Skip to Content.
Sympa Menu

opal - AW: [Opal] question about SAMPLER feature

opal AT lists.psi.ch

Subject: The OPAL Discussion Forum

List archive

AW: [Opal] question about SAMPLER feature


Chronological Thread  
  • From: "Snuverink Jochem (PSI)" <jochem.snuverink AT psi.ch>
  • To: "'philippe.piot AT gmail.com'" <philippe.piot AT gmail.com>
  • Cc: opal <opal AT lists.psi.ch>
  • Subject: AW: [Opal] question about SAMPLER feature
  • Date: Thu, 1 Apr 2021 12:58:05 +0000
  • Accept-language: en-US, de-CH
  • Authentication-results: localhost; iprev=pass (psi-seppmail1.ethz.ch) smtp.remote-ip=129.132.93.141; spf=pass smtp.mailfrom=psi.ch; dmarc=skipped

Dear Philippe,

 

Thanks for checking and the version numbers. Actually I was mistaken, the warning message comes at the end of the simulation when OPAL is trying to remove the unwanted files (everything that is not in the KEEP option). I think there is probably a bug in the code there, which means that the deletion of the unwanted files is not working properly. If you don’t mind that these files are not deleted, you can simply ignore the warning. It will be fixed in a future version.

 

Best wishes,

Jochem

 

Von: Philippe Piot <philippe.piot AT gmail.com>
Gesendet: Donnerstag, 1. April 2021
14:16
An: Snuverink Jochem (PSI) <jochem.snuverink AT psi.ch>
Cc: opal <opal AT lists.psi.ch>
Betreff: Re: [Opal] question about SAMPLER feature

 

Dear Jochem,

  Thank you for your suggestion. I am on Fedora 32 [5.10.21-100.fc32.x86_64] with boost version 1.69. Somehow removing the "phiscan" and "data" by hand directories did not suppress the warning messages I mentioned in my previous e-mail. Thank you, -- Philippe.

 

On Thu, Apr 1, 2021 at 6:58 AM Snuverink Jochem (PSI) <jochem.snuverink AT psi.ch> wrote:

Dear Philippe,

 

The SAMPLER command tries to clean the directory structure before starting a new simulation. Apparently OPAL didn’t succeed in removing the directory (or only partly).

The error message is probably not critical, but it might be that you still have results from a previous simulation, e.g. if you have reduced the number of samples. Best to be a bit alert with this error message.

 

To suppress the message / fix, you can delete the phiscan directory manually before starting the new simulation.

 

To understand better why it failed, may I ask you:

1.       the boost version?

2.       the operating system version?

 

Best wishes,

Jochem

 

Von: opal-request AT lists.psi.ch <opal-request AT lists.psi.ch> Im Auftrag von Philippe Piot
Gesendet: Donnerstag, 1. April 2021 13:13
An: opal <opal AT lists.psi.ch>
Betreff: [Opal] question about SAMPLER feature

 

Dear All,

  I have been using the SAMPLER and always get some message of the form

Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/9', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/9/data") 

  see below extended stdout. Should I care (it seems the output is all fine)? Is there a way to fix this? or suppress this warning (I assumed this is what it is).  I am also attaching my sampler input in case somebody has a suggestion (I have many objectives and I am wondering if there is a smarter way to record them...).

  Thank you very much. All the best,  -- Philippe. 

 

---- STDOUT                                                                

 

[piot@localhost scan_example]$ opal varyTDCphase.in
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 2 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 3 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 4 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 5 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 6 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 7 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 7 ready.
Ippl> CommMPI: Child 5 ready.
Ippl> CommMPI: Child 3 ready.
Ippl> CommMPI: Child 6 ready.
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Child 2 ready.
Ippl> CommMPI: Child 4 ready.
Ippl> CommMPI: Initialization complete.
{0}>                ____  _____       ___
{0}>               / __ \|  __ \ /\   | |
{0}>              | |  | | |__) /  \  | |
{0}>              | |  | |  ___/ /\ \ | |
{0}>              | |__| | |  / ____ \| |____
{0}>               \____/|_| /_/    \_\______|
OPAL{0}>
OPAL{0}> This is OPAL (Object Oriented Parallel Accelerator Library) Version 2.4.0
OPAL{0}>             git rev. 44a883d69a3da43ec824a72adf5bdffe1a0dc343
OPAL{0}>
OPAL{0}>
OPAL{0}>                      (c) PSI, http://amas.web.psi.ch
OPAL{0}>
OPAL{0}>
OPAL{0}> The optimiser (former opt-Pilot) is integrated
OPAL{0}>
OPAL{0}> Please send cookies, goodies or other motivations (wine and beer ... )
OPAL{0}> to the OPAL developers opal AT lists.psi.ch
OPAL{0}>
OPAL{0}> Time: 06:02:33 date: 01/04/2021
OPAL{0}>
OPAL{0}> Couldn't find startup file "/home/piot/init.opal".
OPAL{0}> Note: this is not mandatory for an OPAL simulation!
OPAL{0}>
OPAL{0}> * Reading input stream "varyTDCphase.in".
OPAL{0}>
OPAL{0}> opal varyTDCphase.in --inputfile=varyTDCphase.tmpl --outfile=phiscan --outdir=phiscan --num-masters=1 --num-coworkers=2 --restartstep=-2147483648 --jsonDumpFreq=1 --nsamples=11 --simtmpdir=/home/piot/OpalSandBox/scan_example/phiscan --templates=/home/piot/OpalSandBox/scan_example/template
  7 (PID: 214335) Worker
  1 (PID: 214329) Sampler
  2 (PID: 214330) Worker
  3 (PID: 214331) Worker
  4 (PID: 214332) Worker
  5 (PID: 214333) Worker
  6 (PID: 214334) Worker
  40 objectives
  1 dvars

  0 (PID: 214328) Pilot
Warning: argument "one-pilot-converge" not found! Using default value (0).
Warning: argument "restartfile" not found! Using default value ().
Warning: argument "restartfile" not found! Using default value ().
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Initialization complete.
Warning: argument "restartfile" not found! Using default value ().
Warning: argument "restartfile" not found! Using default value ().
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Initialization complete.
Warning: argument "restartfile" not found! Using default value ().
Warning: argument "restartfile" not found! Using default value ().
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/1', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/1/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/0', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/0/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/2', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/2/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/3', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/3/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/5', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/5/data")
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/4', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/4/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/6', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/6/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/7', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/7/data")
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/8', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/8/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/9', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/9/data")
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/10', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/10/data")
Stop Pilot..
OPAL{0}> * End of input stream "varyTDCphase.in".
Stop Worker..
Stop Worker..
Stop Worker..
Stop Worker..
Stop Worker..
Stop Worker..
Stop Sampler..
Timings{0}> -----------------------------------------------------------------
Timings{0}>      Timing results for 8 nodes:
Timings{0}> -----------------------------------------------------------------
Timings{0}> mainTimer........... Wall tot =    160.313, CPU tot =     159.81
Timings{0}>
Timings{0}> Fast inside test.... Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> Initialize geometry. Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> Inside test......... Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> Particle Inside..... Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> Ray tracing......... Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> -----------------------------------------------------------------
[1617275113.534395] [localhost:214328:0]          mpool.c:37   UCX  WARN  object 0x14779c0 was not returned to mpool ucp_requests
[1617275113.534415] [localhost:214328:0]          mpool.c:37   UCX  WARN  object 0x1477b80 was not returned to mpool ucp_requests




Archive powered by MHonArc 2.6.19.

Top of Page