The OPAL Discussion Forum

[Philippe Piot <philippe.piot AT gmail.com>]

Dear Jochem,

  Thank you for your suggestion. I am on Fedora 32 [5.10.21-100.fc32.x86_64] with boost version 1.69. Somehow removing the "phiscan" and "data" by hand directories did not suppress the warning messages I mentioned in my previous e-mail. Thank you, -- Philippe.

On Thu, Apr 1, 2021 at 6:58 AM Snuverink Jochem (PSI) <jochem.snuverink AT psi.ch> wrote:

Dear Philippe,

 

The SAMPLER command tries to clean the directory structure before starting a new simulation. Apparently OPAL didn’t succeed in removing the directory (or only partly).

The error message is probably not critical, but it might be that you still have results from a previous simulation, e.g. if you have reduced the number of samples. Best to be a bit alert with this error message.

 

To suppress the message / fix, you can delete the phiscan directory manually before starting the new simulation.

 

To understand better why it failed, may I ask you:

1.       the boost version?

2.       the operating system version?

 

Best wishes,

Jochem

 

Von: opal-request AT lists.psi.ch <opal-request AT lists.psi.ch> Im Auftrag von Philippe Piot
Gesendet: Donnerstag, 1. April 2021 13:13
An: opal <opal AT lists.psi.ch>
Betreff: [Opal] question about SAMPLER feature

 

Dear All,

  I have been using the SAMPLER and always get some message of the form

Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/9', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/9/data") 

  see below extended stdout. Should I care (it seems the output is all fine)? Is there a way to fix this? or suppress this warning (I assumed this is what it is).  I am also attaching my sampler input in case somebody has a suggestion (I have many objectives and I am wondering if there is a smarter way to record them...).

  Thank you very much. All the best,  -- Philippe. 

 

---- STDOUT

 

[piot@localhost scan_example]$ opal varyTDCphase.in
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 2 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 3 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 4 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 5 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 6 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 7 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 7 ready.
Ippl> CommMPI: Child 5 ready.
Ippl> CommMPI: Child 3 ready.
Ippl> CommMPI: Child 6 ready.
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Child 2 ready.
Ippl> CommMPI: Child 4 ready.
Ippl> CommMPI: Initialization complete.
{0}>                ____  _____       ___
{0}>               / __ \|  __ \ /\   | |
{0}>              | |  | | |__) /  \  | |
{0}>              | |  | |  ___/ /\ \ | |
{0}>              | |__| | |  / ____ \| |____
{0}>               \____/|_| /_/    \_\______|
OPAL{0}>
OPAL{0}> This is OPAL (Object Oriented Parallel Accelerator Library) Version 2.4.0
OPAL{0}>             git rev. 44a883d69a3da43ec824a72adf5bdffe1a0dc343
OPAL{0}>
OPAL{0}>
OPAL{0}>                      (c) PSI, http://amas.web.psi.ch
OPAL{0}>
OPAL{0}>
OPAL{0}> The optimiser (former opt-Pilot) is integrated
OPAL{0}>
OPAL{0}> Please send cookies, goodies or other motivations (wine and beer ... )
OPAL{0}> to the OPAL developers opal AT lists.psi.ch
OPAL{0}>
OPAL{0}> Time: 06:02:33 date: 01/04/2021
OPAL{0}>
OPAL{0}> Couldn't find startup file "/home/piot/init.opal".
OPAL{0}> Note: this is not mandatory for an OPAL simulation!
OPAL{0}>
OPAL{0}> * Reading input stream "varyTDCphase.in".
OPAL{0}>
OPAL{0}> opal varyTDCphase.in --inputfile=varyTDCphase.tmpl --outfile=phiscan --outdir=phiscan --num-masters=1 --num-coworkers=2 --restartstep=-2147483648 --jsonDumpFreq=1 --nsamples=11 --simtmpdir=/home/piot/OpalSandBox/scan_example/phiscan --templates=/home/piot/OpalSandBox/scan_example/template
  7 (PID: 214335) ▶ Worker
  1 (PID: 214329) ▶ Sampler
  2 (PID: 214330) ▶ Worker
  3 (PID: 214331) ▶ Worker
  4 (PID: 214332) ▶ Worker
  5 (PID: 214333) ▶ Worker
  6 (PID: 214334) ▶ Worker
  ✔ 40 objectives
  ✔ 1 dvars

  0 (PID: 214328) ▶ Pilot
Warning: argument "one-pilot-converge" not found! Using default value (0).
Warning: argument "restartfile" not found! Using default value ().
Warning: argument "restartfile" not found! Using default value ().
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Initialization complete.
Warning: argument "restartfile" not found! Using default value ().
Warning: argument "restartfile" not found! Using default value ().
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Initialization complete.
Warning: argument "restartfile" not found! Using default value ().
Warning: argument "restartfile" not found! Using default value ().
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/1', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/1/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/0', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/0/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/2', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/2/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/3', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/3/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/5', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/5/data")
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/4', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/4/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/6', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/6/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/7', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/7/data")
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/8', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/8/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/9', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/9/data")
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/10', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/10/data")
Stop Pilot..
OPAL{0}> * End of input stream "varyTDCphase.in".
Stop Worker..
Stop Worker..
Stop Worker..
Stop Worker..
Stop Worker..
Stop Worker..
Stop Sampler..
Timings{0}> -----------------------------------------------------------------
Timings{0}>      Timing results for 8 nodes:
Timings{0}> -----------------------------------------------------------------
Timings{0}> mainTimer........... Wall tot =    160.313, CPU tot =     159.81
Timings{0}>
Timings{0}> Fast inside test.... Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> Initialize geometry. Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> Inside test......... Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> Particle Inside..... Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> Ray tracing......... Wall max =          0, CPU max =          0
Timings{0}>                      Wall avg =          0, CPU avg =          0
Timings{0}>                      Wall min =          0, CPU min =          0
Timings{0}>
Timings{0}> -----------------------------------------------------------------
[1617275113.534395] [localhost:214328:0]          mpool.c:37   UCX  WARN  object 0x14779c0 was not returned to mpool ucp_requests
[1617275113.534415] [localhost:214328:0]          mpool.c:37   UCX  WARN  object 0x1477b80 was not returned to mpool ucp_requests