Dear Philippe,
Thanks for checking and the version numbers. Actually I was mistaken, the warning message comes at the end of the simulation
when OPAL is trying to remove the unwanted files (everything that is not in the KEEP option). I think there is probably a bug in the code there, which means that the deletion of the unwanted files is not working properly. If you don’t mind that these files
are not deleted, you can simply ignore the warning. It will be fixed in a future version.
Best wishes,
Jochem
Von: Philippe Piot <philippe.piot AT gmail.com>
Gesendet: Donnerstag, 1. April 2021 14:16
An: Snuverink Jochem (PSI) <jochem.snuverink AT psi.ch>
Cc: opal <opal AT lists.psi.ch>
Betreff: Re: [Opal] question about SAMPLER feature
Thank you for your suggestion. I am on Fedora 32 [5.10.21-100.fc32.x86_64] with boost version 1.69. Somehow removing the "phiscan" and "data" by hand directories did not suppress the warning messages I mentioned in my previous e-mail.
Thank you, -- Philippe.
Dear Philippe,
The SAMPLER command tries to clean the directory structure before starting a new simulation.
Apparently OPAL didn’t succeed in removing the directory (or only partly).
The error message is probably not critical, but it might be that you still have results
from a previous simulation, e.g. if you have reduced the number of samples. Best to be a bit alert with this error message.
To suppress the message / fix, you can delete the phiscan directory manually before starting
the new simulation.
To understand better why it failed, may I ask you:
1.
the boost version?
2.
the operating system version?
Best wishes,
Jochem
Von:
opal-request AT lists.psi.ch <opal-request AT lists.psi.ch>
Im Auftrag von Philippe Piot
Gesendet: Donnerstag, 1. April 2021 13:13
An: opal <opal AT lists.psi.ch>
Betreff: [Opal] question about SAMPLER feature
I have been using the SAMPLER and always get some message of the form
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/9', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/9/data")
see below extended stdout. Should I care (it seems the output is all fine)? Is there a way to fix this? or suppress this warning (I assumed this is what it is). I am also attaching
my sampler input in case somebody has a suggestion (I have many objectives and I am wondering if there is a smarter way to record them...).
Thank you very much. All the best, -- Philippe.
[piot@localhost scan_example]$ opal varyTDCphase.in
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 2 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 3 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 4 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 5 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 6 on host `localhost.localdomain'.
Ippl> CommMPI: Started job 7 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 7 ready.
Ippl> CommMPI: Child 5 ready.
Ippl> CommMPI: Child 3 ready.
Ippl> CommMPI: Child 6 ready.
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Child 2 ready.
Ippl> CommMPI: Child 4 ready.
Ippl> CommMPI: Initialization complete.
{0}> ____ _____ ___
{0}> / __ \| __ \ /\ | |
{0}> | | | | |__) / \ | |
{0}> | | | | ___/ /\ \ | |
{0}> | |__| | | / ____ \| |____
{0}> \____/|_| /_/ \_\______|
OPAL{0}>
OPAL{0}> This is OPAL (Object Oriented Parallel Accelerator Library) Version 2.4.0
OPAL{0}> git rev. 44a883d69a3da43ec824a72adf5bdffe1a0dc343
OPAL{0}>
OPAL{0}>
OPAL{0}> (c) PSI,
http://amas.web.psi.ch
OPAL{0}>
OPAL{0}>
OPAL{0}> The optimiser (former opt-Pilot) is integrated
OPAL{0}>
OPAL{0}> Please send cookies, goodies or other motivations (wine and beer ... )
OPAL{0}> to the OPAL developers
opal AT lists.psi.ch
OPAL{0}>
OPAL{0}> Time: 06:02:33 date: 01/04/2021
OPAL{0}>
OPAL{0}> Couldn't find startup file "/home/piot/init.opal".
OPAL{0}> Note: this is not mandatory for an OPAL simulation!
OPAL{0}>
OPAL{0}> * Reading input stream "varyTDCphase.in".
OPAL{0}>
OPAL{0}> opal varyTDCphase.in --inputfile=varyTDCphase.tmpl --outfile=phiscan --outdir=phiscan --num-masters=1 --num-coworkers=2 --restartstep=-2147483648 --jsonDumpFreq=1 --nsamples=11 --simtmpdir=/home/piot/OpalSandBox/scan_example/phiscan --templates=/home/piot/OpalSandBox/scan_example/template
7 (PID: 214335) ▶ Worker
1 (PID: 214329) ▶ Sampler
2 (PID: 214330) ▶ Worker
3 (PID: 214331) ▶ Worker
4 (PID: 214332) ▶ Worker
5 (PID: 214333) ▶ Worker
6 (PID: 214334) ▶ Worker
✔ 40 objectives
✔ 1 dvars
0 (PID: 214328) ▶ Pilot
Warning: argument "one-pilot-converge" not found! Using default value (0).
Warning: argument "restartfile" not found! Using default value ().
Warning: argument "restartfile" not found! Using default value ().
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Initialization complete.
Warning: argument "restartfile" not found! Using default value ().
Warning: argument "restartfile" not found! Using default value ().
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Initialization complete.
Warning: argument "restartfile" not found! Using default value ().
Warning: argument "restartfile" not found! Using default value ().
Ippl> CommMPI: Started job 1 on host `localhost.localdomain'.
Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/1', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/1/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/0', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/0/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/2', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/2/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/3', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/3/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/5', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/5/data")
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/4', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/4/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/6', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/6/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/7', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/7/data")
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/8', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/8/data")
Ippl{0}> CommMPI: Parent process waiting for children ...
Ippl{0}> CommMPI: Child 1 ready.
Ippl{0}> CommMPI: Initialization complete.
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/9', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/9/data")
Can't remove file in directory '/home/piot/OpalSandBox/scan_example/phiscan/10', (boost::filesystem::remove: Directory not empty: "/home/piot/OpalSandBox/scan_example/phiscan/10/data")
Stop Pilot..
OPAL{0}> * End of input stream "varyTDCphase.in".
Stop Worker..
Stop Worker..
Stop Worker..
Stop Worker..
Stop Worker..
Stop Worker..
Stop Sampler..
Timings{0}> -----------------------------------------------------------------
Timings{0}> Timing results for 8 nodes:
Timings{0}> -----------------------------------------------------------------
Timings{0}> mainTimer........... Wall tot = 160.313, CPU tot = 159.81
Timings{0}>
Timings{0}> Fast inside test.... Wall max = 0, CPU max = 0
Timings{0}> Wall avg = 0, CPU avg = 0
Timings{0}> Wall min = 0, CPU min = 0
Timings{0}>
Timings{0}> Initialize geometry. Wall max = 0, CPU max = 0
Timings{0}> Wall avg = 0, CPU avg = 0
Timings{0}> Wall min = 0, CPU min = 0
Timings{0}>
Timings{0}> Inside test......... Wall max = 0, CPU max = 0
Timings{0}> Wall avg = 0, CPU avg = 0
Timings{0}> Wall min = 0, CPU min = 0
Timings{0}>
Timings{0}> Particle Inside..... Wall max = 0, CPU max = 0
Timings{0}> Wall avg = 0, CPU avg = 0
Timings{0}> Wall min = 0, CPU min = 0
Timings{0}>
Timings{0}> Ray tracing......... Wall max = 0, CPU max = 0
Timings{0}> Wall avg = 0, CPU avg = 0
Timings{0}> Wall min = 0, CPU min = 0
Timings{0}>
Timings{0}> -----------------------------------------------------------------
[1617275113.534395] [localhost:214328:0] mpool.c:37 UCX WARN object 0x14779c0 was not returned to mpool ucp_requests
[1617275113.534415] [localhost:214328:0] mpool.c:37 UCX WARN object 0x1477b80 was not returned to mpool ucp_requests
|
