The OPAL Discussion Forum

[Norman Huang <norman-huang AT hotmail.com>]

Hi Andreas,

Here's the stdout output.

Using this configuration, a run takes about 3.5 hours. While using a single node only takes 2 hours.

The Pi calculation test was successful, so I think OpenMPI is installed correctly. Does FFT actually
exploit parallel processing, or do I have to use multigrid instead?

Regards,
Norman

---

Subject: Re: Enabling Parallel Computing on OPAL-T
From: andreas.adelmann AT psi.ch
Date: Sat, 26 Nov 2011 08:45:35 +0100
CC: opal AT lists.psi.ch; raoyn AT triumf.ca; krab AT triumf.ca; tplanche AT triumf.ca; fwj AT triumf.ca
To: norman-huang AT hotmail.com

Hello Norman the input files is just fine, I made one small change not related to your problem. 

Can you send me the std-output of your run? On which cluster do you run?

Are you sure that MPI is installed properly i.e. can you run a canonical MPI test - for example 

calculating Pi - (this test comes with every MPI distribution).

You should also contact Fred Jones, I remember having similar problems when I was at Triumf 

in the beginning of this year. 

Cheers Andreas 

On Nov 26, 2011, at 2:54 AM, Norman Huang wrote:

Hi Andreas,

I'm trying to do space charge calculations using parallel computing on OPAL-T, but 

it appears only 1 core is being used.

This is my fieldsolver parameters:

Fs1:FIELDSOLVER, FSTYPE=fft, MX=32, MY=32, MT=2024,

PARFFTX=true, PARFFTY=true, PARFFTT=false,

BCFFTX=open, BCFFTY=open, BCFFTT=open,

BBOXINCR=1, GREENSF=INTEGRATED;

Command used to run the test 'isis.in': mpirun -np 8 opal --commlib mpi isis.in

When it's being run, all 8 cpu cores are active, but only one is doing the

calculations. Furthermore, this run actually took an hour more than a previous

run using a single core. 

Am I missing some configurations?

Regards,

Norman

<isis.in>

------
Dr. sc. math. Andreas (Andy) Adelmann
Staff Scientist
Paul Scherrer Institut WLGB/132 CH-5232 Villigen PSI
Phone Office: xx41 56 310 42 33 Fax: xx41 56 310 31 91
Phone Home: xx41 62 891 91 44
-------------------------------------------------------
Thursdays: ETH CAB H 83.1  +41 44 632 36 72
============================================
The more exotic, the more abstract the knowledge, 
the more profound will be its consequences.
Leon Lederman 
============================================

Ippl> CommMPI: Parent process waiting for children ...
Ippl> CommMPI: Child 3 ready.
Ippl> CommMPI: Child 5 ready.
Ippl> CommMPI: Child 1 ready.
Ippl> CommMPI: Child 7 ready.
Ippl> CommMPI: Child 6 ready.
Ippl> CommMPI: Child 2 ready.
Ippl> CommMPI: Child 4 ready.
Ippl> CommMPI: Initialization complete.
{0}>                ____  _____       ___ 
{0}>               / __ \|  __ \ /\   | | 
{0}>              | |  | | |__) /  \  | |
{0}>              | |  | |  ___/ /\ \ | |
{0}>              | |__| | |  / ____ \| |____
{0}>               \____/|_| /_/    \_\______|
OPAL {0}> 
OPAL {0}> This is OPAL (Object Oriented Parallel Accelerator Library) Version 
1.1.8 SVN version 11730M  (c) PSI, http://amas.web.psi.ch
OPAL {0}> 
OPAL {0}> Please send cookies, goodies or other motivations (wine and beer 
... ) to andreas.adelmann AT psi.ch
OPAL {0}> Time: 13.28.02 date: 28/11/2011
Ippl> CommMPI: Started job 1 on host `trcompdev.triumf.ca'.
Ippl> CommMPI: Started job 2 on host `trcompdev.triumf.ca'.
Ippl> CommMPI: Started job 3 on host `trcompdev.triumf.ca'.
Ippl> CommMPI: Started job 4 on host `trcompdev.triumf.ca'.
Ippl> CommMPI: Started job 5 on host `trcompdev.triumf.ca'.
Ippl> CommMPI: Started job 6 on host `trcompdev.triumf.ca'.
Ippl> CommMPI: Started job 7 on host `trcompdev.triumf.ca'.
OPAL {+0}> No startup file "/home/hnorman/init.opal" found.
OPAL {+0}> Reading input stream "isis.in".
OPAL {+0}> 
OPAL {+0}> 5 elements selected.
OPAL {+0}> 
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}>   Selected Tracking Method == PARALLEL-T, NEW TRACK
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> -------------------------------------------------------------
OPAL {+0}>      READ ININITAL DISTRIBUTION FROM FILE    
OPAL {+0}>      BE AWARE OF THE FACT THAT ONLY NODE 0 IS READING IN 
OPAL {+0}> -------------------------------------------------------------
OPAL {+0}> 
OPAL {+0}> * ************* D I S T R I B U T I O N 
******************************************** 
OPAL {+0}> * Distribution:      DIST1
OPAL {+0}> * Distribution type: FROMFILE
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> * ************* B E A M 
************************************************************ 
OPAL {+0}> * BEAM        BEAM1
OPAL {+0}> * PARTICLE    HMINUS
OPAL {+0}> * CURRENT     0.000583 A
OPAL {+0}> * FREQENCY    2.306e+07 Hz
OPAL {+0}> * CHARGE      -e * 1 
OPAL {+0}> * REST MASS   0.939277 GeV
OPAL {+0}> * MOMENTUM    0.0235826
OPAL {+0}> * NPART       50001
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> * ************* F I E L D S O L V E R 
********************************************** 
OPAL {+0}> * FIELDSOLVER  FS1
OPAL {+0}> * TYPE         FFT
OPAL {+0}> * N-PROCESSORS 8
OPAL {+0}> * MX           32
OPAL {+0}> * MY           32
OPAL {+0}> * MT           2048
OPAL {+0}> * BBOXINCR     1
OPAL {+0}> * GRRENSF      INTEGRATED
OPAL {+0}> * XDIM is parallel  
OPAL {+0}> * YDIM is parallel  
OPAL {+0}> * Z(T)DIM is parallel  
Ippl{+0}> ======UniformCartesian<3,MFLOAT>==begin======
Ippl{+0}> gridSizes[0] = 33
Ippl{+0}> gridSizes[1] = 33
Ippl{+0}> gridSizes[2] = 2049
Ippl{+0}> origin = ( -0.00712132 , -0.00897451 , -0.00339422 )
Ippl{+0}> meshSpacing[0] = 0.000452483
Ippl{+0}> meshSpacing[1] = 0.000618651
Ippl{+0}> meshSpacing[2] = 0.00016344
Ippl{+0}> Dvc[0] = ( -552.506 , -404.105 , -1529.61 )
Ippl{+0}> Dvc[1] = ( 552.506 , -404.105 , -1529.61 )
Ippl{+0}> Dvc[2] = ( -552.506 , 404.105 , -1529.61 )
Ippl{+0}> Dvc[3] = ( 552.506 , 404.105 , -1529.61 )
Ippl{+0}> Dvc[4] = ( -552.506 , -404.105 , 1529.61 )
Ippl{+0}> Dvc[5] = ( 552.506 , -404.105 , 1529.61 )
Ippl{+0}> Dvc[6] = ( -552.506 , 404.105 , 1529.61 )
Ippl{+0}> Dvc[7] = ( 552.506 , 404.105 , 1529.61 )
Ippl{+0}> cell volume = 4.57517e-11
Ippl{+0}> ======UniformCartesian<3,MFLOAT>==end========
Ippl{+0}> 
Ippl{+0}> ParticleSpatialLayout, with particle distribution:
Ippl{+0}>     Number of particles 9303  Number of particles 9160  Number of 
particles 5002  Number of particles 4905  Number of particles 6932  Number of 
particles 7054  Number of particles 3864  Number of particles 3781  
Ippl{+0}> SpatialLayout decomposition = Total Domain = 
{[-0.00712132,0.00735815),[-0.00897451,0.0108223),[-0.00339422,0.331331)}
Ippl{+0}> Local Rnodes = 1
Ippl{+0}>  rnode 0 : 
{[-0.00712132,0.000118412),[-0.00897451,0.00092391),[-0.00339422,0.163969)}
Ippl{+0}> Remote Rnodes = 7
Ippl{+0}>  rnode 0 : 
{[-0.00712132,0.000118412),[0.00092391,0.0108223),[-0.00339422,0.163969)}
Ippl{+0}>  rnode 1 : 
{[0.000118412,0.00735815),[-0.00897451,0.00092391),[-0.00339422,0.163969)}
Ippl{+0}>  rnode 2 : 
{[0.000118412,0.00735815),[0.00092391,0.0108223),[-0.00339422,0.163969)}
Ippl{+0}>  rnode 3 : 
{[-0.00712132,0.000118412),[-0.00897451,0.00092391),[0.163969,0.331331)}
Ippl{+0}>  rnode 4 : 
{[-0.00712132,0.000118412),[0.00092391,0.0108223),[0.163969,0.331331)}
Ippl{+0}>  rnode 5 : 
{[0.000118412,0.00735815),[-0.00897451,0.00092391),[0.163969,0.331331)}
Ippl{+0}>  rnode 6 : 
{[0.000118412,0.00735815),[0.00092391,0.0108223),[0.163969,0.331331)}
Ippl{+0}> Internal FieldLayout = Domain = {[0:31:1],[0:31:1],[0:2047:1]}
Ippl{+0}> FieldLayoutUsers = 3
Ippl{+0}> Total number of vnodes = 8
Ippl{+0}> Local Vnodes = 1
Ippl{+0}>  vnode 0: Node = 0 ; vnode_m = 0 ; Domain = 
{[0:15:1],[0:15:1],[0:1023:1]}
Ippl{+0}> Remote Vnodes = 7
Ippl{+0}>  vnode 0 : Node = 2 ; vnode_m = 2 ; Domain = 
{[0:15:1],[16:31:1],[0:1023:1]}
Ippl{+0}>  vnode 1 : Node = 4 ; vnode_m = 4 ; Domain = 
{[16:31:1],[0:15:1],[0:1023:1]}
Ippl{+0}>  vnode 2 : Node = 6 ; vnode_m = 6 ; Domain = 
{[16:31:1],[16:31:1],[0:1023:1]}
Ippl{+0}>  vnode 3 : Node = 1 ; vnode_m = 1 ; Domain = 
{[0:15:1],[0:15:1],[1024:2047:1]}
Ippl{+0}>  vnode 4 : Node = 3 ; vnode_m = 3 ; Domain = 
{[0:15:1],[16:31:1],[1024:2047:1]}
Ippl{+0}>  vnode 5 : Node = 5 ; vnode_m = 5 ; Domain = 
{[16:31:1],[0:15:1],[1024:2047:1]}
Ippl{+0}>  vnode 6 : Node = 7 ; vnode_m = 7 ; Domain = 
{[16:31:1],[16:31:1],[1024:2047:1]}
Ippl{+0}> 
OPAL {+0}> 
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> * ************** B U N C H 
********************************************************* 
OPAL {+0}> * NP= 50001 Qtot= 0.0252819 [nC]  Qi= 5.05627e-16 [C]
OPAL {+0}> * Ekin= 0.296 [MeV] dEkin= 1.85735e-06 [MeV]
OPAL {+0}> * rmax= ( 0.00713191 , 0.010513 , 0.33125 ) [m]
OPAL {+0}> * rmin= ( -0.00689508 , -0.00866518 , -0.0033125 ) [m]
OPAL {+0}> * rms beam size= ( 0.00120963 , 0.00256648 , 0.0947017 ) [m]
OPAL {+0}> * rms momenta= ( 2.93579e-05 , 2.98691e-05 , 7.87843e-08 ) [beta 
gamma]
OPAL {+0}> * mean beam size= ( -2.76717e-05 , -2.60189e-05 , 0.163579 ) [m]
OPAL {+0}> * mean momenta= ( 1.0715e-06 , 8.18541e-07 , 0.0251072 ) [beta 
gamma]
OPAL {+0}> * rms emmitance= ( 1.13345e-06 , 1.14852e-06 , 2.97166e-07 ) (not 
normalized)
OPAL {+0}> * rms correlation= ( -0.598198 , -0.926553 , 0.000526253 )
OPAL {+0}> * dh= 0.01 [m] dT= 1e-09 [s]
OPAL {+0}> * hr= ( 0.000452483 , 0.000618651 , 0.00016344 ) [m]
OPAL {+0}> * spos= 0.164052 [m]
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> Phase space dump frequency 1 and statistics dump frequency 10 
w.r.t. the time step.
OPAL {+0}> totalParticle_i= 50001
OPAL {+0}> Track start at: 13.28.03, t= 0; zstop at: 1.53 [m]
OPAL {+0}> Executing ParallelTTracker, initial DT 1e-09 [s];
OPAL {+0}> max integration steps 100001, step= 1, Nplocal= 9303
OPAL {+0}> 
OPAL {+0}> --- BEGIN FIELD LIST 
---------------------------------------------------------------
OPAL {+0}> 
OPAL {+0}> --- 0.824687 m -- 0.970991 m -- alpha = 0 -- beta = 0 
------------------------------
OPAL {+0}> Q1
OPAL {+0}> --- 0.987907 m -- 1.15961 m -- alpha = 0 -- beta = 0 
-------------------------------
OPAL {+0}> Q2
OPAL {+0}> --- 1.35559 m -- 1.52729 m -- alpha = 0 -- beta = 0 
--------------------------------
OPAL {+0}> Q3
OPAL {+0}> 
OPAL {+0}> --- END FIELD LIST 
-----------------------------------------------------------------
OPAL {+0}> 
ParallelTTrackDebug {+7}> rmax1= ( 0.00700091 , 0.010322 , 0.32797 ) rmin= ( 
-0.00676286 , -0.00847264 , -8.04711e-08 )
ParallelTTrackDebug {+1}> rmax1= ( 0.00700091 , 0.010322 , 0.32797 ) rmin= ( 
-0.00676286 , -0.00847264 , -8.04711e-08 )
ParallelTTrackDebug {+2}> rmax1= ( 0.00700091 , 0.010322 , 0.32797 ) rmin= ( 
-0.00676286 , -0.00847264 , -8.04711e-08 )
ParallelTTrackDebug {+3}> rmax1= ( 0.00700091 , 0.010322 , 0.32797 ) rmin= ( 
-0.00676286 , -0.00847264 , -8.04711e-08 )
ParallelTTrackDebug {+4}> rmax1= ( 0.00700091 , 0.010322 , 0.32797 ) rmin= ( 
-0.00676286 , -0.00847264 , -8.04711e-08 )
ParallelTTrackDebug {+5}> rmax1= ( 0.00700091 , 0.010322 , 0.32797 ) rmin= ( 
-0.00676286 , -0.00847264 , -8.04711e-08 )
ParallelTTrackDebug {+6}> rmax1= ( 0.00700091 , 0.010322 , 0.32797 ) rmin= ( 
-0.00676286 , -0.00847264 , -8.04711e-08 )
ParallelTTrackDebug {+0}> rmax1= ( 0.00700091 , 0.010322 , 0.32797 ) rmin= ( 
-0.00676286 , -0.00847264 , -8.04711e-08 )
OPAL {+0}> Emission done. Switching back to track timestep: 1e-09
OPAL {+0}> * Deleted 0 particles, remaining 50001particles
OPAL {+0}> 13.28.10 Step 1 at 0.171151 [m] t= 1e-09 [s] E=0.296 [MeV] 
OPAL {+0}> * Wrote beam phase space.
OPAL {+0}> * ************** B U N C H 
********************************************************* 
OPAL {+0}> * NP= 50001 Qtot= 0.0252819 [nC]  Qi= 5.05627e-16 [C]
OPAL {+0}> * Ekin= 0.296 [MeV] dEkin= 1.89556e-06 [MeV]
OPAL {+0}> * rmax= ( 0.00714328 , 0.0105083 , 0.338774 ) [m]
OPAL {+0}> * rmin= ( -0.00688449 , -0.00864797 , 0.00421197 ) [m]
OPAL {+0}> * rms beam size= ( 0.00120439 , 0.00255819 , 0.0947017 ) [m]
OPAL {+0}> * rms momenta= ( 2.93284e-05 , 2.98114e-05 , 8.0405e-08 ) [beta 
gamma]
OPAL {+0}> * mean beam size= ( -2.76717e-05 , -2.60189e-05 , 0.171104 ) [m]
OPAL {+0}> * mean momenta= ( -3.70646e-14 , -2.53474e-13 , 0.0251072 ) [beta 
gamma]
OPAL {+0}> * rms emmitance= ( 1.13353e-06 , 1.14744e-06 , 3.01711e-07 ) (not 
normalized)
OPAL {+0}> * rms correlation= ( -0.592315 , -0.925904 , 0.101568 )
OPAL {+0}> * dh= 0.01 [m] dT= 1e-09 [s]
OPAL {+0}> * hr= ( 0.000452509 , 0.000617943 , 0.00016344 ) [m]
OPAL {+0}> * spos= 0.171151 [m]
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> * Deleted 0 particles, remaining 50001particles
OPAL {+0}> 13.28.18 Step 2 at 0.178675 [m] t= 2e-09 [s] E=0.296 [MeV] 
OPAL {+0}> * Wrote beam phase space.
OPAL {+0}> * ************** B U N C H 
********************************************************* 
OPAL {+0}> * NP= 50001 Qtot= 0.0252819 [nC]  Qi= 5.05627e-16 [C]
OPAL {+0}> * Ekin= 0.296 [MeV] dEkin= 2.00264e-06 [MeV]
OPAL {+0}> * rmax= ( 0.00714801 , 0.0105066 , 0.346299 ) [m]
OPAL {+0}> * rmin= ( -0.00686713 , -0.0086335 , 0.0117365 ) [m]
OPAL {+0}> * rms beam size= ( 0.00119921 , 0.00254992 , 0.0947017 ) [m]
OPAL {+0}> * rms momenta= ( 2.92993e-05 , 2.97536e-05 , 8.4947e-08 ) [beta 
gamma]
OPAL {+0}> * mean beam size= ( -2.76717e-05 , -2.60189e-05 , 0.178628 ) [m]
OPAL {+0}> * mean momenta= ( -7.48175e-14 , -5.03331e-13 , 0.0251072 ) [beta 
gamma]
OPAL {+0}> * rms emmitance= ( 1.13363e-06 , 1.14638e-06 , 3.14452e-07 ) (not 
normalized)
OPAL {+0}> * rms correlation= ( -0.586347 , -0.925246 , 0.191963 )
OPAL {+0}> * dh= 0.01 [m] dT= 1e-09 [s]
OPAL {+0}> * hr= ( 0.000452101 , 0.000617422 , 0.00016344 ) [m]
OPAL {+0}> * spos= 0.178675 [m]
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> * Deleted 0 particles, remaining 50001particles
OPAL {+0}> 13.28.26 Step 3 at 0.1862 [m] t= 3e-09 [s] E=0.296 [MeV] 
OPAL {+0}> * Wrote beam phase space.
OPAL {+0}> * ************** B U N C H 
********************************************************* 
OPAL {+0}> * NP= 50001 Qtot= 0.0252819 [nC]  Qi= 5.05627e-16 [C]
OPAL {+0}> * Ekin= 0.296 [MeV] dEkin= 2.16953e-06 [MeV]
OPAL {+0}> * rmax= ( 0.00715277 , 0.0105049 , 0.353824 ) [m]
OPAL {+0}> * rmin= ( -0.00684977 , -0.00861904 , 0.019261 ) [m]
OPAL {+0}> * rms beam size= ( 0.00119409 , 0.00254168 , 0.0947017 ) [m]
OPAL {+0}> * rms momenta= ( 2.92705e-05 , 2.96956e-05 , 9.2026e-08 ) [beta 
gamma]
OPAL {+0}> * mean beam size= ( -2.76717e-05 , -2.60189e-05 , 0.186153 ) [m]
OPAL {+0}> * mean momenta= ( -1.13148e-13 , -7.49959e-13 , 0.0251072 ) [beta 
gamma]
OPAL {+0}> * rms emmitance= ( 1.13374e-06 , 1.14532e-06 , 3.34632e-07 ) (not 
normalized)
OPAL {+0}> * rms correlation= ( -0.580291 , -0.924581 , 0.26574 )
OPAL {+0}> * dh= 0.01 [m] dT= 1e-09 [s]
OPAL {+0}> * hr= ( 0.000451695 , 0.000616903 , 0.00016344 ) [m]
OPAL {+0}> * spos= 0.1862 [m]
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> * Deleted 0 particles, remaining 50001particles
OPAL {+0}> 13.28.34 Step 4 at 0.193725 [m] t= 4e-09 [s] E=0.296 [MeV] 
OPAL {+0}> * Wrote beam phase space.
OPAL {+0}> * ************** B U N C H 
********************************************************* 
OPAL {+0}> * NP= 50001 Qtot= 0.0252819 [nC]  Qi= 5.05627e-16 [C]
OPAL {+0}> * Ekin= 0.296 [MeV] dEkin= 2.38309e-06 [MeV]
OPAL {+0}> * rmax= ( 0.00715754 , 0.0105033 , 0.361348 ) [m]
OPAL {+0}> * rmin= ( -0.00683244 , -0.0086046 , 0.0267854 ) [m]
OPAL {+0}> * rms beam size= ( 0.00118903 , 0.00253347 , 0.0947018 ) [m]
OPAL {+0}> * rms momenta= ( 2.9242e-05 , 2.96375e-05 , 1.01085e-07 ) [beta 
gamma]
OPAL {+0}> * mean beam size= ( -2.76717e-05 , -2.60189e-05 , 0.193678 ) [m]
OPAL {+0}> * mean momenta= ( -1.51936e-13 , -9.94234e-13 , 0.0251072 ) [beta 
gamma]
OPAL {+0}> * rms emmitance= ( 1.13385e-06 , 1.14426e-06 , 3.60894e-07 ) (not 
normalized)
OPAL {+0}> * rms correlation= ( -0.574146 , -0.923907 , 0.322615 )
OPAL {+0}> * dh= 0.01 [m] dT= 1e-09 [s]
OPAL {+0}> * hr= ( 0.00045129 , 0.000616384 , 0.000163441 ) [m]
OPAL {+0}> * spos= 0.193725 [m]
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> * Deleted 0 particles, remaining 50001particles
OPAL {+0}> 13.28.42 Step 5 at 0.201249 [m] t= 5e-09 [s] E=0.296 [MeV] 
OPAL {+0}> * Wrote beam phase space.
OPAL {+0}> * ************** B U N C H 
********************************************************* 
OPAL {+0}> * NP= 50001 Qtot= 0.0252819 [nC]  Qi= 5.05627e-16 [C]
OPAL {+0}> * Ekin= 0.296 [MeV] dEkin= 2.6329e-06 [MeV]
OPAL {+0}> * rmax= ( 0.00716233 , 0.0105017 , 0.368873 ) [m]
OPAL {+0}> * rmin= ( -0.00681512 , -0.00859017 , 0.0343099 ) [m]
OPAL {+0}> * rms beam size= ( 0.00118403 , 0.00252527 , 0.0947018 ) [m]
OPAL {+0}> * rms momenta= ( 2.9214e-05 , 2.95792e-05 , 1.11681e-07 ) [beta 
gamma]
OPAL {+0}> * mean beam size= ( -2.76717e-05 , -2.60189e-05 , 0.201202 ) [m]
OPAL {+0}> * mean momenta= ( -1.91053e-13 , -1.23738e-12 , 0.0251072 ) [beta 
gamma]
OPAL {+0}> * rms emmitance= ( 1.13397e-06 , 1.1432e-06 , 3.92169e-07 ) (not 
normalized)
OPAL {+0}> * rms correlation= ( -0.567912 , -0.923224 , 0.365111 )
OPAL {+0}> * dh= 0.01 [m] dT= 1e-09 [s]
OPAL {+0}> * hr= ( 0.000450885 , 0.000615866 , 0.000163441 ) [m]
OPAL {+0}> * spos= 0.201249 [m]
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
OPAL {+0}> * Deleted 0 particles, remaining 50001particles
OPAL {+0}> 13.28.51 Step 6 at 0.208774 [m] t= 6e-09 [s] E=0.296 [MeV] 
OPAL {+0}> * Wrote beam phase space.
OPAL {+0}> * ************** B U N C H 
********************************************************* 
OPAL {+0}> * NP= 50001 Qtot= 0.0252819 [nC]  Qi= 5.05627e-16 [C]
OPAL {+0}> * Ekin= 0.296 [MeV] dEkin= 2.90969e-06 [MeV]
OPAL {+0}> * rmax= ( 0.00716713 , 0.0105001 , 0.376398 ) [m]
OPAL {+0}> * rmin= ( -0.00679782 , -0.00857577 , 0.0418343 ) [m]
OPAL {+0}> * rms beam size= ( 0.00117908 , 0.0025171 , 0.0947018 ) [m]
OPAL {+0}> * rms momenta= ( 2.91862e-05 , 2.95208e-05 , 1.23422e-07 ) [beta 
gamma]
OPAL {+0}> * mean beam size= ( -2.76717e-05 , -2.60189e-05 , 0.208727 ) [m]
OPAL {+0}> * mean momenta= ( -2.30359e-13 , -1.48027e-12 , 0.0251072 ) [beta 
gamma]
OPAL {+0}> * rms emmitance= ( 1.1341e-06 , 1.14215e-06 , 4.27357e-07 ) (not 
normalized)
OPAL {+0}> * rms correlation= ( -0.561587 , -0.922533 , 0.396597 )
OPAL {+0}> * dh= 0.01 [m] dT= 1e-09 [s]
OPAL {+0}> * hr= ( 0.000450482 , 0.000615349 , 0.000163441 ) [m]
OPAL {+0}> * spos= 0.208774 [m]
OPAL {+0}> * 
**********************************************************************************
 
OPAL {+0}> 
8 total processes killed (some possibly by mpirun during cleanup)