diff --git a/CHANGES/v2.11.md b/CHANGES/v2.11.md index 7c80256e5f..4d55e5d4e8 100644 --- a/CHANGES/v2.11.md +++ b/CHANGES/v2.11.md @@ -38,6 +38,9 @@ The entries below give the details; the main cases are: - Replica exchange through GREX evaluates both configurations with the same updated time-dependent bias. This changes exchange probabilities with the 2.11 kernel also when using older GROMACS patches; GROMACS does not need to be patched again. - [UPPER_WALLS](UPPER_WALLS.md) and [LOWER_WALLS](LOWER_WALLS.md) acting on a periodic argument do not apply the periodic boundary conditions to the difference between the argument and `AT`. - [JCOUPLING](JCOUPLING.md) with `TYPE=CUSTOM` needs `A`, `B` and `C`, and `SHIFT` is zero by default. `ARG=*` leaves out the values that the action cannot use. + - [ANTIBETARMSD](ANTIBETARMSD.md) and [PARABETARMSD](PARABETARMSD.md) use `STRANDS_CUTOFF=1` (nm) by default (`STRANDS_CUTOFF=0` uses all the pairs of strands). + The default switching function of these two and of [ALPHARMSD](ALPHARMSD.md) is stretched to be zero at `D_MAX`, where it is 1e-5, as in the other actions + that take `R_0`, `NN` and `MM` (the number of segments changes by at most 1e-5 per segment within the cutoff). - Functions of vectors are evaluated also where all their arguments are zero (e.g. [CUSTOM](CUSTOM.md) with `FUNC=x+1`); [MOMENTS](MOMENTS.md) of periodic variables were wrong. - [COORD_ANGLES](COORD_ANGLES.md) with more than one central atom; [GYRATION](GYRATION.md) with `TYPE=RGYR_1` and `TYPE=RGYR_3` (they were swapped). - Wrong forces were fixed in [CENTER](CENTER.md) and [COM](COM.md) with `PHASES` in non-orthorhombic cells, [MATRIX_PRODUCT](MATRIX_PRODUCT.md) of sparse matrices, @@ -81,6 +84,14 @@ The entries below give the details; the main cases are: - [READ](READ.md) has an `IGNORE_COMPONENT` flag, to read a component (e.g. `d.x`) as a plain value. - The experimental openaccPTM plugin (`plugins/openaccPTM`, compiled separately with the NVIDIA HPC SDK) adds the `USEGPU` flag to some actions, e.g. [DISTANCE](DISTANCE.md), [KDE](KDE.md), [SAXS](SAXS.md) and [SANS](SANS.md), computed on the GPU with OpenACC. + With MPI the first rank computes these actions on its GPU; with `MULTIGPU` their tasks are split between the ranks, each using its own GPU. + With several GPUs on a node and no MD code (e.g. `mpirun -np 4 plumed driver`) the ranks of the node use the GPUs in turn. + With `USEGPU`, [COORDINATIONNUMBER](COORDINATIONNUMBER.md) and [Q1](Q1.md)-[Q6](Q6.md) compute the sums over the neighbours on the GPU + without building the contact matrix, with the kernels and the linked cells of the CPU version (on one A100, 20000 atoms: + 3.6 ms per step for COORDINATIONNUMBER and 12.6 ms for Q6; 4.0 and 15.7 ms on 32 CPU cores). On the GPU the forces of the matrices are gathered in one pass by default (`AVOID_THREAD_GATHER` for the + low memory version, which was the default and is about two times slower). + The data of the actions (e.g. the list of the segments of [ALPHARMSD](ALPHARMSD.md), [ANTIBETARMSD](ANTIBETARMSD.md) and [PARABETARMSD](PARABETARMSD.md)) stays on the GPU between the steps + and is copied again only when the action may have changed it, instead of being copied twice per step. #### Restart and checkpoints @@ -183,6 +194,17 @@ The entries below give the details; the main cases are: - [ANTIBETARMSD](ANTIBETARMSD.md) and [PARABETARMSD](PARABETARMSD.md) with `STYLE=inter` crashed when a chain contained a single residue; they are now an error only when no pair of strands can be built. - `TYPE` of the three shortcuts is not case sensitive (`TYPE=drmsd` was an error). - The secondary structure collective variables with `TYPE=DRMSD` (the default) are faster: the derivatives are accumulated per atom and the virial is computed from the atoms of each segment, which reduces the cost of the force calculation by about 40%. The setup of [ANTIBETARMSD](ANTIBETARMSD.md) and [PARABETARMSD](PARABETARMSD.md) for large proteins, which build hundreds of thousands of segments, is about 20% faster. Their documentation has been revised (default `R_0`, periodic boundary conditions, `STRANDS_CUTOFF`, `STYLE`). + - [ANTIBETARMSD](ANTIBETARMSD.md) and [PARABETARMSD](PARABETARMSD.md) compute the number of segments that are similar to a sheet with a single action + (`ANTIBETARMSD_SCALAR`, `PARABETARMSD_SCALAR`), which skips the pairs of strands further apart than `STRANDS_CUTOFF`, adds the derivatives of each segment + directly to the atoms and does not create a vector with an element per segment; the vectors of the expanded input are computed only if they are used elsewhere. + The results are the same. With 144 peptides (370k pairs of strands, 20k atoms) and `STRANDS_CUTOFF=1` the three secondary structure variables take 41 ms per step + instead of 298 ms on one CPU core (6.1 ms instead of 100 ms on 32 cores). The derivatives of a segment are computed only when its switching function + is not constant. With `USEGPU` and `TYPE=DRMSD` the same calculation is done on the GPU (`ANTIBETARMSD_SCALAR_ACC` and `PARABETARMSD_SCALAR_ACC` + in the openaccPTM plugin: 1.8 ms per step for the three variables of the example above on one A100); with `USEGPU` and the other types the vectors are still used. + [ALPHARMSD](ALPHARMSD.md) is computed in the same way (`ALPHARMSD_SCALAR`, `ALPHARMSD_SCALAR_ACC`), which is about 1.7 times faster on the CPU. + `STRANDS_CUTOFF` is 1 nm by default. When the switching function goes to zero at a finite distance (as the default one now does, or with `D_MAX` in `LESS_THAN`), the single action + also skips the pairs of strands that are so far apart that their segment certainly has a distance from the reference beyond it: the result does not + change, and with `STRANDS_CUTOFF=0` ANTIBETARMSD for the 144 peptides above takes 160 ms per step on one CPU core instead of 930 ms (0.6 ms on one A100). - Fixes in the collective variables: - [DIHEDRAL_CORRELATION](DIHEDRAL_CORRELATION.md) with `ATOMS` (a single variable) crashed: the atoms were never requested. - [CHARGE](CHARGE.md) returned the masses of the atoms instead of their charges, and an error is given when the MD code does not provide the charges. @@ -502,6 +524,11 @@ The entries below give the details; the main cases are: took time proportional to their number. With 10 atoms, a 0.6 nm cutoff and a 20 nm box, [COORDINATIONNUMBER](COORDINATIONNUMBER.md) took 0.75 ms per step and now takes 0.01 ms, [COORDINATION](COORDINATION.md) with `NLISTCELLS` and `NL_STRIDE=1` 0.66 ms and now 0.04 ms. The pairs found are the same; with `NLISTCELLS`, when there are fewer cells than before, the order of the pairs, and so the last digits of the results, can change. + - Building the linked cells (used by [CONTACT_MATRIX](CONTACT_MATRIX.md) and the variables built on it, by `NLISTCELLS`, by the fused + [COORDINATIONNUMBER](COORDINATIONNUMBER.md) and [Q6](Q6.md) and by other actions) is about 2 times faster on one thread, as the cell of each + atom and its position wrapped in the box are found with one change of coordinates instead of four, and it is split among the OpenMP threads also when the atoms + are placed in the cells (it was serial). With 20000 atoms it took 0.86 ms on one thread and 0.30 ms on 32, and now takes 0.40 and 0.09 ms; + [COORDINATIONNUMBER](COORDINATIONNUMBER.md) of 20000 atoms on 32 cores is 16% faster. The cells and the order of their atoms are identical. - Making the molecules whole no longer opens an OpenMP parallel region when it runs on one thread, which happens for every action with few atoms (e.g. [DISTANCE](DISTANCE.md)) at every step. With 200 [DISTANCE](DISTANCE.md) and a [RESTRAINT](RESTRAINT.md) on them the calculation is almost twice as fast. - The virial of the collective variables that compute it from the atomic derivatives (e.g. [DISTANCE](DISTANCE.md), [GYRATION](GYRATION.md) and the multicolvars) @@ -520,6 +547,20 @@ The entries below give the details; the main cases are: [COORDINATIONNUMBER](COORDINATIONNUMBER.md) is a further 1.4 times faster in the orthorhombic box and in the rhombic dodecahedron and 1.25 in a truncated octahedron, and building the list of [COORDINATION](COORDINATION.md) with `NLISTCELLS` 1.5 and 2.4 times faster. The order of the neighbors changes, so the results can change in the last digits (relative differences of 1e-14). + - [COORDINATIONNUMBER](COORDINATIONNUMBER.md) and [Q1](Q1.md), [Q3](Q3.md), [Q4](Q4.md), [Q6](Q6.md) (and so the actions that use them, e.g. + [LOCAL_Q6](LOCAL_Q6.md) and [LOCAL_AVERAGE](LOCAL_AVERAGE.md)) compute the sums over the neighbours of each atom in one pass over the linked cells, + without building the contact matrix (and, for the Steinhardt parameters, the matrices of the spherical harmonics); with `SPECIES` the force on each atom + is gathered from its own neighbours, so that the forces on the atoms do not depend on the number of OpenMP threads. On two cores, with 2000 to 20000 atoms + and a 0.6 nm cutoff, [COORDINATIONNUMBER](COORDINATIONNUMBER.md) is 1.6-2.3 times faster and [Q6](Q6.md) 2.4-4 times faster, and the small inputs + are not slower (64 atoms: 1.3 times faster). The values are the same and the forces change in the last digits (relative differences of 1e-14). + With `MASK`, and for [COORDINATION_MOMENTS](COORDINATION_MOMENTS.md), the contact matrix is used as before. The actions of the contact matrix + (e.g. `q6_mat`, `q6_sh`) are still created, and are computed only when another action uses them. + For the Steinhardt parameters the coordination numbers (`q6_denom`) are computed in the same pass as the sums of the spherical harmonics, the forces + are contracted pair by pair, and the norms of the sums (`q6_norm`) are computed by one action: [Q6](Q6.md) is a further 1.9 times faster on two cores. + With few atoms in `SPECIESA` (e.g. one ion against all the water molecules) the linked cells are not built: the atoms of `SPECIESB` are + shared between the threads (one atom against 100000 water oxygens: 2.7 times faster, and faster than [COORDINATION](COORDINATION.md) without a neighbor list). + - [COORDINATION](COORDINATION.md) with `NLISTCELLS` builds the list as with `NLIST` when one of the groups has at most 8 atoms: sorting all the atoms + into cells costs more than one distance per pair (one atom against 100000 water oxygens: 2.4 times faster when the list is updated at every step). - [DFSCLUSTERING](DFSCLUSTERING.md) (and so the cluster actions that use it, e.g. [CLUSTER_WITHSURFACE](CLUSTER_WITHSURFACE.md)) wrote outside the list of the neighbors of a node when the adjacency matrix was not flagged as symmetric, as for a product of matrices: each edge was then stored twice, and a node with more connections than half the columns of the matrix overwrote the list of the next node. The clusters could then depend on the order of the neighbors. diff --git a/developer-doc/Migration211.md b/developer-doc/Migration211.md index 46ee333baa..d25a8b5fe2 100644 --- a/developer-doc/Migration211.md +++ b/developer-doc/Migration211.md @@ -35,6 +35,11 @@ These keywords are still read, as the keyword that replaces them, with a warning - UPPER_WALLS and LOWER_WALLS acting on a periodic argument do not apply the periodic boundary conditions to the difference between the argument and `AT` any more. - `ARG=*` leaves out the values that the action cannot use (e.g. in PRINT). +- ANTIBETARMSD and PARABETARMSD use `STRANDS_CUTOFF=1` (nm) by default: the segments whose strands are further apart do not + contribute to the number of segments. Write `STRANDS_CUTOFF=0` to use all the pairs of strands as before. +- ALPHARMSD, ANTIBETARMSD and PARABETARMSD: with R_0, NN, MM and D_0 (and not LESS_THAN) the switching function is stretched to be + zero where it is 1e-5 (its D_MAX), as in the other actions that take these keywords; `LESS_THAN={RATIONAL R_0=0.08 NN=8 MM=12}` + gives the function of v2.10. - A function of a sparse matrix that is not zero for zero arguments (e.g. CUSTOM with `FUNC=1-x` on a CONTACT_MATRIX with `D_MAX`) stops with an error: the elements that the matrix does not store were silently taken as zero. Give the function a `MASK` (e.g. the matrix itself) to compute it only on the stored elements, or remove `D_MAX`. diff --git a/plugins/openaccPTM/README.md b/plugins/openaccPTM/README.md index 9020019105..db1468b853 100644 --- a/plugins/openaccPTM/README.md +++ b/plugins/openaccPTM/README.md @@ -67,8 +67,59 @@ LOAD FILE=/path/to/plumedOpenACC.so CONTACT_MATRIX GROUP=1-1000 SWITCH={EXP D_0=0.2 R_0=0.1 D_MAX=0.66} USEGPU ``` -When PLUMED runs with MPI (e.g. an MD code with several MPI ranks), the actions with `USEGPU` are computed by rank 0 only, -on its GPU, and the results are sent to the other ranks. The other ranks do not use the GPU and wait for rank 0. +When PLUMED runs with MPI (e.g. an MD code with several MPI ranks, or `mpirun -np 4 plumed driver`), the actions with `USEGPU` +are computed by the first rank, on its GPU, and the results are sent to the other ranks. With `MULTIGPU` (accepted by the actions +and by the shortcuts that take `USEGPU`) the tasks are split in blocks between the ranks, each rank computes its block on its GPU +(see below), and the results are summed, as for the CPU version; `SERIAL` restores the default. `MULTIGPU` is not the default +because, for most actions, a call is dominated by work on the CPU (copies of the input, of the results and of the forces) that +does not decrease with the number of ranks, while the sums over the ranks add more: on Leonardo (A100) splitting +[COORDINATIONNUMBER](COORDINATIONNUMBER.md) or [Q6](Q6.md) of 20000 atoms or a [DISTANCES](DISTANCES.md) of 100000 between +2 or 4 GPUs was slower than using one (measured with the contact matrices, before the sums described below). It pays off when +the calculation on the GPU dominates. + +The forces of the matrices are gathered in one pass, adding with atomics the forces that several rows touch. The low memory +version (`AVOID_THREAD_GATHER`), which computes the matrix again column by column, was the default on the GPU, but it makes the +backward pass about two times slower ([CONTACT_MATRIX](CONTACT_MATRIX.md) of 20000 atoms on an A100). + +### Coordination numbers and Steinhardt parameters + +With `USEGPU`, [COORDINATIONNUMBER](COORDINATIONNUMBER.md) and [Q1](Q1.md), [Q3](Q3.md), [Q4](Q4.md), [Q6](Q6.md) (and so +[LOCAL_Q1](LOCAL_Q1.md), ..., [LOCAL_AVERAGE](LOCAL_AVERAGE.md) that use their output) compute the sums over the neighbours +of each atom on the GPU in a single pass, without building the contact matrix (`COORDINATIONNUMBER_SUMSACC`, `Q6_SUMSACC`, ..., +see `src/NeighborSums.cpp`): only the positions and the linked cells go to the GPU, and only the sums and the forces on the atoms +come back. These are the actions that the CPU uses without `USEGPU` (`src/symfunc/NeighborSums.h` in PLUMED), with the same +kernels: the linked cells are built on the CPU and searched on the GPU, in any box, one GPU thread per atom. With up to 512 +atoms in `SPECIESA` (e.g. one ion against all the water molecules) the cells are not built: the GPU threads share the atoms of +`SPECIESB` in blocks, and the partial sums of each atom are added in order by a second kernel. With `SPECIES` the force on each +atom is gathered from its own neighbours (no atomics); with `SPECIESA` and `SPECIESB` the forces on the second group are added +with atomics. +For Q1, ..., Q6 the coordination numbers (the denominators) are computed in the same pass as the sums of the spherical harmonics, +and the forces of the spherical harmonics are contracted pair by pair, without storing the derivatives of the $2(2l+1)$ components. +The results are those of the CPU version (in double precision). On one A100 (8 CPU threads), ms per step: +COORDINATIONNUMBER 3.6 (20000 atoms) and 16 (100000), Q6 12.6 and 58; on 32 CPU cores 4.0, 22, 15.7 and 90. +This is not used with `MASK`, and for [COORDINATION_MOMENTS](COORDINATION_MOMENTS.md): the contact matrix is then computed +on the GPU as before. The actions of the contact matrix (e.g. `q6_mat`, `q6_sh`) are still created, and are computed (on the GPU) +only when another action uses them. +For Q1, ..., Q6 the norm of the vector of the $2l+1$ sums (`Q6_NORM`, as [COMBINE](COMBINE.md) and the square root) is always +computed on the CPU, which is faster than moving the $2(2l+1)$ vectors to the GPU and back. + +### Secondary structure + +With `USEGPU` and `TYPE=DRMSD`, the number of segments that are similar to a helix or a sheet computed by [ALPHARMSD](ALPHARMSD.md), +[ANTIBETARMSD](ANTIBETARMSD.md) and [PARABETARMSD](PARABETARMSD.md) (the value, or the `lessthan` component) comes from +`ALPHARMSD_SCALAR_ACC`, `ANTIBETARMSD_SCALAR_ACC` and `PARABETARMSD_SCALAR_ACC` (`src/SecondaryStructureCount.cpp`), the GPU +version of the single action that PLUMED uses on the CPU +(`src/secondarystructure/SecondaryStructureCount.h`), with the same functions for a segment: a first kernel lists the pairs of strands +within `STRANDS_CUTOFF` (1 nm by default) and whose switching function is not certainly zero (see the documentation of +ANTIBETARMSD), one GPU thread per listed segment computes its distance from the references, the switching function +and the derivatives, which are added to the atoms with atomics, and a last kernel sums the values and the virial. The forces +need no second pass. The vectors of the expanded input are computed (on the GPU) only when another action uses them. + +On one A100 (8 CPU threads), for 144 peptides of 8 residues (20160 atoms, 370800 pairs of strands, about 5000 of them +within `STRANDS_CUTOFF=1`), [ALPHARMSD](ALPHARMSD.md), ANTIBETARMSD and PARABETARMSD together take 1.8 ms per step +(6.1 ms on 32 CPU cores, 12.5 ms on 8); ANTIBETARMSD with `STRANDS_CUTOFF=0` takes 0.6 ms (2.4 ms on 32 CPU cores). For a single protein, +with a few hundred residues, the CPU is faster: the time on the GPU is then set by the cost of starting the kernels and of +the transfers (about 0.3 ms per step for ALPHARMSD). ### Which GPU is used @@ -77,8 +128,12 @@ several GPUs and do not interfere with an MD code that keeps its data on the GPU 1. the GPU assigned to PLUMED by the MD code (with the `setGpuDeviceId` command; the GROMACS 2024 patch does it), otherwise 2. the GPU the MD code is using (the one whose CUDA context is current when PLUMED is called, as for GROMACS 2025 and 2026), otherwise -3. the default OpenACC device: the first GPU, or the one set with `ACC_DEVICE_NUM` (e.g. for [driver](driver.md), where there is no MD code). - With `CUDA_VISIBLE_DEVICES` each rank can be given its own GPU. +3. with several GPUs on the node, and if `ACC_DEVICE_NUM` is not set, GPU number (local rank % number of GPUs), where the local rank + is the rank of the process within its node, as set by the MPI launcher (`OMPI_COMM_WORLD_LOCAL_RANK`, `MPI_LOCALRANKID`, `SLURM_LOCALID`, ...). + This is what happens with [driver](driver.md), where there is no MD code: e.g. `mpirun -np 4 plumed driver` on a node with 4 GPUs + uses one GPU per rank, otherwise +4. the default OpenACC device: the first GPU, or the one set with `ACC_DEVICE_NUM`. + With `CUDA_VISIBLE_DEVICES` (or `srun --gpus-per-task=1`) each rank can be given its own GPU. The GPU of an action is chosen the first time it is computed, and it does not change afterwards. It is written in the log, in the same way for all the actions, e.g. `d runs on GPU 1` for an action labelled `d` (or `d runs on the host` when OpenACC @@ -111,9 +166,9 @@ The next section contains a list of the actions that can take the USEGPU command - ~~[QUATERNION_BOND_PRODUCT_MATRIX](QUATERNION_BOND_PRODUCT_MATRIX.md)~~ setup, but deactivated - secondarystructure: - [SECONDARY_STRUCTURE_DRMSD](SECONDARY_STRUCTURE_DRMSD.md), and in particular: - - [ALPHARMSD](ALPHARMSD.md) only with **TYPE=DRMSD** - - [ANTIBETARMSD](ANTIBETARMSD.md) only with **TYPE=DRMSD** - - [PARABETARMSD](PARABETARMSD.md) only with **TYPE=DRMSD** + - [ALPHARMSD](ALPHARMSD.md) only with **TYPE=DRMSD** (the number of segments: `ALPHARMSD_SCALAR_ACC`, see below) + - [ANTIBETARMSD](ANTIBETARMSD.md) only with **TYPE=DRMSD** (the number of segments: `ANTIBETARMSD_SCALAR_ACC`, see below) + - [PARABETARMSD](PARABETARMSD.md) only with **TYPE=DRMSD** (the number of segments: `PARABETARMSD_SCALAR_ACC`, see below) - volumes: - [AROUND](AROUND.md) - [INCYLINDER](INCYLINDER.md) @@ -134,6 +189,7 @@ The next section contains a list of the actions that can take the USEGPU command - isdb - [SAXS](SAXS.md) and [SANS](SANS.md), see below - symfunc + - [COORDINATIONNUMBER](COORDINATIONNUMBER.md) - [Q1](Q1.md) - [Q3](Q3.md) - [Q4](Q4.md) @@ -172,7 +228,7 @@ SAXS ... (This example is not highlighted only because the manual is built without the plugin.) - The GPU is chosen as for the other actions (see above): there is no `DEVICEID` keyword. -- Differently from the other actions, with MPI the rows of the Debye sum are split over the ranks, each one using its own +- As for the other actions, with MPI the rows of the Debye sum are split over the ranks, each one using its own GPU (or sharing one), and the results are summed. With `SERIAL` only the first rank computes on its GPU and the results are shared with the others. - With `DOSCORE` the derivatives of the intensities stay on the GPU and only the forces are copied back. Without it the diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/Makefile b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/Makefile new file mode 100644 index 0000000000..3703b27cea --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/Makefile @@ -0,0 +1 @@ +include ../../scripts/test.make diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/colvar.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/colvar.reference new file mode 100644 index 0000000000..4b6b6fab04 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/colvar.reference @@ -0,0 +1,6 @@ +#! FIELDS time s diag.vals-1 + 0.000000 0.13443 42.22566 + 1.000000 0.13067 41.67056 + 2.000000 0.10292 40.98616 + 3.000000 0.10205 40.05492 + 4.000000 0.09599 40.13433 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/config b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/config new file mode 100644 index 0000000000..7c673c7af0 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/config @@ -0,0 +1,6 @@ +type=driver +mpiprocs=4 +arg="--plumed plumed.dat --ixyz trajectory.xyz --dump-forces forces --dump-forces-fmt=%10.5f" +extra_files="../../trajectories/trajectory.xyz" +# some contributions are computed in single precision on the GPU: the last printed digit may differ from the CPU +plumed_tolerance=(forces.0:1e-4 forces.1:1e-4 forces.2:1e-4 forces.3:1e-4 colvar:1e-4) diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.0.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.0.reference new file mode 100644 index 0000000000..88519b9f4b --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.0.reference @@ -0,0 +1,550 @@ +108 + -30.07783 -61.87946 -85.31495 +X -2.99958 -4.41155 -1.40689 +X 3.66746 -5.18612 -0.38351 +X 4.41451 -0.40098 -3.31410 +X -5.41424 -1.26872 -1.80431 +X -3.58153 -5.68061 0.95972 +X 2.79921 -4.19021 1.35698 +X 6.05708 -2.33856 2.35001 +X -4.19779 -0.85594 2.86511 +X -2.39362 -2.56428 0.36621 +X 1.93567 -3.06353 -1.01896 +X 3.20164 0.69639 1.18694 +X -3.21626 0.79417 -1.80440 +X -2.83854 3.48827 -3.30190 +X 4.01562 4.51654 -2.81866 +X 1.26921 2.58287 -1.53033 +X -1.93124 4.52659 -1.31977 +X -5.35213 4.17413 3.16661 +X 2.37661 3.41411 3.67707 +X 2.16620 4.34272 1.43869 +X -0.85840 2.31272 1.49981 +X 0.00000 0.00000 0.00000 +X 0.01301 0.13167 -0.13480 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00118 -0.01732 -0.00012 +X -0.00174 -0.03906 -0.00057 +X 0.07042 -0.26603 -0.18082 +X -0.22145 -0.29256 0.12129 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.01801 -0.23817 0.24226 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00167 -0.07943 -0.08325 +X 0.39187 -0.18704 -0.30656 +X 0.05833 -0.00179 0.00382 +X 0.02080 -0.00018 -0.00023 +X 0.36558 0.19822 0.12250 +X 0.18307 0.00602 0.20187 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.13548 0.01132 -0.14473 +X 0.13624 0.13569 -0.00865 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.22858 -0.25083 -0.00953 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01120 -0.00623 0.00585 +X 0.00522 -0.00561 0.01164 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02664 -0.00055 -0.00099 +X -0.14515 -0.00889 0.11546 +X -0.11918 0.08906 -0.00900 +X -0.00584 0.00313 0.00288 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.11028 -0.00427 -0.10656 +X -0.00262 0.00303 -0.00549 +X -0.00547 0.00315 -0.00294 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00831 0.00445 -0.00424 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07783 -0.07581 0.00658 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -30.96535 -60.92028 -85.02883 +X -3.09317 -4.62648 -1.49722 +X 4.05363 -4.97291 -0.31789 +X 4.57259 -0.29362 -3.17490 +X -5.34072 -0.96747 -2.14880 +X -3.88826 -5.77992 0.97985 +X 2.93845 -4.13990 1.48873 +X 6.49283 -2.46677 2.58708 +X -4.25359 -1.10369 2.44960 +X -2.58938 -2.47609 0.19873 +X 1.67134 -3.31648 -1.06329 +X 3.51684 0.83486 1.16210 +X -3.26438 0.97605 -1.90707 +X -2.50787 3.43257 -2.77732 +X 3.30258 4.76753 -3.20819 +X 1.34062 2.69142 -1.42676 +X -1.68937 4.48869 -1.27415 +X -5.52988 4.16635 3.68079 +X 1.94590 3.39048 3.54908 +X 2.11936 4.15692 1.55456 +X -0.67460 2.17957 1.26752 +X 0.00000 0.00000 0.00000 +X 0.01460 0.10155 -0.10476 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00149 -0.01137 -0.00015 +X -0.00281 -0.03808 -0.00103 +X 0.03524 -0.21375 -0.15997 +X -0.25911 -0.28383 0.11590 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.04430 -0.27757 0.29517 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00228 -0.05012 -0.05411 +X 0.36818 -0.19776 -0.40432 +X 0.08148 -0.00670 0.01066 +X 0.01479 -0.00037 -0.00038 +X 0.36931 0.21175 0.08529 +X 0.19162 0.00961 0.22922 +X 0.00000 0.00000 0.00000 +X 0.01282 0.00691 0.00625 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.10378 0.01511 -0.12315 +X 0.11276 0.11291 -0.01346 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00401 0.00808 0.00319 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00449 -0.01221 -0.00673 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.25464 -0.30934 -0.01158 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01483 -0.00926 0.00826 +X 0.00599 -0.00694 0.01458 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02469 -0.00096 -0.00167 +X -0.12282 -0.01384 0.09785 +X -0.08853 0.06565 -0.00988 +X -0.00590 0.00337 0.00292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.09870 -0.00812 -0.09345 +X -0.00229 0.00299 -0.00503 +X -0.00437 0.00283 -0.00251 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00966 0.00882 -0.00595 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05205 -0.05047 0.00640 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -32.98101 -59.03102 -83.58927 +X -3.09839 -4.66881 -1.66771 +X 4.46365 -4.95427 -0.41530 +X 4.82154 -0.33738 -3.22017 +X -6.07511 -1.69468 -1.78388 +X -4.05694 -5.68465 1.00361 +X 2.98507 -4.06140 1.57964 +X 6.70585 -2.74477 2.60852 +X -4.61588 -1.34503 2.44520 +X -2.57514 -2.39762 0.09213 +X 1.26319 -3.38373 -1.04851 +X 3.68454 0.83542 0.97590 +X -2.78209 1.11013 -1.99050 +X -2.15131 3.58366 -2.95760 +X 3.37153 5.24185 -3.02446 +X 1.41455 2.77689 -1.37217 +X -1.53215 4.53255 -1.11675 +X -6.00713 4.24043 3.40831 +X 2.32968 3.30202 3.62311 +X 2.10078 4.22772 1.59236 +X -0.74279 2.28416 1.22154 +X 0.00000 0.00000 0.00000 +X 0.00513 0.04428 -0.04434 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00191 -0.01093 -0.00028 +X -0.00246 -0.02811 -0.00150 +X 0.03369 -0.15656 -0.10834 +X -0.21100 -0.26140 0.12161 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05908 -0.24945 0.26292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00282 -0.04906 -0.05325 +X 0.25012 -0.12705 -0.34889 +X 0.09679 -0.01266 0.01307 +X 0.00796 -0.00044 -0.00018 +X 0.28173 0.18779 0.02795 +X 0.19716 0.01681 0.25966 +X 0.00000 0.00000 0.00000 +X 0.01373 0.00806 0.00681 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.05344 0.00956 -0.06670 +X 0.05757 0.05757 -0.00762 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00221 0.00456 0.00171 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.20136 -0.27733 -0.02619 +X 0.00323 -0.01168 0.00549 +X 0.00000 0.00000 0.00000 +X 0.01418 -0.01049 0.00863 +X 0.00520 -0.00674 0.01344 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02909 -0.00193 -0.00193 +X -0.12864 -0.02355 0.11648 +X -0.10765 0.09722 -0.00864 +X -0.00782 0.00461 0.00405 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.12363 -0.02061 -0.12378 +X -0.00242 0.00340 -0.00559 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00633 0.00816 -0.00430 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05354 -0.05653 0.00643 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -36.06068 -57.41089 -81.58879 +X -3.06608 -4.45659 -1.53716 +X 4.59498 -4.67231 -0.49859 +X 5.07670 -0.51077 -3.48976 +X -6.90312 -2.42141 -1.40220 +X -4.23532 -5.48777 1.06201 +X 2.99397 -3.78407 1.80396 +X 6.81081 -3.03005 2.34615 +X -4.90791 -1.34655 2.35739 +X -2.46536 -2.19423 0.08654 +X 0.80286 -3.34341 -0.95315 +X 3.73035 0.50785 0.87413 +X -2.23332 0.98051 -1.93905 +X -1.75184 3.70192 -3.13347 +X 3.72999 5.69240 -2.74530 +X 1.39698 2.76181 -1.39661 +X -1.51326 4.48424 -1.02419 +X -6.63427 4.21372 2.85228 +X 2.96687 3.09033 3.68966 +X 2.11737 4.31377 1.59487 +X -0.86490 2.30670 1.31673 +X 0.00000 0.00000 0.00000 +X 0.00120 0.02372 -0.02333 +X 0.00000 0.00000 0.00000 +X -0.00128 0.00246 -0.00139 +X 0.00228 -0.01228 -0.00062 +X -0.00207 -0.02464 -0.00209 +X 0.05238 -0.15265 -0.08858 +X -0.17021 -0.27037 0.12999 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06975 -0.23296 0.23756 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 -0.05275 -0.05764 +X 0.18395 -0.09289 -0.29559 +X 0.13663 -0.02476 0.01187 +X 0.01909 0.00519 -0.00701 +X 0.28612 0.20026 -0.00192 +X 0.21313 0.02216 0.32092 +X 0.00000 0.00000 0.00000 +X 0.01580 0.00995 0.00842 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.03893 0.00647 -0.04894 +X 0.03845 0.03897 -0.00452 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00124 0.00276 0.00106 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00215 0.00131 -0.00132 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.15538 -0.24702 -0.04168 +X 0.00315 -0.01323 0.00582 +X 0.00000 0.00000 0.00000 +X 0.01430 -0.01311 0.00960 +X 0.00519 -0.00761 0.01384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.03784 -0.00343 -0.00129 +X -0.15347 -0.03143 0.14969 +X -0.14720 0.15527 -0.00863 +X -0.01033 0.00621 0.00579 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.15542 -0.04041 -0.16998 +X -0.00263 0.00384 -0.00633 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00525 0.00909 -0.00390 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06301 -0.07423 0.00597 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -38.65934 -56.74544 -80.55182 +X -3.12953 -4.39135 -1.44388 +X 4.61881 -4.76109 -0.34105 +X 5.27923 -0.75337 -3.72766 +X -7.64412 -2.43833 -1.46420 +X -4.29289 -5.64014 1.32867 +X 2.99425 -3.47009 1.98388 +X 7.00602 -3.06000 2.23022 +X -4.93958 -1.16005 2.42709 +X -2.25754 -2.04854 0.10271 +X 0.39218 -3.22692 -1.00018 +X 3.57293 0.14087 0.62450 +X -1.82959 0.60450 -2.25084 +X -1.38239 3.87147 -3.54073 +X 4.44766 5.69624 -2.15455 +X 1.37954 2.89725 -1.66507 +X -1.58369 4.82583 -1.02111 +X -7.48941 3.84037 2.52487 +X 3.53781 2.62869 4.12855 +X 2.15533 4.66012 1.72352 +X -1.02592 2.39802 1.50804 +X 0.00000 0.00000 0.00000 +X -0.00006 0.03340 -0.03445 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00230 -0.01443 -0.00111 +X -0.00143 -0.01593 -0.00158 +X 0.08964 -0.16338 -0.07190 +X -0.07253 -0.25738 0.15712 +X -0.00338 -0.00671 0.00257 +X 0.00000 0.00000 0.00000 +X -0.03833 -0.12442 0.13556 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00385 -0.05373 -0.05928 +X 0.15383 -0.10836 -0.18107 +X 0.11043 -0.02403 0.00628 +X 0.01976 0.00295 -0.00484 +X 0.23424 0.13411 0.02126 +X 0.13077 0.00997 0.21001 +X 0.00000 0.00000 0.00000 +X 0.01050 0.00687 0.00618 +X 0.00000 0.00000 0.00000 +X 0.00208 -0.00168 -0.00384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.07772 0.01034 -0.09412 +X 0.08310 0.09050 -0.01176 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00194 0.00461 0.00191 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 0.00242 -0.00219 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00652 -0.00365 -0.00371 +X 0.08418 -0.14892 -0.02839 +X 0.00190 -0.00912 0.00374 +X 0.00000 0.00000 0.00000 +X 0.00899 -0.00930 0.00637 +X 0.00292 -0.00455 0.00807 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05439 -0.00563 0.00009 +X -0.18431 -0.03676 0.18473 +X -0.20546 0.22657 -0.01410 +X -0.01238 0.00749 0.00711 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.18806 -0.06796 -0.20969 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00394 0.00928 -0.00356 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07310 -0.09603 0.00180 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.1.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.1.reference new file mode 100644 index 0000000000..88519b9f4b --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.1.reference @@ -0,0 +1,550 @@ +108 + -30.07783 -61.87946 -85.31495 +X -2.99958 -4.41155 -1.40689 +X 3.66746 -5.18612 -0.38351 +X 4.41451 -0.40098 -3.31410 +X -5.41424 -1.26872 -1.80431 +X -3.58153 -5.68061 0.95972 +X 2.79921 -4.19021 1.35698 +X 6.05708 -2.33856 2.35001 +X -4.19779 -0.85594 2.86511 +X -2.39362 -2.56428 0.36621 +X 1.93567 -3.06353 -1.01896 +X 3.20164 0.69639 1.18694 +X -3.21626 0.79417 -1.80440 +X -2.83854 3.48827 -3.30190 +X 4.01562 4.51654 -2.81866 +X 1.26921 2.58287 -1.53033 +X -1.93124 4.52659 -1.31977 +X -5.35213 4.17413 3.16661 +X 2.37661 3.41411 3.67707 +X 2.16620 4.34272 1.43869 +X -0.85840 2.31272 1.49981 +X 0.00000 0.00000 0.00000 +X 0.01301 0.13167 -0.13480 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00118 -0.01732 -0.00012 +X -0.00174 -0.03906 -0.00057 +X 0.07042 -0.26603 -0.18082 +X -0.22145 -0.29256 0.12129 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.01801 -0.23817 0.24226 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00167 -0.07943 -0.08325 +X 0.39187 -0.18704 -0.30656 +X 0.05833 -0.00179 0.00382 +X 0.02080 -0.00018 -0.00023 +X 0.36558 0.19822 0.12250 +X 0.18307 0.00602 0.20187 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.13548 0.01132 -0.14473 +X 0.13624 0.13569 -0.00865 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.22858 -0.25083 -0.00953 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01120 -0.00623 0.00585 +X 0.00522 -0.00561 0.01164 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02664 -0.00055 -0.00099 +X -0.14515 -0.00889 0.11546 +X -0.11918 0.08906 -0.00900 +X -0.00584 0.00313 0.00288 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.11028 -0.00427 -0.10656 +X -0.00262 0.00303 -0.00549 +X -0.00547 0.00315 -0.00294 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00831 0.00445 -0.00424 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07783 -0.07581 0.00658 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -30.96535 -60.92028 -85.02883 +X -3.09317 -4.62648 -1.49722 +X 4.05363 -4.97291 -0.31789 +X 4.57259 -0.29362 -3.17490 +X -5.34072 -0.96747 -2.14880 +X -3.88826 -5.77992 0.97985 +X 2.93845 -4.13990 1.48873 +X 6.49283 -2.46677 2.58708 +X -4.25359 -1.10369 2.44960 +X -2.58938 -2.47609 0.19873 +X 1.67134 -3.31648 -1.06329 +X 3.51684 0.83486 1.16210 +X -3.26438 0.97605 -1.90707 +X -2.50787 3.43257 -2.77732 +X 3.30258 4.76753 -3.20819 +X 1.34062 2.69142 -1.42676 +X -1.68937 4.48869 -1.27415 +X -5.52988 4.16635 3.68079 +X 1.94590 3.39048 3.54908 +X 2.11936 4.15692 1.55456 +X -0.67460 2.17957 1.26752 +X 0.00000 0.00000 0.00000 +X 0.01460 0.10155 -0.10476 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00149 -0.01137 -0.00015 +X -0.00281 -0.03808 -0.00103 +X 0.03524 -0.21375 -0.15997 +X -0.25911 -0.28383 0.11590 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.04430 -0.27757 0.29517 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00228 -0.05012 -0.05411 +X 0.36818 -0.19776 -0.40432 +X 0.08148 -0.00670 0.01066 +X 0.01479 -0.00037 -0.00038 +X 0.36931 0.21175 0.08529 +X 0.19162 0.00961 0.22922 +X 0.00000 0.00000 0.00000 +X 0.01282 0.00691 0.00625 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.10378 0.01511 -0.12315 +X 0.11276 0.11291 -0.01346 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00401 0.00808 0.00319 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00449 -0.01221 -0.00673 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.25464 -0.30934 -0.01158 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01483 -0.00926 0.00826 +X 0.00599 -0.00694 0.01458 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02469 -0.00096 -0.00167 +X -0.12282 -0.01384 0.09785 +X -0.08853 0.06565 -0.00988 +X -0.00590 0.00337 0.00292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.09870 -0.00812 -0.09345 +X -0.00229 0.00299 -0.00503 +X -0.00437 0.00283 -0.00251 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00966 0.00882 -0.00595 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05205 -0.05047 0.00640 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -32.98101 -59.03102 -83.58927 +X -3.09839 -4.66881 -1.66771 +X 4.46365 -4.95427 -0.41530 +X 4.82154 -0.33738 -3.22017 +X -6.07511 -1.69468 -1.78388 +X -4.05694 -5.68465 1.00361 +X 2.98507 -4.06140 1.57964 +X 6.70585 -2.74477 2.60852 +X -4.61588 -1.34503 2.44520 +X -2.57514 -2.39762 0.09213 +X 1.26319 -3.38373 -1.04851 +X 3.68454 0.83542 0.97590 +X -2.78209 1.11013 -1.99050 +X -2.15131 3.58366 -2.95760 +X 3.37153 5.24185 -3.02446 +X 1.41455 2.77689 -1.37217 +X -1.53215 4.53255 -1.11675 +X -6.00713 4.24043 3.40831 +X 2.32968 3.30202 3.62311 +X 2.10078 4.22772 1.59236 +X -0.74279 2.28416 1.22154 +X 0.00000 0.00000 0.00000 +X 0.00513 0.04428 -0.04434 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00191 -0.01093 -0.00028 +X -0.00246 -0.02811 -0.00150 +X 0.03369 -0.15656 -0.10834 +X -0.21100 -0.26140 0.12161 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05908 -0.24945 0.26292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00282 -0.04906 -0.05325 +X 0.25012 -0.12705 -0.34889 +X 0.09679 -0.01266 0.01307 +X 0.00796 -0.00044 -0.00018 +X 0.28173 0.18779 0.02795 +X 0.19716 0.01681 0.25966 +X 0.00000 0.00000 0.00000 +X 0.01373 0.00806 0.00681 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.05344 0.00956 -0.06670 +X 0.05757 0.05757 -0.00762 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00221 0.00456 0.00171 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.20136 -0.27733 -0.02619 +X 0.00323 -0.01168 0.00549 +X 0.00000 0.00000 0.00000 +X 0.01418 -0.01049 0.00863 +X 0.00520 -0.00674 0.01344 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02909 -0.00193 -0.00193 +X -0.12864 -0.02355 0.11648 +X -0.10765 0.09722 -0.00864 +X -0.00782 0.00461 0.00405 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.12363 -0.02061 -0.12378 +X -0.00242 0.00340 -0.00559 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00633 0.00816 -0.00430 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05354 -0.05653 0.00643 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -36.06068 -57.41089 -81.58879 +X -3.06608 -4.45659 -1.53716 +X 4.59498 -4.67231 -0.49859 +X 5.07670 -0.51077 -3.48976 +X -6.90312 -2.42141 -1.40220 +X -4.23532 -5.48777 1.06201 +X 2.99397 -3.78407 1.80396 +X 6.81081 -3.03005 2.34615 +X -4.90791 -1.34655 2.35739 +X -2.46536 -2.19423 0.08654 +X 0.80286 -3.34341 -0.95315 +X 3.73035 0.50785 0.87413 +X -2.23332 0.98051 -1.93905 +X -1.75184 3.70192 -3.13347 +X 3.72999 5.69240 -2.74530 +X 1.39698 2.76181 -1.39661 +X -1.51326 4.48424 -1.02419 +X -6.63427 4.21372 2.85228 +X 2.96687 3.09033 3.68966 +X 2.11737 4.31377 1.59487 +X -0.86490 2.30670 1.31673 +X 0.00000 0.00000 0.00000 +X 0.00120 0.02372 -0.02333 +X 0.00000 0.00000 0.00000 +X -0.00128 0.00246 -0.00139 +X 0.00228 -0.01228 -0.00062 +X -0.00207 -0.02464 -0.00209 +X 0.05238 -0.15265 -0.08858 +X -0.17021 -0.27037 0.12999 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06975 -0.23296 0.23756 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 -0.05275 -0.05764 +X 0.18395 -0.09289 -0.29559 +X 0.13663 -0.02476 0.01187 +X 0.01909 0.00519 -0.00701 +X 0.28612 0.20026 -0.00192 +X 0.21313 0.02216 0.32092 +X 0.00000 0.00000 0.00000 +X 0.01580 0.00995 0.00842 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.03893 0.00647 -0.04894 +X 0.03845 0.03897 -0.00452 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00124 0.00276 0.00106 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00215 0.00131 -0.00132 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.15538 -0.24702 -0.04168 +X 0.00315 -0.01323 0.00582 +X 0.00000 0.00000 0.00000 +X 0.01430 -0.01311 0.00960 +X 0.00519 -0.00761 0.01384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.03784 -0.00343 -0.00129 +X -0.15347 -0.03143 0.14969 +X -0.14720 0.15527 -0.00863 +X -0.01033 0.00621 0.00579 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.15542 -0.04041 -0.16998 +X -0.00263 0.00384 -0.00633 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00525 0.00909 -0.00390 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06301 -0.07423 0.00597 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -38.65934 -56.74544 -80.55182 +X -3.12953 -4.39135 -1.44388 +X 4.61881 -4.76109 -0.34105 +X 5.27923 -0.75337 -3.72766 +X -7.64412 -2.43833 -1.46420 +X -4.29289 -5.64014 1.32867 +X 2.99425 -3.47009 1.98388 +X 7.00602 -3.06000 2.23022 +X -4.93958 -1.16005 2.42709 +X -2.25754 -2.04854 0.10271 +X 0.39218 -3.22692 -1.00018 +X 3.57293 0.14087 0.62450 +X -1.82959 0.60450 -2.25084 +X -1.38239 3.87147 -3.54073 +X 4.44766 5.69624 -2.15455 +X 1.37954 2.89725 -1.66507 +X -1.58369 4.82583 -1.02111 +X -7.48941 3.84037 2.52487 +X 3.53781 2.62869 4.12855 +X 2.15533 4.66012 1.72352 +X -1.02592 2.39802 1.50804 +X 0.00000 0.00000 0.00000 +X -0.00006 0.03340 -0.03445 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00230 -0.01443 -0.00111 +X -0.00143 -0.01593 -0.00158 +X 0.08964 -0.16338 -0.07190 +X -0.07253 -0.25738 0.15712 +X -0.00338 -0.00671 0.00257 +X 0.00000 0.00000 0.00000 +X -0.03833 -0.12442 0.13556 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00385 -0.05373 -0.05928 +X 0.15383 -0.10836 -0.18107 +X 0.11043 -0.02403 0.00628 +X 0.01976 0.00295 -0.00484 +X 0.23424 0.13411 0.02126 +X 0.13077 0.00997 0.21001 +X 0.00000 0.00000 0.00000 +X 0.01050 0.00687 0.00618 +X 0.00000 0.00000 0.00000 +X 0.00208 -0.00168 -0.00384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.07772 0.01034 -0.09412 +X 0.08310 0.09050 -0.01176 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00194 0.00461 0.00191 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 0.00242 -0.00219 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00652 -0.00365 -0.00371 +X 0.08418 -0.14892 -0.02839 +X 0.00190 -0.00912 0.00374 +X 0.00000 0.00000 0.00000 +X 0.00899 -0.00930 0.00637 +X 0.00292 -0.00455 0.00807 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05439 -0.00563 0.00009 +X -0.18431 -0.03676 0.18473 +X -0.20546 0.22657 -0.01410 +X -0.01238 0.00749 0.00711 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.18806 -0.06796 -0.20969 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00394 0.00928 -0.00356 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07310 -0.09603 0.00180 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.2.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.2.reference new file mode 100644 index 0000000000..88519b9f4b --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.2.reference @@ -0,0 +1,550 @@ +108 + -30.07783 -61.87946 -85.31495 +X -2.99958 -4.41155 -1.40689 +X 3.66746 -5.18612 -0.38351 +X 4.41451 -0.40098 -3.31410 +X -5.41424 -1.26872 -1.80431 +X -3.58153 -5.68061 0.95972 +X 2.79921 -4.19021 1.35698 +X 6.05708 -2.33856 2.35001 +X -4.19779 -0.85594 2.86511 +X -2.39362 -2.56428 0.36621 +X 1.93567 -3.06353 -1.01896 +X 3.20164 0.69639 1.18694 +X -3.21626 0.79417 -1.80440 +X -2.83854 3.48827 -3.30190 +X 4.01562 4.51654 -2.81866 +X 1.26921 2.58287 -1.53033 +X -1.93124 4.52659 -1.31977 +X -5.35213 4.17413 3.16661 +X 2.37661 3.41411 3.67707 +X 2.16620 4.34272 1.43869 +X -0.85840 2.31272 1.49981 +X 0.00000 0.00000 0.00000 +X 0.01301 0.13167 -0.13480 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00118 -0.01732 -0.00012 +X -0.00174 -0.03906 -0.00057 +X 0.07042 -0.26603 -0.18082 +X -0.22145 -0.29256 0.12129 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.01801 -0.23817 0.24226 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00167 -0.07943 -0.08325 +X 0.39187 -0.18704 -0.30656 +X 0.05833 -0.00179 0.00382 +X 0.02080 -0.00018 -0.00023 +X 0.36558 0.19822 0.12250 +X 0.18307 0.00602 0.20187 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.13548 0.01132 -0.14473 +X 0.13624 0.13569 -0.00865 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.22858 -0.25083 -0.00953 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01120 -0.00623 0.00585 +X 0.00522 -0.00561 0.01164 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02664 -0.00055 -0.00099 +X -0.14515 -0.00889 0.11546 +X -0.11918 0.08906 -0.00900 +X -0.00584 0.00313 0.00288 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.11028 -0.00427 -0.10656 +X -0.00262 0.00303 -0.00549 +X -0.00547 0.00315 -0.00294 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00831 0.00445 -0.00424 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07783 -0.07581 0.00658 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -30.96535 -60.92028 -85.02883 +X -3.09317 -4.62648 -1.49722 +X 4.05363 -4.97291 -0.31789 +X 4.57259 -0.29362 -3.17490 +X -5.34072 -0.96747 -2.14880 +X -3.88826 -5.77992 0.97985 +X 2.93845 -4.13990 1.48873 +X 6.49283 -2.46677 2.58708 +X -4.25359 -1.10369 2.44960 +X -2.58938 -2.47609 0.19873 +X 1.67134 -3.31648 -1.06329 +X 3.51684 0.83486 1.16210 +X -3.26438 0.97605 -1.90707 +X -2.50787 3.43257 -2.77732 +X 3.30258 4.76753 -3.20819 +X 1.34062 2.69142 -1.42676 +X -1.68937 4.48869 -1.27415 +X -5.52988 4.16635 3.68079 +X 1.94590 3.39048 3.54908 +X 2.11936 4.15692 1.55456 +X -0.67460 2.17957 1.26752 +X 0.00000 0.00000 0.00000 +X 0.01460 0.10155 -0.10476 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00149 -0.01137 -0.00015 +X -0.00281 -0.03808 -0.00103 +X 0.03524 -0.21375 -0.15997 +X -0.25911 -0.28383 0.11590 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.04430 -0.27757 0.29517 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00228 -0.05012 -0.05411 +X 0.36818 -0.19776 -0.40432 +X 0.08148 -0.00670 0.01066 +X 0.01479 -0.00037 -0.00038 +X 0.36931 0.21175 0.08529 +X 0.19162 0.00961 0.22922 +X 0.00000 0.00000 0.00000 +X 0.01282 0.00691 0.00625 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.10378 0.01511 -0.12315 +X 0.11276 0.11291 -0.01346 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00401 0.00808 0.00319 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00449 -0.01221 -0.00673 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.25464 -0.30934 -0.01158 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01483 -0.00926 0.00826 +X 0.00599 -0.00694 0.01458 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02469 -0.00096 -0.00167 +X -0.12282 -0.01384 0.09785 +X -0.08853 0.06565 -0.00988 +X -0.00590 0.00337 0.00292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.09870 -0.00812 -0.09345 +X -0.00229 0.00299 -0.00503 +X -0.00437 0.00283 -0.00251 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00966 0.00882 -0.00595 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05205 -0.05047 0.00640 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -32.98101 -59.03102 -83.58927 +X -3.09839 -4.66881 -1.66771 +X 4.46365 -4.95427 -0.41530 +X 4.82154 -0.33738 -3.22017 +X -6.07511 -1.69468 -1.78388 +X -4.05694 -5.68465 1.00361 +X 2.98507 -4.06140 1.57964 +X 6.70585 -2.74477 2.60852 +X -4.61588 -1.34503 2.44520 +X -2.57514 -2.39762 0.09213 +X 1.26319 -3.38373 -1.04851 +X 3.68454 0.83542 0.97590 +X -2.78209 1.11013 -1.99050 +X -2.15131 3.58366 -2.95760 +X 3.37153 5.24185 -3.02446 +X 1.41455 2.77689 -1.37217 +X -1.53215 4.53255 -1.11675 +X -6.00713 4.24043 3.40831 +X 2.32968 3.30202 3.62311 +X 2.10078 4.22772 1.59236 +X -0.74279 2.28416 1.22154 +X 0.00000 0.00000 0.00000 +X 0.00513 0.04428 -0.04434 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00191 -0.01093 -0.00028 +X -0.00246 -0.02811 -0.00150 +X 0.03369 -0.15656 -0.10834 +X -0.21100 -0.26140 0.12161 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05908 -0.24945 0.26292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00282 -0.04906 -0.05325 +X 0.25012 -0.12705 -0.34889 +X 0.09679 -0.01266 0.01307 +X 0.00796 -0.00044 -0.00018 +X 0.28173 0.18779 0.02795 +X 0.19716 0.01681 0.25966 +X 0.00000 0.00000 0.00000 +X 0.01373 0.00806 0.00681 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.05344 0.00956 -0.06670 +X 0.05757 0.05757 -0.00762 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00221 0.00456 0.00171 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.20136 -0.27733 -0.02619 +X 0.00323 -0.01168 0.00549 +X 0.00000 0.00000 0.00000 +X 0.01418 -0.01049 0.00863 +X 0.00520 -0.00674 0.01344 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02909 -0.00193 -0.00193 +X -0.12864 -0.02355 0.11648 +X -0.10765 0.09722 -0.00864 +X -0.00782 0.00461 0.00405 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.12363 -0.02061 -0.12378 +X -0.00242 0.00340 -0.00559 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00633 0.00816 -0.00430 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05354 -0.05653 0.00643 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -36.06068 -57.41089 -81.58879 +X -3.06608 -4.45659 -1.53716 +X 4.59498 -4.67231 -0.49859 +X 5.07670 -0.51077 -3.48976 +X -6.90312 -2.42141 -1.40220 +X -4.23532 -5.48777 1.06201 +X 2.99397 -3.78407 1.80396 +X 6.81081 -3.03005 2.34615 +X -4.90791 -1.34655 2.35739 +X -2.46536 -2.19423 0.08654 +X 0.80286 -3.34341 -0.95315 +X 3.73035 0.50785 0.87413 +X -2.23332 0.98051 -1.93905 +X -1.75184 3.70192 -3.13347 +X 3.72999 5.69240 -2.74530 +X 1.39698 2.76181 -1.39661 +X -1.51326 4.48424 -1.02419 +X -6.63427 4.21372 2.85228 +X 2.96687 3.09033 3.68966 +X 2.11737 4.31377 1.59487 +X -0.86490 2.30670 1.31673 +X 0.00000 0.00000 0.00000 +X 0.00120 0.02372 -0.02333 +X 0.00000 0.00000 0.00000 +X -0.00128 0.00246 -0.00139 +X 0.00228 -0.01228 -0.00062 +X -0.00207 -0.02464 -0.00209 +X 0.05238 -0.15265 -0.08858 +X -0.17021 -0.27037 0.12999 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06975 -0.23296 0.23756 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 -0.05275 -0.05764 +X 0.18395 -0.09289 -0.29559 +X 0.13663 -0.02476 0.01187 +X 0.01909 0.00519 -0.00701 +X 0.28612 0.20026 -0.00192 +X 0.21313 0.02216 0.32092 +X 0.00000 0.00000 0.00000 +X 0.01580 0.00995 0.00842 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.03893 0.00647 -0.04894 +X 0.03845 0.03897 -0.00452 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00124 0.00276 0.00106 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00215 0.00131 -0.00132 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.15538 -0.24702 -0.04168 +X 0.00315 -0.01323 0.00582 +X 0.00000 0.00000 0.00000 +X 0.01430 -0.01311 0.00960 +X 0.00519 -0.00761 0.01384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.03784 -0.00343 -0.00129 +X -0.15347 -0.03143 0.14969 +X -0.14720 0.15527 -0.00863 +X -0.01033 0.00621 0.00579 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.15542 -0.04041 -0.16998 +X -0.00263 0.00384 -0.00633 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00525 0.00909 -0.00390 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06301 -0.07423 0.00597 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -38.65934 -56.74544 -80.55182 +X -3.12953 -4.39135 -1.44388 +X 4.61881 -4.76109 -0.34105 +X 5.27923 -0.75337 -3.72766 +X -7.64412 -2.43833 -1.46420 +X -4.29289 -5.64014 1.32867 +X 2.99425 -3.47009 1.98388 +X 7.00602 -3.06000 2.23022 +X -4.93958 -1.16005 2.42709 +X -2.25754 -2.04854 0.10271 +X 0.39218 -3.22692 -1.00018 +X 3.57293 0.14087 0.62450 +X -1.82959 0.60450 -2.25084 +X -1.38239 3.87147 -3.54073 +X 4.44766 5.69624 -2.15455 +X 1.37954 2.89725 -1.66507 +X -1.58369 4.82583 -1.02111 +X -7.48941 3.84037 2.52487 +X 3.53781 2.62869 4.12855 +X 2.15533 4.66012 1.72352 +X -1.02592 2.39802 1.50804 +X 0.00000 0.00000 0.00000 +X -0.00006 0.03340 -0.03445 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00230 -0.01443 -0.00111 +X -0.00143 -0.01593 -0.00158 +X 0.08964 -0.16338 -0.07190 +X -0.07253 -0.25738 0.15712 +X -0.00338 -0.00671 0.00257 +X 0.00000 0.00000 0.00000 +X -0.03833 -0.12442 0.13556 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00385 -0.05373 -0.05928 +X 0.15383 -0.10836 -0.18107 +X 0.11043 -0.02403 0.00628 +X 0.01976 0.00295 -0.00484 +X 0.23424 0.13411 0.02126 +X 0.13077 0.00997 0.21001 +X 0.00000 0.00000 0.00000 +X 0.01050 0.00687 0.00618 +X 0.00000 0.00000 0.00000 +X 0.00208 -0.00168 -0.00384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.07772 0.01034 -0.09412 +X 0.08310 0.09050 -0.01176 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00194 0.00461 0.00191 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 0.00242 -0.00219 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00652 -0.00365 -0.00371 +X 0.08418 -0.14892 -0.02839 +X 0.00190 -0.00912 0.00374 +X 0.00000 0.00000 0.00000 +X 0.00899 -0.00930 0.00637 +X 0.00292 -0.00455 0.00807 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05439 -0.00563 0.00009 +X -0.18431 -0.03676 0.18473 +X -0.20546 0.22657 -0.01410 +X -0.01238 0.00749 0.00711 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.18806 -0.06796 -0.20969 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00394 0.00928 -0.00356 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07310 -0.09603 0.00180 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.3.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.3.reference new file mode 100644 index 0000000000..88519b9f4b --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/forces.3.reference @@ -0,0 +1,550 @@ +108 + -30.07783 -61.87946 -85.31495 +X -2.99958 -4.41155 -1.40689 +X 3.66746 -5.18612 -0.38351 +X 4.41451 -0.40098 -3.31410 +X -5.41424 -1.26872 -1.80431 +X -3.58153 -5.68061 0.95972 +X 2.79921 -4.19021 1.35698 +X 6.05708 -2.33856 2.35001 +X -4.19779 -0.85594 2.86511 +X -2.39362 -2.56428 0.36621 +X 1.93567 -3.06353 -1.01896 +X 3.20164 0.69639 1.18694 +X -3.21626 0.79417 -1.80440 +X -2.83854 3.48827 -3.30190 +X 4.01562 4.51654 -2.81866 +X 1.26921 2.58287 -1.53033 +X -1.93124 4.52659 -1.31977 +X -5.35213 4.17413 3.16661 +X 2.37661 3.41411 3.67707 +X 2.16620 4.34272 1.43869 +X -0.85840 2.31272 1.49981 +X 0.00000 0.00000 0.00000 +X 0.01301 0.13167 -0.13480 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00118 -0.01732 -0.00012 +X -0.00174 -0.03906 -0.00057 +X 0.07042 -0.26603 -0.18082 +X -0.22145 -0.29256 0.12129 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.01801 -0.23817 0.24226 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00167 -0.07943 -0.08325 +X 0.39187 -0.18704 -0.30656 +X 0.05833 -0.00179 0.00382 +X 0.02080 -0.00018 -0.00023 +X 0.36558 0.19822 0.12250 +X 0.18307 0.00602 0.20187 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.13548 0.01132 -0.14473 +X 0.13624 0.13569 -0.00865 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.22858 -0.25083 -0.00953 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01120 -0.00623 0.00585 +X 0.00522 -0.00561 0.01164 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02664 -0.00055 -0.00099 +X -0.14515 -0.00889 0.11546 +X -0.11918 0.08906 -0.00900 +X -0.00584 0.00313 0.00288 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.11028 -0.00427 -0.10656 +X -0.00262 0.00303 -0.00549 +X -0.00547 0.00315 -0.00294 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00831 0.00445 -0.00424 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07783 -0.07581 0.00658 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -30.96535 -60.92028 -85.02883 +X -3.09317 -4.62648 -1.49722 +X 4.05363 -4.97291 -0.31789 +X 4.57259 -0.29362 -3.17490 +X -5.34072 -0.96747 -2.14880 +X -3.88826 -5.77992 0.97985 +X 2.93845 -4.13990 1.48873 +X 6.49283 -2.46677 2.58708 +X -4.25359 -1.10369 2.44960 +X -2.58938 -2.47609 0.19873 +X 1.67134 -3.31648 -1.06329 +X 3.51684 0.83486 1.16210 +X -3.26438 0.97605 -1.90707 +X -2.50787 3.43257 -2.77732 +X 3.30258 4.76753 -3.20819 +X 1.34062 2.69142 -1.42676 +X -1.68937 4.48869 -1.27415 +X -5.52988 4.16635 3.68079 +X 1.94590 3.39048 3.54908 +X 2.11936 4.15692 1.55456 +X -0.67460 2.17957 1.26752 +X 0.00000 0.00000 0.00000 +X 0.01460 0.10155 -0.10476 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00149 -0.01137 -0.00015 +X -0.00281 -0.03808 -0.00103 +X 0.03524 -0.21375 -0.15997 +X -0.25911 -0.28383 0.11590 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.04430 -0.27757 0.29517 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00228 -0.05012 -0.05411 +X 0.36818 -0.19776 -0.40432 +X 0.08148 -0.00670 0.01066 +X 0.01479 -0.00037 -0.00038 +X 0.36931 0.21175 0.08529 +X 0.19162 0.00961 0.22922 +X 0.00000 0.00000 0.00000 +X 0.01282 0.00691 0.00625 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.10378 0.01511 -0.12315 +X 0.11276 0.11291 -0.01346 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00401 0.00808 0.00319 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00449 -0.01221 -0.00673 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.25464 -0.30934 -0.01158 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01483 -0.00926 0.00826 +X 0.00599 -0.00694 0.01458 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02469 -0.00096 -0.00167 +X -0.12282 -0.01384 0.09785 +X -0.08853 0.06565 -0.00988 +X -0.00590 0.00337 0.00292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.09870 -0.00812 -0.09345 +X -0.00229 0.00299 -0.00503 +X -0.00437 0.00283 -0.00251 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00966 0.00882 -0.00595 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05205 -0.05047 0.00640 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -32.98101 -59.03102 -83.58927 +X -3.09839 -4.66881 -1.66771 +X 4.46365 -4.95427 -0.41530 +X 4.82154 -0.33738 -3.22017 +X -6.07511 -1.69468 -1.78388 +X -4.05694 -5.68465 1.00361 +X 2.98507 -4.06140 1.57964 +X 6.70585 -2.74477 2.60852 +X -4.61588 -1.34503 2.44520 +X -2.57514 -2.39762 0.09213 +X 1.26319 -3.38373 -1.04851 +X 3.68454 0.83542 0.97590 +X -2.78209 1.11013 -1.99050 +X -2.15131 3.58366 -2.95760 +X 3.37153 5.24185 -3.02446 +X 1.41455 2.77689 -1.37217 +X -1.53215 4.53255 -1.11675 +X -6.00713 4.24043 3.40831 +X 2.32968 3.30202 3.62311 +X 2.10078 4.22772 1.59236 +X -0.74279 2.28416 1.22154 +X 0.00000 0.00000 0.00000 +X 0.00513 0.04428 -0.04434 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00191 -0.01093 -0.00028 +X -0.00246 -0.02811 -0.00150 +X 0.03369 -0.15656 -0.10834 +X -0.21100 -0.26140 0.12161 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05908 -0.24945 0.26292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00282 -0.04906 -0.05325 +X 0.25012 -0.12705 -0.34889 +X 0.09679 -0.01266 0.01307 +X 0.00796 -0.00044 -0.00018 +X 0.28173 0.18779 0.02795 +X 0.19716 0.01681 0.25966 +X 0.00000 0.00000 0.00000 +X 0.01373 0.00806 0.00681 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.05344 0.00956 -0.06670 +X 0.05757 0.05757 -0.00762 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00221 0.00456 0.00171 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.20136 -0.27733 -0.02619 +X 0.00323 -0.01168 0.00549 +X 0.00000 0.00000 0.00000 +X 0.01418 -0.01049 0.00863 +X 0.00520 -0.00674 0.01344 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02909 -0.00193 -0.00193 +X -0.12864 -0.02355 0.11648 +X -0.10765 0.09722 -0.00864 +X -0.00782 0.00461 0.00405 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.12363 -0.02061 -0.12378 +X -0.00242 0.00340 -0.00559 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00633 0.00816 -0.00430 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05354 -0.05653 0.00643 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -36.06068 -57.41089 -81.58879 +X -3.06608 -4.45659 -1.53716 +X 4.59498 -4.67231 -0.49859 +X 5.07670 -0.51077 -3.48976 +X -6.90312 -2.42141 -1.40220 +X -4.23532 -5.48777 1.06201 +X 2.99397 -3.78407 1.80396 +X 6.81081 -3.03005 2.34615 +X -4.90791 -1.34655 2.35739 +X -2.46536 -2.19423 0.08654 +X 0.80286 -3.34341 -0.95315 +X 3.73035 0.50785 0.87413 +X -2.23332 0.98051 -1.93905 +X -1.75184 3.70192 -3.13347 +X 3.72999 5.69240 -2.74530 +X 1.39698 2.76181 -1.39661 +X -1.51326 4.48424 -1.02419 +X -6.63427 4.21372 2.85228 +X 2.96687 3.09033 3.68966 +X 2.11737 4.31377 1.59487 +X -0.86490 2.30670 1.31673 +X 0.00000 0.00000 0.00000 +X 0.00120 0.02372 -0.02333 +X 0.00000 0.00000 0.00000 +X -0.00128 0.00246 -0.00139 +X 0.00228 -0.01228 -0.00062 +X -0.00207 -0.02464 -0.00209 +X 0.05238 -0.15265 -0.08858 +X -0.17021 -0.27037 0.12999 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06975 -0.23296 0.23756 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 -0.05275 -0.05764 +X 0.18395 -0.09289 -0.29559 +X 0.13663 -0.02476 0.01187 +X 0.01909 0.00519 -0.00701 +X 0.28612 0.20026 -0.00192 +X 0.21313 0.02216 0.32092 +X 0.00000 0.00000 0.00000 +X 0.01580 0.00995 0.00842 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.03893 0.00647 -0.04894 +X 0.03845 0.03897 -0.00452 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00124 0.00276 0.00106 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00215 0.00131 -0.00132 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.15538 -0.24702 -0.04168 +X 0.00315 -0.01323 0.00582 +X 0.00000 0.00000 0.00000 +X 0.01430 -0.01311 0.00960 +X 0.00519 -0.00761 0.01384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.03784 -0.00343 -0.00129 +X -0.15347 -0.03143 0.14969 +X -0.14720 0.15527 -0.00863 +X -0.01033 0.00621 0.00579 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.15542 -0.04041 -0.16998 +X -0.00263 0.00384 -0.00633 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00525 0.00909 -0.00390 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06301 -0.07423 0.00597 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -38.65934 -56.74544 -80.55182 +X -3.12953 -4.39135 -1.44388 +X 4.61881 -4.76109 -0.34105 +X 5.27923 -0.75337 -3.72766 +X -7.64412 -2.43833 -1.46420 +X -4.29289 -5.64014 1.32867 +X 2.99425 -3.47009 1.98388 +X 7.00602 -3.06000 2.23022 +X -4.93958 -1.16005 2.42709 +X -2.25754 -2.04854 0.10271 +X 0.39218 -3.22692 -1.00018 +X 3.57293 0.14087 0.62450 +X -1.82959 0.60450 -2.25084 +X -1.38239 3.87147 -3.54073 +X 4.44766 5.69624 -2.15455 +X 1.37954 2.89725 -1.66507 +X -1.58369 4.82583 -1.02111 +X -7.48941 3.84037 2.52487 +X 3.53781 2.62869 4.12855 +X 2.15533 4.66012 1.72352 +X -1.02592 2.39802 1.50804 +X 0.00000 0.00000 0.00000 +X -0.00006 0.03340 -0.03445 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00230 -0.01443 -0.00111 +X -0.00143 -0.01593 -0.00158 +X 0.08964 -0.16338 -0.07190 +X -0.07253 -0.25738 0.15712 +X -0.00338 -0.00671 0.00257 +X 0.00000 0.00000 0.00000 +X -0.03833 -0.12442 0.13556 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00385 -0.05373 -0.05928 +X 0.15383 -0.10836 -0.18107 +X 0.11043 -0.02403 0.00628 +X 0.01976 0.00295 -0.00484 +X 0.23424 0.13411 0.02126 +X 0.13077 0.00997 0.21001 +X 0.00000 0.00000 0.00000 +X 0.01050 0.00687 0.00618 +X 0.00000 0.00000 0.00000 +X 0.00208 -0.00168 -0.00384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.07772 0.01034 -0.09412 +X 0.08310 0.09050 -0.01176 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00194 0.00461 0.00191 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 0.00242 -0.00219 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00652 -0.00365 -0.00371 +X 0.08418 -0.14892 -0.02839 +X 0.00190 -0.00912 0.00374 +X 0.00000 0.00000 0.00000 +X 0.00899 -0.00930 0.00637 +X 0.00292 -0.00455 0.00807 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05439 -0.00563 0.00009 +X -0.18431 -0.03676 0.18473 +X -0.20546 0.22657 -0.01410 +X -0.01238 0.00749 0.00711 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.18806 -0.06796 -0.20969 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00394 0.00928 -0.00356 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07310 -0.09603 0.00180 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/plumed.dat b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/plumed.dat new file mode 100644 index 0000000000..cc01ccb803 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-nogather/plumed.dat @@ -0,0 +1,20 @@ +LOAD FILE=../../../../plumedOpenACC.so +# With MULTIGPU the tasks of the GPU actions are split in blocks between the 4 processes, +# and the results summed. AVOID_THREAD_GATHER asks for the low memory force gathering. +# The contact matrix c1 has 3 rows and 108 columns: the last process computes no row, +# but some of the columns in the second pass of the low memory force gathering, so it +# must upload the positions there. +# The CPU references come from regtest/adjmat/rt-nogather-serial-mpi +c1: CONTACT_MATRIX GROUPA=1-3 GROUPB=1-108 SWITCH={RATIONAL R_0=1 NN=6 MM=12 D_MAX=2} USEGPU MULTIGPU AVOID_THREAD_GATHER +ones: ONES SIZE=108 +cc: MATRIX_VECTOR_PRODUCT ARG=c1,ones USEGPU MULTIGPU +mtc: MORE_THAN ARG=cc SWITCH={RATIONAL D_0=2 R_0=2} USEGPU MULTIGPU +s: SUM ARG=mtc PERIODIC=NO +BIASVALUE ARG=s + +c2: CONTACT_MATRIX GROUP=1-20 SWITCH={RATIONAL R_0=1.5 NN=6 MM=12} USEGPU MULTIGPU +c22: MATRIX_PRODUCT ARG=c2,c2 USEGPU MULTIGPU AVOID_THREAD_GATHER +diag: DIAGONALIZE ARG=c22 VECTORS=1 +BIASVALUE ARG=diag.vals-1 + +PRINT ARG=s,diag.vals-1 FILE=colvar FMT=%10.5f diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/Makefile b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/Makefile new file mode 100644 index 0000000000..3703b27cea --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/Makefile @@ -0,0 +1 @@ +include ../../scripts/test.make diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/colvar.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/colvar.reference new file mode 100644 index 0000000000..4b6b6fab04 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/colvar.reference @@ -0,0 +1,6 @@ +#! FIELDS time s diag.vals-1 + 0.000000 0.13443 42.22566 + 1.000000 0.13067 41.67056 + 2.000000 0.10292 40.98616 + 3.000000 0.10205 40.05492 + 4.000000 0.09599 40.13433 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/config b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/config new file mode 100644 index 0000000000..f673f4f757 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/config @@ -0,0 +1,6 @@ +type=driver +mpiprocs=2 +arg="--plumed plumed.dat --ixyz trajectory.xyz --dump-forces forces --dump-forces-fmt=%10.5f" +extra_files="../../trajectories/trajectory.xyz" +# some contributions are computed in single precision on the GPU: the last printed digit may differ from the CPU +plumed_tolerance=(forces.0:1e-4 forces.1:1e-4 colvar:1e-4) diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/forces.0.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/forces.0.reference new file mode 100644 index 0000000000..88519b9f4b --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/forces.0.reference @@ -0,0 +1,550 @@ +108 + -30.07783 -61.87946 -85.31495 +X -2.99958 -4.41155 -1.40689 +X 3.66746 -5.18612 -0.38351 +X 4.41451 -0.40098 -3.31410 +X -5.41424 -1.26872 -1.80431 +X -3.58153 -5.68061 0.95972 +X 2.79921 -4.19021 1.35698 +X 6.05708 -2.33856 2.35001 +X -4.19779 -0.85594 2.86511 +X -2.39362 -2.56428 0.36621 +X 1.93567 -3.06353 -1.01896 +X 3.20164 0.69639 1.18694 +X -3.21626 0.79417 -1.80440 +X -2.83854 3.48827 -3.30190 +X 4.01562 4.51654 -2.81866 +X 1.26921 2.58287 -1.53033 +X -1.93124 4.52659 -1.31977 +X -5.35213 4.17413 3.16661 +X 2.37661 3.41411 3.67707 +X 2.16620 4.34272 1.43869 +X -0.85840 2.31272 1.49981 +X 0.00000 0.00000 0.00000 +X 0.01301 0.13167 -0.13480 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00118 -0.01732 -0.00012 +X -0.00174 -0.03906 -0.00057 +X 0.07042 -0.26603 -0.18082 +X -0.22145 -0.29256 0.12129 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.01801 -0.23817 0.24226 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00167 -0.07943 -0.08325 +X 0.39187 -0.18704 -0.30656 +X 0.05833 -0.00179 0.00382 +X 0.02080 -0.00018 -0.00023 +X 0.36558 0.19822 0.12250 +X 0.18307 0.00602 0.20187 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.13548 0.01132 -0.14473 +X 0.13624 0.13569 -0.00865 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.22858 -0.25083 -0.00953 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01120 -0.00623 0.00585 +X 0.00522 -0.00561 0.01164 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02664 -0.00055 -0.00099 +X -0.14515 -0.00889 0.11546 +X -0.11918 0.08906 -0.00900 +X -0.00584 0.00313 0.00288 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.11028 -0.00427 -0.10656 +X -0.00262 0.00303 -0.00549 +X -0.00547 0.00315 -0.00294 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00831 0.00445 -0.00424 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07783 -0.07581 0.00658 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -30.96535 -60.92028 -85.02883 +X -3.09317 -4.62648 -1.49722 +X 4.05363 -4.97291 -0.31789 +X 4.57259 -0.29362 -3.17490 +X -5.34072 -0.96747 -2.14880 +X -3.88826 -5.77992 0.97985 +X 2.93845 -4.13990 1.48873 +X 6.49283 -2.46677 2.58708 +X -4.25359 -1.10369 2.44960 +X -2.58938 -2.47609 0.19873 +X 1.67134 -3.31648 -1.06329 +X 3.51684 0.83486 1.16210 +X -3.26438 0.97605 -1.90707 +X -2.50787 3.43257 -2.77732 +X 3.30258 4.76753 -3.20819 +X 1.34062 2.69142 -1.42676 +X -1.68937 4.48869 -1.27415 +X -5.52988 4.16635 3.68079 +X 1.94590 3.39048 3.54908 +X 2.11936 4.15692 1.55456 +X -0.67460 2.17957 1.26752 +X 0.00000 0.00000 0.00000 +X 0.01460 0.10155 -0.10476 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00149 -0.01137 -0.00015 +X -0.00281 -0.03808 -0.00103 +X 0.03524 -0.21375 -0.15997 +X -0.25911 -0.28383 0.11590 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.04430 -0.27757 0.29517 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00228 -0.05012 -0.05411 +X 0.36818 -0.19776 -0.40432 +X 0.08148 -0.00670 0.01066 +X 0.01479 -0.00037 -0.00038 +X 0.36931 0.21175 0.08529 +X 0.19162 0.00961 0.22922 +X 0.00000 0.00000 0.00000 +X 0.01282 0.00691 0.00625 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.10378 0.01511 -0.12315 +X 0.11276 0.11291 -0.01346 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00401 0.00808 0.00319 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00449 -0.01221 -0.00673 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.25464 -0.30934 -0.01158 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01483 -0.00926 0.00826 +X 0.00599 -0.00694 0.01458 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02469 -0.00096 -0.00167 +X -0.12282 -0.01384 0.09785 +X -0.08853 0.06565 -0.00988 +X -0.00590 0.00337 0.00292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.09870 -0.00812 -0.09345 +X -0.00229 0.00299 -0.00503 +X -0.00437 0.00283 -0.00251 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00966 0.00882 -0.00595 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05205 -0.05047 0.00640 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -32.98101 -59.03102 -83.58927 +X -3.09839 -4.66881 -1.66771 +X 4.46365 -4.95427 -0.41530 +X 4.82154 -0.33738 -3.22017 +X -6.07511 -1.69468 -1.78388 +X -4.05694 -5.68465 1.00361 +X 2.98507 -4.06140 1.57964 +X 6.70585 -2.74477 2.60852 +X -4.61588 -1.34503 2.44520 +X -2.57514 -2.39762 0.09213 +X 1.26319 -3.38373 -1.04851 +X 3.68454 0.83542 0.97590 +X -2.78209 1.11013 -1.99050 +X -2.15131 3.58366 -2.95760 +X 3.37153 5.24185 -3.02446 +X 1.41455 2.77689 -1.37217 +X -1.53215 4.53255 -1.11675 +X -6.00713 4.24043 3.40831 +X 2.32968 3.30202 3.62311 +X 2.10078 4.22772 1.59236 +X -0.74279 2.28416 1.22154 +X 0.00000 0.00000 0.00000 +X 0.00513 0.04428 -0.04434 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00191 -0.01093 -0.00028 +X -0.00246 -0.02811 -0.00150 +X 0.03369 -0.15656 -0.10834 +X -0.21100 -0.26140 0.12161 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05908 -0.24945 0.26292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00282 -0.04906 -0.05325 +X 0.25012 -0.12705 -0.34889 +X 0.09679 -0.01266 0.01307 +X 0.00796 -0.00044 -0.00018 +X 0.28173 0.18779 0.02795 +X 0.19716 0.01681 0.25966 +X 0.00000 0.00000 0.00000 +X 0.01373 0.00806 0.00681 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.05344 0.00956 -0.06670 +X 0.05757 0.05757 -0.00762 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00221 0.00456 0.00171 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.20136 -0.27733 -0.02619 +X 0.00323 -0.01168 0.00549 +X 0.00000 0.00000 0.00000 +X 0.01418 -0.01049 0.00863 +X 0.00520 -0.00674 0.01344 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02909 -0.00193 -0.00193 +X -0.12864 -0.02355 0.11648 +X -0.10765 0.09722 -0.00864 +X -0.00782 0.00461 0.00405 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.12363 -0.02061 -0.12378 +X -0.00242 0.00340 -0.00559 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00633 0.00816 -0.00430 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05354 -0.05653 0.00643 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -36.06068 -57.41089 -81.58879 +X -3.06608 -4.45659 -1.53716 +X 4.59498 -4.67231 -0.49859 +X 5.07670 -0.51077 -3.48976 +X -6.90312 -2.42141 -1.40220 +X -4.23532 -5.48777 1.06201 +X 2.99397 -3.78407 1.80396 +X 6.81081 -3.03005 2.34615 +X -4.90791 -1.34655 2.35739 +X -2.46536 -2.19423 0.08654 +X 0.80286 -3.34341 -0.95315 +X 3.73035 0.50785 0.87413 +X -2.23332 0.98051 -1.93905 +X -1.75184 3.70192 -3.13347 +X 3.72999 5.69240 -2.74530 +X 1.39698 2.76181 -1.39661 +X -1.51326 4.48424 -1.02419 +X -6.63427 4.21372 2.85228 +X 2.96687 3.09033 3.68966 +X 2.11737 4.31377 1.59487 +X -0.86490 2.30670 1.31673 +X 0.00000 0.00000 0.00000 +X 0.00120 0.02372 -0.02333 +X 0.00000 0.00000 0.00000 +X -0.00128 0.00246 -0.00139 +X 0.00228 -0.01228 -0.00062 +X -0.00207 -0.02464 -0.00209 +X 0.05238 -0.15265 -0.08858 +X -0.17021 -0.27037 0.12999 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06975 -0.23296 0.23756 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 -0.05275 -0.05764 +X 0.18395 -0.09289 -0.29559 +X 0.13663 -0.02476 0.01187 +X 0.01909 0.00519 -0.00701 +X 0.28612 0.20026 -0.00192 +X 0.21313 0.02216 0.32092 +X 0.00000 0.00000 0.00000 +X 0.01580 0.00995 0.00842 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.03893 0.00647 -0.04894 +X 0.03845 0.03897 -0.00452 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00124 0.00276 0.00106 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00215 0.00131 -0.00132 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.15538 -0.24702 -0.04168 +X 0.00315 -0.01323 0.00582 +X 0.00000 0.00000 0.00000 +X 0.01430 -0.01311 0.00960 +X 0.00519 -0.00761 0.01384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.03784 -0.00343 -0.00129 +X -0.15347 -0.03143 0.14969 +X -0.14720 0.15527 -0.00863 +X -0.01033 0.00621 0.00579 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.15542 -0.04041 -0.16998 +X -0.00263 0.00384 -0.00633 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00525 0.00909 -0.00390 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06301 -0.07423 0.00597 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -38.65934 -56.74544 -80.55182 +X -3.12953 -4.39135 -1.44388 +X 4.61881 -4.76109 -0.34105 +X 5.27923 -0.75337 -3.72766 +X -7.64412 -2.43833 -1.46420 +X -4.29289 -5.64014 1.32867 +X 2.99425 -3.47009 1.98388 +X 7.00602 -3.06000 2.23022 +X -4.93958 -1.16005 2.42709 +X -2.25754 -2.04854 0.10271 +X 0.39218 -3.22692 -1.00018 +X 3.57293 0.14087 0.62450 +X -1.82959 0.60450 -2.25084 +X -1.38239 3.87147 -3.54073 +X 4.44766 5.69624 -2.15455 +X 1.37954 2.89725 -1.66507 +X -1.58369 4.82583 -1.02111 +X -7.48941 3.84037 2.52487 +X 3.53781 2.62869 4.12855 +X 2.15533 4.66012 1.72352 +X -1.02592 2.39802 1.50804 +X 0.00000 0.00000 0.00000 +X -0.00006 0.03340 -0.03445 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00230 -0.01443 -0.00111 +X -0.00143 -0.01593 -0.00158 +X 0.08964 -0.16338 -0.07190 +X -0.07253 -0.25738 0.15712 +X -0.00338 -0.00671 0.00257 +X 0.00000 0.00000 0.00000 +X -0.03833 -0.12442 0.13556 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00385 -0.05373 -0.05928 +X 0.15383 -0.10836 -0.18107 +X 0.11043 -0.02403 0.00628 +X 0.01976 0.00295 -0.00484 +X 0.23424 0.13411 0.02126 +X 0.13077 0.00997 0.21001 +X 0.00000 0.00000 0.00000 +X 0.01050 0.00687 0.00618 +X 0.00000 0.00000 0.00000 +X 0.00208 -0.00168 -0.00384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.07772 0.01034 -0.09412 +X 0.08310 0.09050 -0.01176 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00194 0.00461 0.00191 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 0.00242 -0.00219 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00652 -0.00365 -0.00371 +X 0.08418 -0.14892 -0.02839 +X 0.00190 -0.00912 0.00374 +X 0.00000 0.00000 0.00000 +X 0.00899 -0.00930 0.00637 +X 0.00292 -0.00455 0.00807 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05439 -0.00563 0.00009 +X -0.18431 -0.03676 0.18473 +X -0.20546 0.22657 -0.01410 +X -0.01238 0.00749 0.00711 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.18806 -0.06796 -0.20969 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00394 0.00928 -0.00356 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07310 -0.09603 0.00180 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/forces.1.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/forces.1.reference new file mode 100644 index 0000000000..88519b9f4b --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/forces.1.reference @@ -0,0 +1,550 @@ +108 + -30.07783 -61.87946 -85.31495 +X -2.99958 -4.41155 -1.40689 +X 3.66746 -5.18612 -0.38351 +X 4.41451 -0.40098 -3.31410 +X -5.41424 -1.26872 -1.80431 +X -3.58153 -5.68061 0.95972 +X 2.79921 -4.19021 1.35698 +X 6.05708 -2.33856 2.35001 +X -4.19779 -0.85594 2.86511 +X -2.39362 -2.56428 0.36621 +X 1.93567 -3.06353 -1.01896 +X 3.20164 0.69639 1.18694 +X -3.21626 0.79417 -1.80440 +X -2.83854 3.48827 -3.30190 +X 4.01562 4.51654 -2.81866 +X 1.26921 2.58287 -1.53033 +X -1.93124 4.52659 -1.31977 +X -5.35213 4.17413 3.16661 +X 2.37661 3.41411 3.67707 +X 2.16620 4.34272 1.43869 +X -0.85840 2.31272 1.49981 +X 0.00000 0.00000 0.00000 +X 0.01301 0.13167 -0.13480 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00118 -0.01732 -0.00012 +X -0.00174 -0.03906 -0.00057 +X 0.07042 -0.26603 -0.18082 +X -0.22145 -0.29256 0.12129 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.01801 -0.23817 0.24226 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00167 -0.07943 -0.08325 +X 0.39187 -0.18704 -0.30656 +X 0.05833 -0.00179 0.00382 +X 0.02080 -0.00018 -0.00023 +X 0.36558 0.19822 0.12250 +X 0.18307 0.00602 0.20187 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.13548 0.01132 -0.14473 +X 0.13624 0.13569 -0.00865 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.22858 -0.25083 -0.00953 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01120 -0.00623 0.00585 +X 0.00522 -0.00561 0.01164 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02664 -0.00055 -0.00099 +X -0.14515 -0.00889 0.11546 +X -0.11918 0.08906 -0.00900 +X -0.00584 0.00313 0.00288 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.11028 -0.00427 -0.10656 +X -0.00262 0.00303 -0.00549 +X -0.00547 0.00315 -0.00294 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00831 0.00445 -0.00424 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07783 -0.07581 0.00658 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -30.96535 -60.92028 -85.02883 +X -3.09317 -4.62648 -1.49722 +X 4.05363 -4.97291 -0.31789 +X 4.57259 -0.29362 -3.17490 +X -5.34072 -0.96747 -2.14880 +X -3.88826 -5.77992 0.97985 +X 2.93845 -4.13990 1.48873 +X 6.49283 -2.46677 2.58708 +X -4.25359 -1.10369 2.44960 +X -2.58938 -2.47609 0.19873 +X 1.67134 -3.31648 -1.06329 +X 3.51684 0.83486 1.16210 +X -3.26438 0.97605 -1.90707 +X -2.50787 3.43257 -2.77732 +X 3.30258 4.76753 -3.20819 +X 1.34062 2.69142 -1.42676 +X -1.68937 4.48869 -1.27415 +X -5.52988 4.16635 3.68079 +X 1.94590 3.39048 3.54908 +X 2.11936 4.15692 1.55456 +X -0.67460 2.17957 1.26752 +X 0.00000 0.00000 0.00000 +X 0.01460 0.10155 -0.10476 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00149 -0.01137 -0.00015 +X -0.00281 -0.03808 -0.00103 +X 0.03524 -0.21375 -0.15997 +X -0.25911 -0.28383 0.11590 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.04430 -0.27757 0.29517 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00228 -0.05012 -0.05411 +X 0.36818 -0.19776 -0.40432 +X 0.08148 -0.00670 0.01066 +X 0.01479 -0.00037 -0.00038 +X 0.36931 0.21175 0.08529 +X 0.19162 0.00961 0.22922 +X 0.00000 0.00000 0.00000 +X 0.01282 0.00691 0.00625 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.10378 0.01511 -0.12315 +X 0.11276 0.11291 -0.01346 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00401 0.00808 0.00319 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00449 -0.01221 -0.00673 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.25464 -0.30934 -0.01158 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.01483 -0.00926 0.00826 +X 0.00599 -0.00694 0.01458 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02469 -0.00096 -0.00167 +X -0.12282 -0.01384 0.09785 +X -0.08853 0.06565 -0.00988 +X -0.00590 0.00337 0.00292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.09870 -0.00812 -0.09345 +X -0.00229 0.00299 -0.00503 +X -0.00437 0.00283 -0.00251 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00966 0.00882 -0.00595 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05205 -0.05047 0.00640 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -32.98101 -59.03102 -83.58927 +X -3.09839 -4.66881 -1.66771 +X 4.46365 -4.95427 -0.41530 +X 4.82154 -0.33738 -3.22017 +X -6.07511 -1.69468 -1.78388 +X -4.05694 -5.68465 1.00361 +X 2.98507 -4.06140 1.57964 +X 6.70585 -2.74477 2.60852 +X -4.61588 -1.34503 2.44520 +X -2.57514 -2.39762 0.09213 +X 1.26319 -3.38373 -1.04851 +X 3.68454 0.83542 0.97590 +X -2.78209 1.11013 -1.99050 +X -2.15131 3.58366 -2.95760 +X 3.37153 5.24185 -3.02446 +X 1.41455 2.77689 -1.37217 +X -1.53215 4.53255 -1.11675 +X -6.00713 4.24043 3.40831 +X 2.32968 3.30202 3.62311 +X 2.10078 4.22772 1.59236 +X -0.74279 2.28416 1.22154 +X 0.00000 0.00000 0.00000 +X 0.00513 0.04428 -0.04434 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00191 -0.01093 -0.00028 +X -0.00246 -0.02811 -0.00150 +X 0.03369 -0.15656 -0.10834 +X -0.21100 -0.26140 0.12161 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05908 -0.24945 0.26292 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00282 -0.04906 -0.05325 +X 0.25012 -0.12705 -0.34889 +X 0.09679 -0.01266 0.01307 +X 0.00796 -0.00044 -0.00018 +X 0.28173 0.18779 0.02795 +X 0.19716 0.01681 0.25966 +X 0.00000 0.00000 0.00000 +X 0.01373 0.00806 0.00681 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.05344 0.00956 -0.06670 +X 0.05757 0.05757 -0.00762 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00221 0.00456 0.00171 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.20136 -0.27733 -0.02619 +X 0.00323 -0.01168 0.00549 +X 0.00000 0.00000 0.00000 +X 0.01418 -0.01049 0.00863 +X 0.00520 -0.00674 0.01344 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.02909 -0.00193 -0.00193 +X -0.12864 -0.02355 0.11648 +X -0.10765 0.09722 -0.00864 +X -0.00782 0.00461 0.00405 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.12363 -0.02061 -0.12378 +X -0.00242 0.00340 -0.00559 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00633 0.00816 -0.00430 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05354 -0.05653 0.00643 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -36.06068 -57.41089 -81.58879 +X -3.06608 -4.45659 -1.53716 +X 4.59498 -4.67231 -0.49859 +X 5.07670 -0.51077 -3.48976 +X -6.90312 -2.42141 -1.40220 +X -4.23532 -5.48777 1.06201 +X 2.99397 -3.78407 1.80396 +X 6.81081 -3.03005 2.34615 +X -4.90791 -1.34655 2.35739 +X -2.46536 -2.19423 0.08654 +X 0.80286 -3.34341 -0.95315 +X 3.73035 0.50785 0.87413 +X -2.23332 0.98051 -1.93905 +X -1.75184 3.70192 -3.13347 +X 3.72999 5.69240 -2.74530 +X 1.39698 2.76181 -1.39661 +X -1.51326 4.48424 -1.02419 +X -6.63427 4.21372 2.85228 +X 2.96687 3.09033 3.68966 +X 2.11737 4.31377 1.59487 +X -0.86490 2.30670 1.31673 +X 0.00000 0.00000 0.00000 +X 0.00120 0.02372 -0.02333 +X 0.00000 0.00000 0.00000 +X -0.00128 0.00246 -0.00139 +X 0.00228 -0.01228 -0.00062 +X -0.00207 -0.02464 -0.00209 +X 0.05238 -0.15265 -0.08858 +X -0.17021 -0.27037 0.12999 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06975 -0.23296 0.23756 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 -0.05275 -0.05764 +X 0.18395 -0.09289 -0.29559 +X 0.13663 -0.02476 0.01187 +X 0.01909 0.00519 -0.00701 +X 0.28612 0.20026 -0.00192 +X 0.21313 0.02216 0.32092 +X 0.00000 0.00000 0.00000 +X 0.01580 0.00995 0.00842 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.03893 0.00647 -0.04894 +X 0.03845 0.03897 -0.00452 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00124 0.00276 0.00106 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00215 0.00131 -0.00132 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.15538 -0.24702 -0.04168 +X 0.00315 -0.01323 0.00582 +X 0.00000 0.00000 0.00000 +X 0.01430 -0.01311 0.00960 +X 0.00519 -0.00761 0.01384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.03784 -0.00343 -0.00129 +X -0.15347 -0.03143 0.14969 +X -0.14720 0.15527 -0.00863 +X -0.01033 0.00621 0.00579 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.15542 -0.04041 -0.16998 +X -0.00263 0.00384 -0.00633 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00525 0.00909 -0.00390 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.06301 -0.07423 0.00597 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +108 + -38.65934 -56.74544 -80.55182 +X -3.12953 -4.39135 -1.44388 +X 4.61881 -4.76109 -0.34105 +X 5.27923 -0.75337 -3.72766 +X -7.64412 -2.43833 -1.46420 +X -4.29289 -5.64014 1.32867 +X 2.99425 -3.47009 1.98388 +X 7.00602 -3.06000 2.23022 +X -4.93958 -1.16005 2.42709 +X -2.25754 -2.04854 0.10271 +X 0.39218 -3.22692 -1.00018 +X 3.57293 0.14087 0.62450 +X -1.82959 0.60450 -2.25084 +X -1.38239 3.87147 -3.54073 +X 4.44766 5.69624 -2.15455 +X 1.37954 2.89725 -1.66507 +X -1.58369 4.82583 -1.02111 +X -7.48941 3.84037 2.52487 +X 3.53781 2.62869 4.12855 +X 2.15533 4.66012 1.72352 +X -1.02592 2.39802 1.50804 +X 0.00000 0.00000 0.00000 +X -0.00006 0.03340 -0.03445 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00230 -0.01443 -0.00111 +X -0.00143 -0.01593 -0.00158 +X 0.08964 -0.16338 -0.07190 +X -0.07253 -0.25738 0.15712 +X -0.00338 -0.00671 0.00257 +X 0.00000 0.00000 0.00000 +X -0.03833 -0.12442 0.13556 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00385 -0.05373 -0.05928 +X 0.15383 -0.10836 -0.18107 +X 0.11043 -0.02403 0.00628 +X 0.01976 0.00295 -0.00484 +X 0.23424 0.13411 0.02126 +X 0.13077 0.00997 0.21001 +X 0.00000 0.00000 0.00000 +X 0.01050 0.00687 0.00618 +X 0.00000 0.00000 0.00000 +X 0.00208 -0.00168 -0.00384 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.07772 0.01034 -0.09412 +X 0.08310 0.09050 -0.01176 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00194 0.00461 0.00191 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00359 0.00242 -0.00219 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00652 -0.00365 -0.00371 +X 0.08418 -0.14892 -0.02839 +X 0.00190 -0.00912 0.00374 +X 0.00000 0.00000 0.00000 +X 0.00899 -0.00930 0.00637 +X 0.00292 -0.00455 0.00807 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.05439 -0.00563 0.00009 +X -0.18431 -0.03676 0.18473 +X -0.20546 0.22657 -0.01410 +X -0.01238 0.00749 0.00711 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.18806 -0.06796 -0.20969 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.00394 0.00928 -0.00356 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X -0.07310 -0.09603 0.00180 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 +X 0.00000 0.00000 0.00000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/plumed.dat b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/plumed.dat new file mode 100644 index 0000000000..e33e4fab5f --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-serial/plumed.dat @@ -0,0 +1,17 @@ +LOAD FILE=../../../../plumedOpenACC.so +# With SERIAL (that wins over MULTIGPU) only the first of the 2 processes computes the GPU actions, on its GPU, and +# sends the results to the other one. +# The CPU references come from regtest/adjmat/rt-nogather-serial-mpi +c1: CONTACT_MATRIX GROUPA=1-3 GROUPB=1-108 SWITCH={RATIONAL R_0=1 NN=6 MM=12 D_MAX=2} USEGPU SERIAL MULTIGPU AVOID_THREAD_GATHER +ones: ONES SIZE=108 +cc: MATRIX_VECTOR_PRODUCT ARG=c1,ones USEGPU SERIAL MULTIGPU +mtc: MORE_THAN ARG=cc SWITCH={RATIONAL D_0=2 R_0=2} USEGPU SERIAL MULTIGPU +s: SUM ARG=mtc PERIODIC=NO +BIASVALUE ARG=s + +c2: CONTACT_MATRIX GROUP=1-20 SWITCH={RATIONAL R_0=1.5 NN=6 MM=12} USEGPU SERIAL MULTIGPU +c22: MATRIX_PRODUCT ARG=c2,c2 USEGPU SERIAL MULTIGPU AVOID_THREAD_GATHER +diag: DIAGONALIZE ARG=c22 VECTORS=1 +BIASVALUE ARG=diag.vals-1 + +PRINT ARG=s,diag.vals-1 FILE=colvar FMT=%10.5f diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/Makefile b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/Makefile new file mode 100644 index 0000000000..3703b27cea --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/Makefile @@ -0,0 +1 @@ +include ../../scripts/test.make diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/colvar.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/colvar.reference new file mode 100644 index 0000000000..203577a03b --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/colvar.reference @@ -0,0 +1,2 @@ +#! FIELDS time q6_mean w6_mean cn_mean d_mean + 0.000000 0.2451 0.0658 13.5703 6.0990 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/config b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/config new file mode 100644 index 0000000000..324aa5d02d --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/config @@ -0,0 +1,6 @@ +type=driver +mpiprocs=3 +arg="--plumed plumed.dat --ixyz 64.xyz --dump-forces forces --dump-forces-fmt=%8.4f" +extra_files="../../trajectories/64.xyz" +# some contributions are computed in single precision on the GPU: the last printed digit may differ from the CPU +plumed_tolerance=(forces.0:2e-4 forces.1:2e-4 forces.2:2e-4 colvar:2e-4) diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/forces.0.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/forces.0.reference new file mode 100644 index 0000000000..6f8669c3db --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/forces.0.reference @@ -0,0 +1,66 @@ +64 + -5.5073 -5.3369 -5.5219 +X 0.0020 0.0025 -0.0010 +X 0.0133 -0.0034 -0.0188 +X -0.0060 -0.0059 -0.0092 +X 0.0122 0.0190 0.0087 +X 0.0087 0.0074 0.0019 +X -0.0045 -0.0247 -0.0004 +X -0.0019 0.0032 -0.0087 +X -0.0038 0.0017 -0.0127 +X 0.0088 -0.0181 -0.0154 +X -0.0063 -0.0054 0.0141 +X -0.0060 0.0084 0.0011 +X 0.0050 0.0020 0.0106 +X -0.0017 0.0005 -0.0079 +X -0.0076 0.0250 0.0048 +X 0.0006 -0.0082 -0.0013 +X 0.0020 -0.0042 -0.0041 +X -0.0023 0.0081 0.0115 +X 0.0072 -0.0147 0.0076 +X -0.0198 0.0194 0.0059 +X -0.0080 0.0050 -0.0106 +X 0.0087 -0.0023 -0.0113 +X -0.0100 0.0057 0.0085 +X -0.0110 -0.0055 0.0060 +X -0.0021 -0.0148 -0.0119 +X 0.0102 0.0045 0.0189 +X 0.0002 -0.0242 -0.0245 +X -0.0093 0.0071 0.0005 +X -0.0033 -0.0165 0.0000 +X 0.0206 -0.0134 0.0031 +X 0.0139 0.0033 0.0264 +X 0.0059 0.0111 0.0012 +X 0.0219 -0.0073 -0.0095 +X -0.0087 -0.0118 0.0017 +X -0.0161 -0.0114 0.0090 +X -0.0086 0.0056 -0.0002 +X -0.0122 0.0041 0.0029 +X 0.0150 0.0283 0.0094 +X -0.0029 0.0114 0.0016 +X -0.0012 0.0051 -0.0010 +X 0.0177 0.0070 -0.0066 +X -0.0067 -0.0082 0.0080 +X 0.0210 -0.0217 -0.0057 +X -0.0017 0.0075 0.0004 +X 0.0195 -0.0162 0.0030 +X -0.0057 0.0106 0.0047 +X 0.0031 0.0101 0.0042 +X 0.0162 -0.0082 -0.0045 +X -0.0118 0.0140 0.0022 +X -0.0029 -0.0053 -0.0121 +X -0.0107 0.0038 0.0024 +X -0.0017 0.0115 -0.0082 +X 0.0005 0.0063 0.0007 +X -0.0001 0.0021 -0.0243 +X -0.0029 -0.0061 -0.0050 +X -0.0182 -0.0056 0.0079 +X 0.0046 0.0017 0.0094 +X 0.0022 -0.0015 -0.0024 +X -0.0022 0.0081 0.0018 +X 0.0086 -0.0146 0.0046 +X -0.0084 0.0036 0.0066 +X 0.0051 0.0059 -0.0090 +X -0.0009 -0.0081 0.0018 +X -0.0177 -0.0071 0.0036 +X -0.0099 0.0144 0.0097 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/forces.1.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/forces.1.reference new file mode 100644 index 0000000000..6f8669c3db --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/forces.1.reference @@ -0,0 +1,66 @@ +64 + -5.5073 -5.3369 -5.5219 +X 0.0020 0.0025 -0.0010 +X 0.0133 -0.0034 -0.0188 +X -0.0060 -0.0059 -0.0092 +X 0.0122 0.0190 0.0087 +X 0.0087 0.0074 0.0019 +X -0.0045 -0.0247 -0.0004 +X -0.0019 0.0032 -0.0087 +X -0.0038 0.0017 -0.0127 +X 0.0088 -0.0181 -0.0154 +X -0.0063 -0.0054 0.0141 +X -0.0060 0.0084 0.0011 +X 0.0050 0.0020 0.0106 +X -0.0017 0.0005 -0.0079 +X -0.0076 0.0250 0.0048 +X 0.0006 -0.0082 -0.0013 +X 0.0020 -0.0042 -0.0041 +X -0.0023 0.0081 0.0115 +X 0.0072 -0.0147 0.0076 +X -0.0198 0.0194 0.0059 +X -0.0080 0.0050 -0.0106 +X 0.0087 -0.0023 -0.0113 +X -0.0100 0.0057 0.0085 +X -0.0110 -0.0055 0.0060 +X -0.0021 -0.0148 -0.0119 +X 0.0102 0.0045 0.0189 +X 0.0002 -0.0242 -0.0245 +X -0.0093 0.0071 0.0005 +X -0.0033 -0.0165 0.0000 +X 0.0206 -0.0134 0.0031 +X 0.0139 0.0033 0.0264 +X 0.0059 0.0111 0.0012 +X 0.0219 -0.0073 -0.0095 +X -0.0087 -0.0118 0.0017 +X -0.0161 -0.0114 0.0090 +X -0.0086 0.0056 -0.0002 +X -0.0122 0.0041 0.0029 +X 0.0150 0.0283 0.0094 +X -0.0029 0.0114 0.0016 +X -0.0012 0.0051 -0.0010 +X 0.0177 0.0070 -0.0066 +X -0.0067 -0.0082 0.0080 +X 0.0210 -0.0217 -0.0057 +X -0.0017 0.0075 0.0004 +X 0.0195 -0.0162 0.0030 +X -0.0057 0.0106 0.0047 +X 0.0031 0.0101 0.0042 +X 0.0162 -0.0082 -0.0045 +X -0.0118 0.0140 0.0022 +X -0.0029 -0.0053 -0.0121 +X -0.0107 0.0038 0.0024 +X -0.0017 0.0115 -0.0082 +X 0.0005 0.0063 0.0007 +X -0.0001 0.0021 -0.0243 +X -0.0029 -0.0061 -0.0050 +X -0.0182 -0.0056 0.0079 +X 0.0046 0.0017 0.0094 +X 0.0022 -0.0015 -0.0024 +X -0.0022 0.0081 0.0018 +X 0.0086 -0.0146 0.0046 +X -0.0084 0.0036 0.0066 +X 0.0051 0.0059 -0.0090 +X -0.0009 -0.0081 0.0018 +X -0.0177 -0.0071 0.0036 +X -0.0099 0.0144 0.0097 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/forces.2.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/forces.2.reference new file mode 100644 index 0000000000..6f8669c3db --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/forces.2.reference @@ -0,0 +1,66 @@ +64 + -5.5073 -5.3369 -5.5219 +X 0.0020 0.0025 -0.0010 +X 0.0133 -0.0034 -0.0188 +X -0.0060 -0.0059 -0.0092 +X 0.0122 0.0190 0.0087 +X 0.0087 0.0074 0.0019 +X -0.0045 -0.0247 -0.0004 +X -0.0019 0.0032 -0.0087 +X -0.0038 0.0017 -0.0127 +X 0.0088 -0.0181 -0.0154 +X -0.0063 -0.0054 0.0141 +X -0.0060 0.0084 0.0011 +X 0.0050 0.0020 0.0106 +X -0.0017 0.0005 -0.0079 +X -0.0076 0.0250 0.0048 +X 0.0006 -0.0082 -0.0013 +X 0.0020 -0.0042 -0.0041 +X -0.0023 0.0081 0.0115 +X 0.0072 -0.0147 0.0076 +X -0.0198 0.0194 0.0059 +X -0.0080 0.0050 -0.0106 +X 0.0087 -0.0023 -0.0113 +X -0.0100 0.0057 0.0085 +X -0.0110 -0.0055 0.0060 +X -0.0021 -0.0148 -0.0119 +X 0.0102 0.0045 0.0189 +X 0.0002 -0.0242 -0.0245 +X -0.0093 0.0071 0.0005 +X -0.0033 -0.0165 0.0000 +X 0.0206 -0.0134 0.0031 +X 0.0139 0.0033 0.0264 +X 0.0059 0.0111 0.0012 +X 0.0219 -0.0073 -0.0095 +X -0.0087 -0.0118 0.0017 +X -0.0161 -0.0114 0.0090 +X -0.0086 0.0056 -0.0002 +X -0.0122 0.0041 0.0029 +X 0.0150 0.0283 0.0094 +X -0.0029 0.0114 0.0016 +X -0.0012 0.0051 -0.0010 +X 0.0177 0.0070 -0.0066 +X -0.0067 -0.0082 0.0080 +X 0.0210 -0.0217 -0.0057 +X -0.0017 0.0075 0.0004 +X 0.0195 -0.0162 0.0030 +X -0.0057 0.0106 0.0047 +X 0.0031 0.0101 0.0042 +X 0.0162 -0.0082 -0.0045 +X -0.0118 0.0140 0.0022 +X -0.0029 -0.0053 -0.0121 +X -0.0107 0.0038 0.0024 +X -0.0017 0.0115 -0.0082 +X 0.0005 0.0063 0.0007 +X -0.0001 0.0021 -0.0243 +X -0.0029 -0.0061 -0.0050 +X -0.0182 -0.0056 0.0079 +X 0.0046 0.0017 0.0094 +X 0.0022 -0.0015 -0.0024 +X -0.0022 0.0081 0.0018 +X 0.0086 -0.0146 0.0046 +X -0.0084 0.0036 0.0066 +X 0.0051 0.0059 -0.0090 +X -0.0009 -0.0081 0.0018 +X -0.0177 -0.0071 0.0036 +X -0.0099 0.0144 0.0097 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/plumed.dat b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/plumed.dat new file mode 100644 index 0000000000..952c18e9b2 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-mpi-shortcuts/plumed.dat @@ -0,0 +1,11 @@ +LOAD FILE=../../../../plumedOpenACC.so +# The shortcuts pass USEGPU, SERIAL and MULTIGPU to the actions they create that run on the GPU. +# With 3 MPI processes the GPU actions of q6 and w6 split their tasks between the processes +# (MULTIGPU), those of cn are computed by the first process only (SERIAL), as those of d (the +# default). The references are the results of the CPU versions +q6: Q6 SPECIES=1-64 D_0=3.0 R_0=1.5 NN=12 MM=24 MEAN USEGPU MULTIGPU +w6: LOCAL_AVERAGE SPECIES=q6 SWITCH={RATIONAL D_0=3.0 R_0=1.5} MEAN USEGPU MULTIGPU +cn: COORDINATIONNUMBER SPECIES=1-64 SWITCH={RATIONAL D_0=3.0 R_0=1.5} MEAN USEGPU SERIAL +d: DISTANCES GROUPA=1-4 GROUPB=5-64 MEAN USEGPU +r: RESTRAINT ARG=q6.mean,w6_mean,cn.mean,d.mean AT=0.3,0.3,10,5 KAPPA=10,10,0.1,0.1 +PRINT ARG=q6.mean,w6_mean,cn.mean,d.mean FILE=colvar FMT=%8.4f diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/Makefile b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/Makefile new file mode 100644 index 0000000000..3703b27cea --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/Makefile @@ -0,0 +1 @@ +include ../../scripts/test.make diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/colvar.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/colvar.reference new file mode 100644 index 0000000000..c5b2654ce3 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/colvar.reference @@ -0,0 +1,4 @@ +#! FIELDS time cn_mean q4_mean q4_vmean q6_mean lq_mean + 0.000000 0.128208 0.614572 0.134218 0.640419 0.475213 + 1.000000 0.166275 0.620225 0.119856 0.616973 0.550963 + 2.000000 0.197236 0.563546 0.094818 0.597336 0.376846 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/config b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/config new file mode 100644 index 0000000000..19eb7b925d --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/config @@ -0,0 +1,5 @@ +type=driver +mpiprocs=3 +arg="--plumed plumed.dat --ixyz triclinic.xyz --box 3.0,0.0,0.0,0.0,3.0,0.0,1.5,1.5,2.1213203 --dump-forces forces --dump-forces-fmt=%10.6f --dump-full-virial" +extra_files="../rt-GPU-DISTANCES-triclinic/triclinic.xyz" +plumed_tolerance=(forces.0:1e-5 forces.1:1e-5 forces.2:1e-5 colvar:1e-5) diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/forces.0.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/forces.0.reference new file mode 100644 index 0000000000..3d22b2e618 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/forces.0.reference @@ -0,0 +1,126 @@ +40 + 0.055820 1.196416 0.050170 1.196416 3.015923 0.651665 0.050170 0.651665 0.503947 +X 1.769906 -0.916118 1.634741 +X -0.832988 -0.098937 0.462397 +X -1.683380 -0.278360 0.534144 +X 1.466395 -0.479006 -0.802622 +X -0.266411 0.235584 -1.707651 +X -0.017970 -0.728665 0.052328 +X -0.277038 0.615962 -1.001053 +X -0.563622 -0.131397 -1.887226 +X -1.493114 1.969347 0.759393 +X -0.269969 -0.051375 0.026352 +X -1.557567 -0.376039 1.178935 +X 0.272948 -0.481600 0.292407 +X 0.254272 -0.420247 -0.983914 +X -0.514336 1.145522 -0.195931 +X 1.374363 -0.482628 -2.239155 +X 1.220413 -0.337312 -0.236644 +X -0.081651 0.133813 -0.217442 +X 0.472985 0.791533 -0.344956 +X 0.927988 -0.434433 -0.603049 +X 0.188561 -1.861615 1.213693 +X 0.060513 -0.880318 0.309603 +X 0.772547 0.348685 -0.867172 +X -1.012689 -0.580390 -0.124232 +X -0.164362 0.300192 -0.835576 +X 0.328370 -0.820814 0.980559 +X -0.439580 1.782801 -0.448507 +X -0.855034 0.023302 -0.554434 +X 0.126859 -0.156431 0.849416 +X 1.569927 -0.220584 1.839566 +X -1.306340 -0.085475 0.144219 +X -0.439171 1.010384 -0.532637 +X -0.714778 0.355395 -0.128190 +X 0.237766 -0.795054 1.468308 +X -0.555072 -0.998833 1.982825 +X 0.479809 -0.563321 0.493279 +X 1.269161 -0.523517 1.007416 +X 0.843274 3.472057 -1.386874 +X -0.344012 0.230056 0.726114 +X 0.058343 0.029380 -0.414854 +X -0.305313 0.258451 -0.443578 +40 + 2.270046 0.532984 0.193745 0.532984 0.251105 -0.548627 0.193745 -0.548627 1.665799 +X 1.418068 0.255775 0.073640 +X -1.441291 0.100519 1.473516 +X -0.356201 -0.255541 -0.533676 +X 0.520569 1.888819 -1.828198 +X 0.907542 0.175365 -3.552881 +X -0.354754 3.000098 -0.429147 +X 1.090630 -1.229891 -1.020290 +X 0.669109 0.690800 0.822364 +X -1.344847 -0.005498 -0.257318 +X 0.866506 0.650375 -0.366487 +X -0.203914 0.132425 0.394315 +X 2.178331 -2.527789 -0.121502 +X -0.380888 -0.798658 -1.425370 +X 0.284111 -0.736579 -0.371113 +X 1.793518 1.111933 0.639462 +X 0.050026 0.047729 -0.036195 +X -0.542724 -0.051601 -0.338192 +X 0.226306 0.272811 0.407231 +X 0.352609 -1.304339 0.940337 +X 0.413073 -0.299604 -0.042193 +X -0.514129 -0.695322 -0.330069 +X -1.100665 -0.287024 0.859903 +X -2.674644 -0.217599 0.403289 +X -0.247601 1.026072 1.384116 +X -0.105810 1.035484 0.585084 +X 0.895801 0.719191 -0.184764 +X -2.299339 0.107040 -0.094161 +X -0.307004 0.107714 1.089207 +X -0.370942 -0.051156 0.210373 +X 0.191404 0.237777 0.451168 +X -0.025029 0.080220 -1.171464 +X -1.172706 -2.315143 -1.522894 +X 1.832126 -0.738902 -0.934259 +X -0.653098 -0.119287 0.120772 +X 0.126377 0.082829 0.397073 +X 1.105139 1.290488 1.638823 +X -0.899016 -1.022614 2.038225 +X 0.507373 0.064101 0.596292 +X 0.643018 1.721334 -0.900550 +X -1.077032 -2.142352 0.935531 +40 + 1.760526 -0.404222 0.766114 -0.404222 1.936669 0.397905 0.766114 0.397905 0.448543 +X 0.048463 0.924451 -1.742922 +X 0.247046 -0.538692 -1.207906 +X -0.765175 -0.071286 -1.038141 +X 2.677761 0.396178 -1.300921 +X 0.575899 0.371609 0.381205 +X 1.062670 -2.041289 -1.324422 +X -0.993260 -1.081566 0.303965 +X -0.050264 0.725204 0.662436 +X -1.968239 -1.205352 -0.194665 +X 0.695487 1.242938 0.293990 +X 0.621843 -0.271126 0.511168 +X -1.788524 -1.179881 1.495395 +X 2.640066 0.525810 0.569967 +X 1.215393 0.022694 0.455789 +X 0.500461 0.154079 0.096995 +X 0.069081 -1.129634 2.087153 +X -0.041083 -0.030890 0.508433 +X -0.533791 -1.176948 1.226860 +X 0.101864 0.109105 1.289375 +X -0.840724 -0.038998 0.628065 +X -0.041362 0.312423 0.452194 +X -1.057459 -0.612333 -0.553143 +X 2.147675 0.951021 -1.123873 +X 0.283653 0.523063 -2.530959 +X -0.609777 -0.383063 -0.603365 +X -0.427542 0.366273 -0.006962 +X -0.102338 -0.544173 -0.798814 +X -0.084463 -0.349474 0.947192 +X 0.113456 -0.213251 -0.218911 +X -1.763888 0.828862 -0.370803 +X 0.308263 0.280695 0.079679 +X 0.450628 0.360933 -0.122699 +X -0.090822 -0.081782 0.712854 +X -1.416197 -1.884253 0.050816 +X -1.401510 1.682154 1.018051 +X -0.149459 0.624674 0.288857 +X -0.231496 0.577760 -2.009487 +X 0.540738 1.494003 1.066469 +X 1.108558 0.472545 -0.643682 +X -1.051632 -0.112480 0.664771 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/forces.1.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/forces.1.reference new file mode 100644 index 0000000000..3d22b2e618 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/forces.1.reference @@ -0,0 +1,126 @@ +40 + 0.055820 1.196416 0.050170 1.196416 3.015923 0.651665 0.050170 0.651665 0.503947 +X 1.769906 -0.916118 1.634741 +X -0.832988 -0.098937 0.462397 +X -1.683380 -0.278360 0.534144 +X 1.466395 -0.479006 -0.802622 +X -0.266411 0.235584 -1.707651 +X -0.017970 -0.728665 0.052328 +X -0.277038 0.615962 -1.001053 +X -0.563622 -0.131397 -1.887226 +X -1.493114 1.969347 0.759393 +X -0.269969 -0.051375 0.026352 +X -1.557567 -0.376039 1.178935 +X 0.272948 -0.481600 0.292407 +X 0.254272 -0.420247 -0.983914 +X -0.514336 1.145522 -0.195931 +X 1.374363 -0.482628 -2.239155 +X 1.220413 -0.337312 -0.236644 +X -0.081651 0.133813 -0.217442 +X 0.472985 0.791533 -0.344956 +X 0.927988 -0.434433 -0.603049 +X 0.188561 -1.861615 1.213693 +X 0.060513 -0.880318 0.309603 +X 0.772547 0.348685 -0.867172 +X -1.012689 -0.580390 -0.124232 +X -0.164362 0.300192 -0.835576 +X 0.328370 -0.820814 0.980559 +X -0.439580 1.782801 -0.448507 +X -0.855034 0.023302 -0.554434 +X 0.126859 -0.156431 0.849416 +X 1.569927 -0.220584 1.839566 +X -1.306340 -0.085475 0.144219 +X -0.439171 1.010384 -0.532637 +X -0.714778 0.355395 -0.128190 +X 0.237766 -0.795054 1.468308 +X -0.555072 -0.998833 1.982825 +X 0.479809 -0.563321 0.493279 +X 1.269161 -0.523517 1.007416 +X 0.843274 3.472057 -1.386874 +X -0.344012 0.230056 0.726114 +X 0.058343 0.029380 -0.414854 +X -0.305313 0.258451 -0.443578 +40 + 2.270046 0.532984 0.193745 0.532984 0.251105 -0.548627 0.193745 -0.548627 1.665799 +X 1.418068 0.255775 0.073640 +X -1.441291 0.100519 1.473516 +X -0.356201 -0.255541 -0.533676 +X 0.520569 1.888819 -1.828198 +X 0.907542 0.175365 -3.552881 +X -0.354754 3.000098 -0.429147 +X 1.090630 -1.229891 -1.020290 +X 0.669109 0.690800 0.822364 +X -1.344847 -0.005498 -0.257318 +X 0.866506 0.650375 -0.366487 +X -0.203914 0.132425 0.394315 +X 2.178331 -2.527789 -0.121502 +X -0.380888 -0.798658 -1.425370 +X 0.284111 -0.736579 -0.371113 +X 1.793518 1.111933 0.639462 +X 0.050026 0.047729 -0.036195 +X -0.542724 -0.051601 -0.338192 +X 0.226306 0.272811 0.407231 +X 0.352609 -1.304339 0.940337 +X 0.413073 -0.299604 -0.042193 +X -0.514129 -0.695322 -0.330069 +X -1.100665 -0.287024 0.859903 +X -2.674644 -0.217599 0.403289 +X -0.247601 1.026072 1.384116 +X -0.105810 1.035484 0.585084 +X 0.895801 0.719191 -0.184764 +X -2.299339 0.107040 -0.094161 +X -0.307004 0.107714 1.089207 +X -0.370942 -0.051156 0.210373 +X 0.191404 0.237777 0.451168 +X -0.025029 0.080220 -1.171464 +X -1.172706 -2.315143 -1.522894 +X 1.832126 -0.738902 -0.934259 +X -0.653098 -0.119287 0.120772 +X 0.126377 0.082829 0.397073 +X 1.105139 1.290488 1.638823 +X -0.899016 -1.022614 2.038225 +X 0.507373 0.064101 0.596292 +X 0.643018 1.721334 -0.900550 +X -1.077032 -2.142352 0.935531 +40 + 1.760526 -0.404222 0.766114 -0.404222 1.936669 0.397905 0.766114 0.397905 0.448543 +X 0.048463 0.924451 -1.742922 +X 0.247046 -0.538692 -1.207906 +X -0.765175 -0.071286 -1.038141 +X 2.677761 0.396178 -1.300921 +X 0.575899 0.371609 0.381205 +X 1.062670 -2.041289 -1.324422 +X -0.993260 -1.081566 0.303965 +X -0.050264 0.725204 0.662436 +X -1.968239 -1.205352 -0.194665 +X 0.695487 1.242938 0.293990 +X 0.621843 -0.271126 0.511168 +X -1.788524 -1.179881 1.495395 +X 2.640066 0.525810 0.569967 +X 1.215393 0.022694 0.455789 +X 0.500461 0.154079 0.096995 +X 0.069081 -1.129634 2.087153 +X -0.041083 -0.030890 0.508433 +X -0.533791 -1.176948 1.226860 +X 0.101864 0.109105 1.289375 +X -0.840724 -0.038998 0.628065 +X -0.041362 0.312423 0.452194 +X -1.057459 -0.612333 -0.553143 +X 2.147675 0.951021 -1.123873 +X 0.283653 0.523063 -2.530959 +X -0.609777 -0.383063 -0.603365 +X -0.427542 0.366273 -0.006962 +X -0.102338 -0.544173 -0.798814 +X -0.084463 -0.349474 0.947192 +X 0.113456 -0.213251 -0.218911 +X -1.763888 0.828862 -0.370803 +X 0.308263 0.280695 0.079679 +X 0.450628 0.360933 -0.122699 +X -0.090822 -0.081782 0.712854 +X -1.416197 -1.884253 0.050816 +X -1.401510 1.682154 1.018051 +X -0.149459 0.624674 0.288857 +X -0.231496 0.577760 -2.009487 +X 0.540738 1.494003 1.066469 +X 1.108558 0.472545 -0.643682 +X -1.051632 -0.112480 0.664771 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/forces.2.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/forces.2.reference new file mode 100644 index 0000000000..3d22b2e618 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/forces.2.reference @@ -0,0 +1,126 @@ +40 + 0.055820 1.196416 0.050170 1.196416 3.015923 0.651665 0.050170 0.651665 0.503947 +X 1.769906 -0.916118 1.634741 +X -0.832988 -0.098937 0.462397 +X -1.683380 -0.278360 0.534144 +X 1.466395 -0.479006 -0.802622 +X -0.266411 0.235584 -1.707651 +X -0.017970 -0.728665 0.052328 +X -0.277038 0.615962 -1.001053 +X -0.563622 -0.131397 -1.887226 +X -1.493114 1.969347 0.759393 +X -0.269969 -0.051375 0.026352 +X -1.557567 -0.376039 1.178935 +X 0.272948 -0.481600 0.292407 +X 0.254272 -0.420247 -0.983914 +X -0.514336 1.145522 -0.195931 +X 1.374363 -0.482628 -2.239155 +X 1.220413 -0.337312 -0.236644 +X -0.081651 0.133813 -0.217442 +X 0.472985 0.791533 -0.344956 +X 0.927988 -0.434433 -0.603049 +X 0.188561 -1.861615 1.213693 +X 0.060513 -0.880318 0.309603 +X 0.772547 0.348685 -0.867172 +X -1.012689 -0.580390 -0.124232 +X -0.164362 0.300192 -0.835576 +X 0.328370 -0.820814 0.980559 +X -0.439580 1.782801 -0.448507 +X -0.855034 0.023302 -0.554434 +X 0.126859 -0.156431 0.849416 +X 1.569927 -0.220584 1.839566 +X -1.306340 -0.085475 0.144219 +X -0.439171 1.010384 -0.532637 +X -0.714778 0.355395 -0.128190 +X 0.237766 -0.795054 1.468308 +X -0.555072 -0.998833 1.982825 +X 0.479809 -0.563321 0.493279 +X 1.269161 -0.523517 1.007416 +X 0.843274 3.472057 -1.386874 +X -0.344012 0.230056 0.726114 +X 0.058343 0.029380 -0.414854 +X -0.305313 0.258451 -0.443578 +40 + 2.270046 0.532984 0.193745 0.532984 0.251105 -0.548627 0.193745 -0.548627 1.665799 +X 1.418068 0.255775 0.073640 +X -1.441291 0.100519 1.473516 +X -0.356201 -0.255541 -0.533676 +X 0.520569 1.888819 -1.828198 +X 0.907542 0.175365 -3.552881 +X -0.354754 3.000098 -0.429147 +X 1.090630 -1.229891 -1.020290 +X 0.669109 0.690800 0.822364 +X -1.344847 -0.005498 -0.257318 +X 0.866506 0.650375 -0.366487 +X -0.203914 0.132425 0.394315 +X 2.178331 -2.527789 -0.121502 +X -0.380888 -0.798658 -1.425370 +X 0.284111 -0.736579 -0.371113 +X 1.793518 1.111933 0.639462 +X 0.050026 0.047729 -0.036195 +X -0.542724 -0.051601 -0.338192 +X 0.226306 0.272811 0.407231 +X 0.352609 -1.304339 0.940337 +X 0.413073 -0.299604 -0.042193 +X -0.514129 -0.695322 -0.330069 +X -1.100665 -0.287024 0.859903 +X -2.674644 -0.217599 0.403289 +X -0.247601 1.026072 1.384116 +X -0.105810 1.035484 0.585084 +X 0.895801 0.719191 -0.184764 +X -2.299339 0.107040 -0.094161 +X -0.307004 0.107714 1.089207 +X -0.370942 -0.051156 0.210373 +X 0.191404 0.237777 0.451168 +X -0.025029 0.080220 -1.171464 +X -1.172706 -2.315143 -1.522894 +X 1.832126 -0.738902 -0.934259 +X -0.653098 -0.119287 0.120772 +X 0.126377 0.082829 0.397073 +X 1.105139 1.290488 1.638823 +X -0.899016 -1.022614 2.038225 +X 0.507373 0.064101 0.596292 +X 0.643018 1.721334 -0.900550 +X -1.077032 -2.142352 0.935531 +40 + 1.760526 -0.404222 0.766114 -0.404222 1.936669 0.397905 0.766114 0.397905 0.448543 +X 0.048463 0.924451 -1.742922 +X 0.247046 -0.538692 -1.207906 +X -0.765175 -0.071286 -1.038141 +X 2.677761 0.396178 -1.300921 +X 0.575899 0.371609 0.381205 +X 1.062670 -2.041289 -1.324422 +X -0.993260 -1.081566 0.303965 +X -0.050264 0.725204 0.662436 +X -1.968239 -1.205352 -0.194665 +X 0.695487 1.242938 0.293990 +X 0.621843 -0.271126 0.511168 +X -1.788524 -1.179881 1.495395 +X 2.640066 0.525810 0.569967 +X 1.215393 0.022694 0.455789 +X 0.500461 0.154079 0.096995 +X 0.069081 -1.129634 2.087153 +X -0.041083 -0.030890 0.508433 +X -0.533791 -1.176948 1.226860 +X 0.101864 0.109105 1.289375 +X -0.840724 -0.038998 0.628065 +X -0.041362 0.312423 0.452194 +X -1.057459 -0.612333 -0.553143 +X 2.147675 0.951021 -1.123873 +X 0.283653 0.523063 -2.530959 +X -0.609777 -0.383063 -0.603365 +X -0.427542 0.366273 -0.006962 +X -0.102338 -0.544173 -0.798814 +X -0.084463 -0.349474 0.947192 +X 0.113456 -0.213251 -0.218911 +X -1.763888 0.828862 -0.370803 +X 0.308263 0.280695 0.079679 +X 0.450628 0.360933 -0.122699 +X -0.090822 -0.081782 0.712854 +X -1.416197 -1.884253 0.050816 +X -1.401510 1.682154 1.018051 +X -0.149459 0.624674 0.288857 +X -0.231496 0.577760 -2.009487 +X 0.540738 1.494003 1.066469 +X 1.108558 0.472545 -0.643682 +X -1.051632 -0.112480 0.664771 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/plumed.dat b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/plumed.dat new file mode 100644 index 0000000000..d99ca51532 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-neighbor-sums/plumed.dat @@ -0,0 +1,12 @@ +LOAD FILE=../../../../plumedOpenACC.so +# With USEGPU, COORDINATIONNUMBER and Q1-Q6 compute the sums over the neighbours on the GPU without +# the contact matrix (actions *_SUMSACC). The box is a rhombic dodecahedron: with D_MAX=0.9 there are +# two cells in a direction and three in the others; without D_MAX all the pairs are computed. +# 3 MPI processes: cn and q4 share the atoms (MULTIGPU), q6 and lq are computed by the first one. +# The references are the results of the CPU versions. +cn: COORDINATIONNUMBER SPECIESA=1-15 SPECIESB=10-40 SWITCH={RATIONAL R_0=0.3 D_MAX=0.9} MEAN USEGPU MULTIGPU +q4: Q4 SPECIES=1-40 SWITCH={RATIONAL R_0=0.3 D_MAX=0.9} MEAN VMEAN USEGPU MULTIGPU +q6: Q6 SPECIES=1-40 SWITCH={RATIONAL R_0=0.3} MEAN USEGPU +lq: LOCAL_Q4 SPECIES=q4 SWITCH={RATIONAL R_0=0.3 D_MAX=0.9} MEAN USEGPU +r: RESTRAINT ARG=cn.mean,q4.mean,q4_vmean,q6.mean,lq.mean AT=0,0,0,0,0 KAPPA=1,10,10,10,10 +PRINT ARG=cn.mean,q4.mean,q4_vmean,q6.mean,lq.mean FILE=colvar FMT=%10.6f diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure-DRMSD/colvar10.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure-DRMSD/colvar10.reference index fbd0fc0fc4..d6cca819e8 100644 --- a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure-DRMSD/colvar10.reference +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure-DRMSD/colvar10.reference @@ -1,13 +1,13 @@ #! FIELDS time a11 a23 a24_lessthan - 0.000000 0.0776 0.1689 0.1689 - 0.050000 0.2634 0.1526 0.1526 - 0.100000 0.1157 0.8820 0.8820 - 0.150000 3.2981 0.1347 0.1347 - 0.200000 3.0817 0.1605 0.1605 - 0.250000 0.1527 0.1144 0.1144 - 0.300000 0.2142 0.1041 0.1041 - 0.350000 3.1619 0.1436 0.1436 - 0.400000 0.6667 0.2657 0.2657 - 0.450000 2.2564 0.0041 0.0041 - 0.500000 6.9472 0.0247 0.0247 - 0.550000 0.2019 0.2079 0.2079 + 0.000000 0.0775 0.1665 0.1666 + 0.050000 0.2634 0.1507 0.1508 + 0.100000 0.1156 0.8786 0.8787 + 0.150000 3.2980 0.1158 0.1158 + 0.200000 3.0817 0.1398 0.1399 + 0.250000 0.1526 0.1120 0.1121 + 0.300000 0.2141 0.0863 0.0863 + 0.350000 3.1619 0.1350 0.1351 + 0.400000 0.6666 0.2456 0.2457 + 0.450000 2.2564 0.0000 0.0000 + 0.500000 6.9472 0.0078 0.0078 + 0.550000 0.2018 0.2035 0.2036 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure-DRMSD/forces.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure-DRMSD/forces.reference index 28aaca72ec..c9cae41818 100644 --- a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure-DRMSD/forces.reference +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure-DRMSD/forces.reference @@ -1,5 +1,5 @@ 132 - 5.648564 1.138834 0.482892 + 5.568245 1.137912 0.399574 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -16,36 +16,36 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.030164 0.118781 0.103631 X 0.046976 0.108477 0.079394 -X -1.834632 1.193136 1.104285 +X -1.824685 1.195966 1.113451 X 0.000000 0.000000 0.000000 -X 0.106914 0.204022 0.348949 +X 0.117951 0.205239 0.358571 X 0.000000 0.000000 0.000000 -X 1.254421 -0.224282 3.468102 +X 1.266543 -0.224111 3.480157 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.292183 0.082024 -0.363128 -X 0.780570 -0.119517 0.017904 -X 0.666793 -0.083173 -1.095539 +X 0.302458 0.082436 -0.354106 +X 0.792783 -0.120015 0.026837 +X 0.674437 -0.082764 -1.087374 X 0.000000 0.000000 0.000000 -X 1.218062 -0.543111 -2.434855 +X 1.223971 -0.543362 -2.427963 X 0.000000 0.000000 0.000000 -X 0.750994 -0.200118 -2.051710 +X 0.755275 -0.200949 -2.045345 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 2.867675 -0.998821 -1.811335 -X 4.291588 -1.227171 -1.336842 -X 1.860560 -1.434762 -1.772669 +X 2.872179 -0.998465 -1.805979 +X 4.296089 -1.226434 -1.331915 +X 1.863606 -1.434905 -1.768566 X 0.000000 0.000000 0.000000 -X 3.223469 -2.064354 -0.950870 +X 3.224993 -2.064906 -0.948470 X 0.000000 0.000000 0.000000 -X 3.966864 -3.534198 0.172995 +X 3.969585 -3.534194 0.175949 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 3.490920 -2.295626 -0.789059 -X 3.899880 -2.562037 -0.778528 +X 3.490215 -2.298038 -0.788610 +X 3.898970 -2.564923 -0.777983 X -0.533323 0.542057 -0.160829 X 0.000000 0.000000 0.000000 X -0.609447 0.169010 -0.206563 @@ -55,7 +55,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X -0.774150 0.733423 -0.290932 -X -1.052827 1.712184 -0.287921 +X -1.052827 1.712183 -0.287921 X -0.187773 0.261773 -0.063669 X 0.000000 0.000000 0.000000 X -0.207356 0.251340 -0.100300 @@ -64,38 +64,38 @@ X -0.211285 0.404772 -0.195160 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.178846 0.174955 -0.095634 -X -0.372721 0.274087 -0.194265 -X 0.085427 -0.045292 0.104368 +X -0.178846 0.174954 -0.095634 +X -0.372720 0.274087 -0.194265 +X 0.078436 -0.044446 0.097044 X 0.000000 0.000000 0.000000 -X 0.105921 -0.028428 0.119538 +X 0.097601 -0.027548 0.110296 X 0.000000 0.000000 0.000000 -X 0.103121 -0.031398 0.159754 +X 0.094559 -0.029842 0.147897 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.085684 -0.001552 0.101986 -X 0.057429 -0.021203 0.072197 -X -0.059055 -0.030605 -0.083536 +X 0.077249 -0.001873 0.092491 +X 0.049294 -0.022046 0.061578 +X -0.067781 -0.031307 -0.091867 X 0.000000 0.000000 0.000000 -X -0.079976 -0.033047 -0.093263 +X -0.088246 -0.034535 -0.100511 X 0.000000 0.000000 0.000000 -X -0.095339 -0.039636 -0.106859 +X -0.102191 -0.041561 -0.113946 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.102235 -0.055705 -0.103594 -X -0.168979 -0.124344 -0.127016 -X -0.336386 -0.202020 -0.277969 +X -0.107761 -0.055897 -0.108385 +X -0.172481 -0.123635 -0.130518 +X -0.341599 -0.202784 -0.282080 X 0.000000 0.000000 0.000000 -X 0.043627 0.317895 0.044112 +X 0.041535 0.318824 0.042363 X 0.000000 0.000000 0.000000 -X 0.048195 0.451301 -0.014855 +X 0.045890 0.451635 -0.016253 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.273068 -0.257025 -0.255919 -X -0.684275 -1.513617 -0.867676 +X -0.274759 -0.255053 -0.257086 +X -0.687767 -1.513166 -0.870711 X 0.689667 0.987217 0.306959 X 0.000000 0.000000 0.000000 X 0.137963 0.259618 0.055793 @@ -133,7 +133,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -1.360715 -20.566183 -4.097877 + -1.360712 -20.566182 -4.097877 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -142,24 +142,24 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.731357 -0.130566 -0.050210 X 0.000000 0.000000 0.000000 -X -0.284621 -0.090758 -0.392268 +X -0.284621 -0.090757 -0.392268 X 0.000000 0.000000 0.000000 -X -0.881635 0.260868 -0.542492 +X -0.881636 0.260868 -0.542492 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.744463 0.060052 0.067277 -X 2.529719 0.535087 0.890442 -X -2.221189 -0.614889 -0.091739 +X 2.529718 0.535087 0.890442 +X -2.221190 -0.614889 -0.091739 X 0.000000 0.000000 0.000000 X -0.557158 -0.356705 0.273566 X 0.000000 0.000000 0.000000 -X -0.117516 0.221216 0.519055 +X -0.117517 0.221216 0.519055 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X -0.764866 -0.721475 -0.496442 -X -1.015578 -1.589232 -1.448891 +X -1.015578 -1.589232 -1.448890 X -0.728136 0.394184 0.052409 X 0.000000 0.000000 0.000000 X -0.564518 -0.369373 -1.096149 @@ -170,21 +170,21 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.722361 1.541808 -0.410295 X 1.414552 2.493896 0.017605 -X 0.955682 3.408644 -0.321598 +X 0.955682 3.408644 -0.321599 X 0.000000 0.000000 0.000000 -X 0.773865 4.971265 -0.178852 +X 0.773865 4.971264 -0.178852 X 0.000000 0.000000 0.000000 X 1.336653 6.808871 -1.175276 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X -0.042084 4.641938 -0.265945 -X -1.365392 6.131125 -1.373908 +X -1.365391 6.131125 -1.373908 X -0.183660 0.641684 0.243435 X 0.000000 0.000000 0.000000 -X -0.139456 0.239403 0.150061 +X -0.139456 0.239402 0.150061 X 0.000000 0.000000 0.000000 -X -0.437847 0.822565 0.373163 +X -0.437847 0.822564 0.373163 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -198,7 +198,7 @@ X 0.448798 -0.278382 0.015799 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.332491 -0.195148 0.024847 +X 0.332492 -0.195148 0.024847 X 0.425200 -0.160260 0.018821 X 0.588665 0.642626 0.207550 X 0.000000 0.000000 0.000000 @@ -267,73 +267,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - 15.700045 3.330948 4.660395 + 15.700059 3.330953 4.660396 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 3.576953 1.849004 -1.167364 +X 3.576956 1.849005 -1.167364 X 0.000000 0.000000 0.000000 -X 0.229314 2.112133 0.207667 +X 0.229317 2.112134 0.207667 X 0.000000 0.000000 0.000000 -X -1.553862 -1.552610 1.000911 +X -1.553859 -1.552608 1.000911 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 1.133143 1.028918 -1.178886 -X 3.686958 -0.473257 -2.069997 -X -0.799007 -0.220532 -1.047235 +X 1.133145 1.028919 -1.178886 +X 3.686961 -0.473256 -2.069996 +X -0.799006 -0.220532 -1.047235 X 0.000000 0.000000 0.000000 -X -0.340588 -0.904794 -1.073178 +X -0.340587 -0.904794 -1.073178 X 0.000000 0.000000 0.000000 X -0.057114 -1.924890 -1.844765 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -3.103724 -0.004435 -1.655981 -X -5.071660 0.925126 -1.350846 +X -3.103723 -0.004434 -1.655981 +X -5.071659 0.925128 -1.350844 X -2.836043 -0.138736 -0.836673 X 0.000000 0.000000 0.000000 X -4.969201 0.011145 -0.032809 X 0.000000 0.000000 0.000000 -X -6.222512 -2.114414 0.796032 +X -6.222512 -2.114414 0.796031 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -4.055186 0.508397 0.147779 -X -1.843516 1.816190 0.316124 -X -0.324019 0.335053 0.213177 +X -4.055186 0.508396 0.147779 +X -1.843516 1.816189 0.316124 +X -0.324020 0.335053 0.213178 X 0.000000 0.000000 0.000000 -X -0.387130 0.460303 0.268047 +X -0.387132 0.460302 0.268047 X 0.000000 0.000000 0.000000 -X -0.489806 0.456051 0.299262 +X -0.489808 0.456050 0.299262 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.387937 0.476836 0.259554 -X -0.894384 0.573705 0.058778 -X -0.211504 -0.092802 -0.022669 +X -0.387939 0.476835 0.259554 +X -0.894386 0.573705 0.058778 +X -0.211506 -0.092804 -0.022670 X 0.000000 0.000000 0.000000 -X -0.222973 -0.096959 -0.061299 +X -0.222975 -0.096961 -0.061299 X 0.000000 0.000000 0.000000 -X -0.334398 -0.180452 -0.077126 +X -0.334401 -0.180454 -0.077127 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.141499 -0.101938 -0.083478 -X -0.126592 -0.085836 -0.098695 -X -0.146673 0.124439 -0.165368 +X -0.141500 -0.101939 -0.083479 +X -0.126593 -0.085837 -0.098696 +X -0.146673 0.124438 -0.165369 X 0.000000 0.000000 0.000000 -X 0.167172 0.142131 -0.006410 +X 0.167173 0.142131 -0.006410 X 0.000000 0.000000 0.000000 -X 0.187591 0.709673 0.250438 +X 0.187591 0.709672 0.250438 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.324900 0.089790 -0.191599 -X 0.385068 0.432257 0.237534 +X 0.324900 0.089791 -0.191598 +X 0.385069 0.432260 0.237537 X 0.307139 -1.117502 -1.057824 X 0.000000 0.000000 0.000000 X 0.861959 -1.622158 -1.185323 @@ -401,73 +401,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -0.588022 -3.235737 -0.235789 + -0.588015 -3.235664 -0.235736 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.188177 0.614206 -0.306067 +X -0.188189 0.614239 -0.306088 X 0.000000 0.000000 0.000000 -X 0.002011 0.389901 -0.126970 +X 0.002010 0.389922 -0.126979 X 0.000000 0.000000 0.000000 -X 0.199312 0.052519 0.165762 +X 0.199322 0.052522 0.165769 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.128268 0.413331 -0.280224 -X -0.464433 0.568069 -0.769509 -X -0.120100 -0.048428 -0.176560 +X -0.128278 0.413352 -0.280244 +X -0.464463 0.568096 -0.769559 +X -0.120095 -0.048422 -0.176556 X 0.000000 0.000000 0.000000 -X -0.050209 0.042268 -0.027210 +X -0.050208 0.042268 -0.027212 X 0.000000 0.000000 0.000000 -X -0.178776 0.077398 -0.194173 +X -0.178769 0.077396 -0.194163 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.029233 0.040040 0.013733 -X -0.081140 0.046823 -0.066952 -X 0.031383 0.155309 0.164763 +X -0.029230 0.040038 0.013733 +X -0.081139 0.046824 -0.066952 +X 0.031387 0.155300 0.164763 X 0.000000 0.000000 0.000000 -X 0.013182 0.255500 0.241421 +X 0.013187 0.255488 0.241421 X 0.000000 0.000000 0.000000 -X 0.030095 0.411720 0.333720 +X 0.030099 0.411704 0.333720 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.063187 0.135869 0.243407 -X 0.056100 0.169638 0.240816 -X -0.290769 0.197663 0.098251 +X 0.063192 0.135857 0.243412 +X 0.056103 0.169633 0.240819 +X -0.290763 0.197644 0.098262 X 0.000000 0.000000 0.000000 -X -0.217547 -0.078868 0.068446 +X -0.217542 -0.078883 0.068460 X 0.000000 0.000000 0.000000 -X -0.411019 -0.590456 0.069880 +X -0.411017 -0.590474 0.069897 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.234542 -0.195044 0.062572 -X -0.255208 -0.067422 0.099849 -X -0.726530 -1.049750 -0.469702 +X -0.234538 -0.195052 0.062583 +X -0.255204 -0.067428 0.099859 +X -0.726529 -1.049756 -0.469692 X 0.000000 0.000000 0.000000 -X -0.899096 -1.440211 -0.679757 +X -0.899095 -1.440212 -0.679749 X 0.000000 0.000000 0.000000 -X -1.616379 -1.930221 -1.274492 +X -1.616381 -1.930220 -1.274485 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.144251 -1.477458 -0.700302 -X 0.400962 -2.091788 -0.430564 -X 0.050471 -1.474152 -0.950781 +X -0.144250 -1.477456 -0.700300 +X 0.400961 -2.091784 -0.430564 +X 0.050471 -1.474148 -0.950781 X 0.000000 0.000000 0.000000 -X 0.419817 -0.868904 -0.447463 +X 0.419814 -0.868900 -0.447467 X 0.000000 0.000000 0.000000 -X 0.521063 -0.941698 -0.208594 +X 0.521054 -0.941693 -0.208600 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.106204 0.324089 0.604488 -X -0.743651 0.707983 0.700723 +X -0.106205 0.324091 0.604487 +X -0.743654 0.707985 0.700720 X -0.218264 0.949316 0.871935 X 0.000000 0.000000 0.000000 X -0.271668 1.797018 0.616977 @@ -669,7 +669,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -9.410373 -1.214350 -1.355330 + -9.410372 -1.214350 -1.355330 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -678,7 +678,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.062494 0.086945 0.084148 X 0.000000 0.000000 0.000000 -X 0.238219 0.183270 0.174569 +X 0.238218 0.183270 0.174569 X 0.000000 0.000000 0.000000 X 0.330853 0.197704 0.132672 X 0.000000 0.000000 0.000000 @@ -720,7 +720,7 @@ X -0.613515 0.144724 0.445066 X 0.000000 0.000000 0.000000 X -0.302932 -0.107425 -0.106196 X 0.000000 0.000000 0.000000 -X -0.731263 -0.247284 0.431549 +X -0.731263 -0.247283 0.431549 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -735,7 +735,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.132969 -0.001190 0.048875 -X 0.140995 -0.009742 0.047117 +X 0.140995 -0.009741 0.047117 X 0.211056 -0.047581 0.024463 X 0.000000 0.000000 0.000000 X 0.205791 -0.097664 0.034866 @@ -803,73 +803,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - 0.698631 3.432477 -0.295707 + 0.698626 3.432494 -0.295707 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.045259 -0.156367 0.874010 +X -0.045256 -0.156372 0.874008 X 0.000000 0.000000 0.000000 -X 0.136012 0.146194 0.365783 +X 0.136015 0.146192 0.365782 X 0.000000 0.000000 0.000000 -X 0.620367 0.149397 -0.182887 +X 0.620372 0.149392 -0.182891 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.357424 0.436000 0.446070 -X 1.067486 0.941502 0.764945 -X 0.014556 -0.335763 -0.147447 +X 0.357425 0.436000 0.446071 +X 1.067487 0.941504 0.764945 +X 0.014557 -0.335761 -0.147446 X 0.000000 0.000000 0.000000 -X 0.160330 0.041738 -0.066755 +X 0.160330 0.041742 -0.066755 X 0.000000 0.000000 0.000000 -X 0.040990 0.074309 -0.107513 +X 0.040989 0.074311 -0.107513 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.237725 0.298852 -0.301561 -X -0.700699 0.793729 -1.083510 -X 0.371972 0.089262 0.057221 +X -0.237724 0.298857 -0.301562 +X -0.700697 0.793737 -1.083513 +X 0.371972 0.089263 0.057221 X 0.000000 0.000000 0.000000 X -0.101136 0.046609 -0.167226 X 0.000000 0.000000 0.000000 -X 0.409794 0.316341 0.598380 +X 0.409794 0.316341 0.598379 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.224427 -0.395524 -0.491321 -X 0.197420 0.095822 0.023168 -X -0.297075 -0.175278 0.015546 +X -0.224428 -0.395524 -0.491321 +X 0.197420 0.095821 0.023167 +X -0.297075 -0.175278 0.015547 X 0.000000 0.000000 0.000000 -X -0.515333 -0.364732 0.008977 +X -0.515333 -0.364733 0.008977 X 0.000000 0.000000 0.000000 X -0.532496 -0.247933 0.077887 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.430549 -0.450640 0.096137 -X -0.600504 -0.427623 0.328141 -X -0.078301 -0.677037 -0.042902 +X -0.430549 -0.450641 0.096138 +X -0.600504 -0.427622 0.328143 +X -0.078300 -0.677042 -0.042903 X 0.000000 0.000000 0.000000 -X 0.006682 -0.766660 -0.004164 +X 0.006683 -0.766666 -0.004164 X 0.000000 0.000000 0.000000 -X -0.027059 -1.089854 0.159054 +X -0.027059 -1.089863 0.159055 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.036516 -0.469664 0.091244 -X 0.076236 -0.419850 0.011905 -X -0.038461 -0.448408 0.118219 +X 0.036517 -0.469667 0.091245 +X 0.076237 -0.419852 0.011905 +X -0.038461 -0.448409 0.118221 X 0.000000 0.000000 0.000000 -X -0.105674 -0.107073 0.109689 +X -0.105676 -0.107071 0.109691 X 0.000000 0.000000 0.000000 -X -0.072276 -0.151468 0.177865 +X -0.072278 -0.151467 0.177868 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.492487 0.302095 0.006363 -X -1.164611 0.392972 -0.331158 +X -0.492492 0.302100 0.006364 +X -1.164622 0.392978 -0.331159 X 0.224857 0.064771 -0.286715 X 0.000000 0.000000 0.000000 X 0.047339 0.162283 -0.201151 @@ -937,73 +937,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - 2.680281 -0.247517 -5.817009 + 2.680289 -0.247506 -5.816985 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.049386 0.290814 -0.084232 +X -0.049392 0.290824 -0.084243 X 0.000000 0.000000 0.000000 -X 0.026371 0.232172 0.025452 +X 0.026369 0.232180 0.025448 X 0.000000 0.000000 0.000000 -X 0.144458 0.074059 0.279396 +X 0.144463 0.074061 0.279404 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.038307 0.235974 -0.045931 -X -0.161211 0.223311 -0.209818 -X -2.466696 -2.530011 -0.139525 +X -0.038313 0.235981 -0.045938 +X -0.161223 0.223316 -0.209834 +X -2.466696 -2.530005 -0.139526 X 0.000000 0.000000 0.000000 -X -1.302855 -1.488619 0.484213 +X -1.302855 -1.488616 0.484212 X 0.000000 0.000000 0.000000 -X -4.398007 -1.322912 -0.528922 +X -4.398001 -1.322910 -0.528920 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.886285 -1.064320 0.392113 -X -0.501875 -0.224386 0.251387 -X -1.094126 -1.065239 0.304288 +X -0.886284 -1.064318 0.392113 +X -0.501874 -0.224386 0.251388 +X -1.094126 -1.065237 0.304287 X 0.000000 0.000000 0.000000 -X -0.323500 0.662260 0.594108 +X -0.323499 0.662259 0.594108 X 0.000000 0.000000 0.000000 -X 0.199804 0.550534 -0.345257 +X 0.199805 0.550533 -0.345255 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.431211 0.160163 0.360049 -X 0.228038 -0.130254 0.316894 -X -1.347190 0.269630 0.147036 +X -0.431209 0.160161 0.360050 +X 0.228036 -0.130253 0.316893 +X -1.347184 0.269624 0.147041 X 0.000000 0.000000 0.000000 -X -1.128062 0.069814 0.084086 +X -1.128055 0.069808 0.084092 X 0.000000 0.000000 0.000000 -X -1.106023 0.718852 0.037444 +X -1.106014 0.718842 0.037453 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.764073 0.014607 -0.052429 -X -0.635749 -0.027325 -0.050215 -X -0.792250 -0.211347 -1.021530 +X -0.764066 0.014604 -0.052423 +X -0.635744 -0.027326 -0.050210 +X -0.792244 -0.211351 -1.021520 X 0.000000 0.000000 0.000000 -X 0.323482 -0.716601 -0.894849 +X 0.323485 -0.716603 -0.894842 X 0.000000 0.000000 0.000000 -X 0.070544 -0.809336 -0.412605 +X 0.070546 -0.809338 -0.412598 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 1.218478 -0.756396 -0.960690 -X 2.011562 -1.057094 -1.828868 -X 1.100765 -0.348538 -0.367486 +X 1.218478 -0.756396 -0.960688 +X 2.011561 -1.057093 -1.828868 +X 1.100763 -0.348538 -0.367488 X 0.000000 0.000000 0.000000 -X 1.295590 0.561904 -0.095938 +X 1.295584 0.561902 -0.095944 X 0.000000 0.000000 0.000000 -X 1.807609 1.092373 -0.410704 +X 1.807599 1.092369 -0.410713 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 1.238349 0.967644 0.535006 -X 1.099611 1.137871 0.870651 +X 1.238341 0.967642 0.535001 +X 1.099602 1.137867 0.870645 X 1.209142 0.837288 1.335752 X 0.000000 0.000000 0.000000 X 0.785250 1.166484 1.545246 @@ -1071,72 +1071,72 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - 16.153121 2.031564 8.874592 + 16.153141 2.031567 8.874594 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.591469 0.408174 -0.276043 +X -0.591471 0.408176 -0.276044 X 0.000000 0.000000 0.000000 -X -0.165110 0.149799 -0.098356 +X -0.165113 0.149800 -0.098357 X 0.000000 0.000000 0.000000 -X 0.236318 0.094013 0.164633 +X 0.236315 0.094014 0.164632 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.025507 0.180409 0.044640 -X -0.097352 0.300857 0.434903 -X -3.217086 -1.000376 -2.644405 +X -0.025510 0.180411 0.044639 +X -0.097355 0.300859 0.434902 +X -3.217088 -1.000376 -2.644406 X 0.000000 0.000000 0.000000 -X -1.747994 -1.385838 -2.409404 +X -1.747996 -1.385838 -2.409405 X 0.000000 0.000000 0.000000 -X -0.707046 -1.163486 -1.070776 +X -0.707048 -1.163487 -1.070777 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.994096 -1.761152 -2.923446 -X -1.773750 -0.168496 -1.354546 -X 0.665595 -2.792952 -4.259810 +X -0.994097 -1.761152 -2.923447 +X -1.773752 -0.168496 -1.354546 +X 0.665594 -2.792952 -4.259811 X 0.000000 0.000000 0.000000 X 1.700569 -2.304787 -3.575691 X 0.000000 0.000000 0.000000 -X 1.205822 -0.962318 -3.738966 +X 1.205823 -0.962319 -3.738966 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 2.859999 -2.088433 -1.660264 -X 2.157148 -1.206042 -1.254068 -X 2.998928 -2.060575 -0.329170 +X 2.157147 -1.206042 -1.254068 +X 2.998929 -2.060575 -0.329170 X 0.000000 0.000000 0.000000 -X 2.668245 -1.061066 0.368102 +X 2.668246 -1.061067 0.368102 X 0.000000 0.000000 0.000000 -X 0.575182 0.636142 -0.365936 +X 0.575183 0.636141 -0.365935 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 2.874559 -0.209614 1.182341 -X -1.349268 2.577746 0.440951 -X -0.381976 0.705871 0.594855 +X 2.874560 -0.209615 1.182341 +X -1.349267 2.577745 0.440951 +X -0.381975 0.705870 0.594855 X 0.000000 0.000000 0.000000 -X -0.465693 0.655051 0.640175 +X -0.465691 0.655051 0.640175 X 0.000000 0.000000 0.000000 -X -1.131352 1.271131 0.664053 +X -1.131348 1.271130 0.664053 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.312024 0.132543 0.225185 -X 0.103887 0.052308 0.273707 -X -0.277706 0.063811 0.364539 +X 0.312026 0.132543 0.225185 +X 0.103888 0.052308 0.273707 +X -0.277703 0.063811 0.364540 X 0.000000 0.000000 0.000000 -X -0.040344 0.099198 0.162482 +X -0.040342 0.099198 0.162483 X 0.000000 0.000000 0.000000 -X -0.521907 0.519581 0.210775 +X -0.521905 0.519581 0.210777 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.323166 0.181507 -0.092031 +X 0.323167 0.181508 -0.092031 X 0.206807 0.149467 -0.209996 X 0.141690 0.184933 -0.075216 X 0.000000 0.000000 0.000000 @@ -1205,103 +1205,103 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -1.411051 -4.904454 -2.586607 + -1.412817 -4.947625 -2.648596 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.044776 0.002305 0.091238 +X 0.044777 0.002305 0.091240 X 0.000000 0.000000 0.000000 -X 0.011048 0.010755 0.074934 +X 0.011049 0.010755 0.074936 X 0.000000 0.000000 0.000000 -X -0.002254 -0.002796 0.089480 +X -0.002254 -0.002796 0.089482 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000529 0.009089 0.008561 -X 0.003345 0.001941 -0.029266 -X -0.004417 -0.000415 -0.014266 +X 0.003345 0.001941 -0.029267 +X -0.004759 0.002736 -0.010478 X 0.000000 0.000000 0.000000 -X -0.014006 -0.011951 -0.058481 +X -0.014266 -0.008805 -0.053125 X 0.000000 0.000000 0.000000 -X -0.015124 -0.001880 -0.064819 +X -0.015049 0.000545 -0.058114 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.032189 -0.030301 -0.079664 -X -0.064811 -0.042551 -0.120990 -X -0.010113 -0.018356 -0.020676 +X -0.031941 -0.026295 -0.073487 +X -0.063698 -0.037848 -0.113283 +X -0.010197 -0.014538 -0.015857 X 0.000000 0.000000 0.000000 -X -0.014502 -0.024414 -0.016293 +X -0.014138 -0.019971 -0.011430 X 0.000000 0.000000 0.000000 -X -0.000961 -0.003988 -0.007366 +X -0.000212 -0.000592 -0.003423 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.012028 -0.033569 -0.007859 -X -0.011924 -0.047696 -0.016324 -X -0.004199 0.053762 0.073628 +X -0.012153 -0.029327 -0.004015 +X -0.012330 -0.043244 -0.012847 +X -0.004367 0.057365 0.076996 X 0.000000 0.000000 0.000000 -X -0.009424 0.067594 0.078104 +X -0.009819 0.070577 0.080328 X 0.000000 0.000000 0.000000 -X -0.008292 0.030555 0.066438 +X -0.008262 0.033850 0.068192 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.017814 0.083943 0.079874 -X -0.048692 0.119221 0.085898 -X -0.370915 1.775220 1.341013 +X -0.018251 0.085660 0.081734 +X -0.049877 0.121700 0.088244 +X -0.370915 1.775220 1.341014 X 0.000000 0.000000 0.000000 -X -0.621878 1.274394 1.049586 +X -0.621877 1.274395 1.049586 X 0.000000 0.000000 0.000000 -X -0.257478 0.256545 0.097797 +X -0.257477 0.256545 0.097799 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.417528 1.194849 1.036825 +X -0.417528 1.194850 1.036825 X -0.070357 1.902777 1.392615 -X -0.580612 0.505209 0.768872 +X -0.580612 0.505211 0.768873 X 0.000000 0.000000 0.000000 -X -0.234928 0.027084 0.179993 +X -0.234927 0.027086 0.179994 X 0.000000 0.000000 0.000000 -X 0.021137 -0.689308 -0.835167 +X 0.021138 -0.689305 -0.835166 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.182579 0.106163 0.137264 -X -0.219310 0.017758 0.048549 -X -0.011358 0.029877 -0.038810 +X -0.182578 0.106164 0.137266 +X -0.219309 0.017760 0.048550 +X -0.011325 0.027242 -0.041001 X 0.000000 0.000000 0.000000 -X 0.085026 0.273154 -0.004718 +X 0.084793 0.270986 -0.007640 X 0.000000 0.000000 0.000000 -X 0.128066 0.300456 0.130076 +X 0.128086 0.299345 0.127458 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.206622 0.012243 -0.436474 -X 0.079467 -0.036128 -0.213433 -X 0.621337 -0.209934 -0.909258 +X 0.206464 0.008990 -0.441028 +X 0.078956 -0.040619 -0.219368 +X 0.621660 -0.212697 -0.913521 X 0.000000 0.000000 0.000000 -X 0.599429 -0.574746 -0.914841 +X 0.600124 -0.578360 -0.920139 X 0.000000 0.000000 0.000000 -X 1.046291 -0.652014 -1.088465 +X 1.047562 -0.655143 -1.093105 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.378754 -0.697698 -0.662014 -X 0.288122 -0.715038 -0.617278 -X 0.296645 -0.735676 -0.484126 +X 0.379045 -0.701660 -0.666816 +X 0.288314 -0.719368 -0.622075 +X 0.296775 -0.739379 -0.488477 X 0.000000 0.000000 0.000000 -X 0.161239 -0.705246 -0.271938 +X 0.161203 -0.709152 -0.275782 X 0.000000 0.000000 0.000000 -X 0.086027 -0.571735 -0.142678 +X 0.085973 -0.575627 -0.145721 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.008898 -0.642337 -0.151336 -X 0.007713 -0.624974 -0.202371 +X -0.009331 -0.645932 -0.155441 +X 0.007000 -0.630294 -0.207256 X -0.183879 -0.475898 -0.046060 X 0.000000 0.000000 0.000000 X -0.220824 -0.246520 0.066064 @@ -1339,73 +1339,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -1.908390 4.247581 -2.891596 + -1.908392 4.247584 -2.891591 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.824785 -2.298856 -2.077486 +X -0.824780 -2.298844 -2.077475 X 0.000000 0.000000 0.000000 -X -0.717947 -1.545093 -1.053851 +X -0.717943 -1.545085 -1.053845 X 0.000000 0.000000 0.000000 -X -0.698979 -0.700913 -0.451758 +X -0.698975 -0.700910 -0.451756 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.218345 -0.618413 -0.200251 -X -0.276045 0.377158 0.013011 -X -0.010290 -0.459487 0.416240 +X -0.218344 -0.618409 -0.200249 +X -0.276043 0.377156 0.013011 +X -0.010290 -0.459485 0.416238 X 0.000000 0.000000 0.000000 -X -0.470686 1.507487 2.036533 +X -0.470683 1.507480 2.036524 X 0.000000 0.000000 0.000000 -X 0.385197 1.589981 0.736429 +X 0.385196 1.589973 0.736426 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.592589 1.059217 1.446503 -X -0.179713 0.871541 2.001610 -X -0.985079 0.906315 0.235395 +X -0.592586 1.059212 1.446496 +X -0.179712 0.871537 2.001601 +X -0.985074 0.906311 0.235394 X 0.000000 0.000000 0.000000 -X -0.562953 0.210317 -0.289169 +X -0.562950 0.210316 -0.289167 X 0.000000 0.000000 0.000000 -X -0.391545 -0.038896 -0.461496 +X -0.391542 -0.038896 -0.461494 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.119437 -0.036371 -0.232352 -X 0.142347 -0.187101 -0.194293 -X -0.153716 0.102538 -0.204856 +X -0.119436 -0.036371 -0.232351 +X 0.142346 -0.187100 -0.194292 +X -0.153715 0.102538 -0.204854 X 0.000000 0.000000 0.000000 -X 0.061896 0.129364 -0.113551 +X 0.061896 0.129364 -0.113550 X 0.000000 0.000000 0.000000 -X 0.204604 0.524987 -0.445995 +X 0.204603 0.524985 -0.445993 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.398249 -0.030156 -0.172696 -X -0.025902 0.006293 -0.059503 -X 0.929456 -0.239345 -0.039156 +X 0.398247 -0.030156 -0.172695 +X -0.025902 0.006293 -0.059502 +X 0.929451 -0.239344 -0.039155 X 0.000000 0.000000 0.000000 -X 0.811909 -0.042895 0.364014 +X 0.811905 -0.042895 0.364013 X 0.000000 0.000000 0.000000 -X 0.744321 0.600475 0.517988 +X 0.744317 0.600472 0.517986 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.662407 -0.151498 -0.074827 -X 0.581700 0.148023 -0.103934 -X 0.412924 -0.623499 -0.269228 +X 0.662404 -0.151497 -0.074827 +X 0.581697 0.148022 -0.103934 +X 0.412922 -0.623496 -0.269227 X 0.000000 0.000000 0.000000 -X 0.255387 -0.222437 -0.199622 +X 0.255385 -0.222436 -0.199621 X 0.000000 0.000000 0.000000 -X 0.487267 0.130566 0.073997 +X 0.487264 0.130566 0.073997 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.164113 -0.202685 -0.313101 -X 0.287451 -0.193301 -0.215659 +X 0.164112 -0.202685 -0.313100 +X 0.287450 -0.193300 -0.215659 X 0.241658 -1.373630 -1.512963 X 0.000000 0.000000 0.000000 X 0.557797 -1.716898 -1.406892 @@ -1473,7 +1473,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - 1.596851 6.577756 -3.991789 + 1.596857 6.577756 -3.991788 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -1482,17 +1482,17 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X -0.013331 0.122612 0.162416 X 0.000000 0.000000 0.000000 -X -0.469121 0.083496 -0.248613 +X -0.469122 0.083496 -0.248613 X 0.000000 0.000000 0.000000 -X -0.534622 0.099781 -0.146511 +X -0.534622 0.099782 -0.146511 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.040458 0.132420 0.124704 -X 0.312409 0.545181 1.105571 +X -0.040459 0.132420 0.124704 +X 0.312408 0.545181 1.105571 X -2.515082 -1.127643 -0.896309 X 0.000000 0.000000 0.000000 -X 0.040022 -0.621034 -0.571235 +X 0.040021 -0.621034 -0.571235 X 0.000000 0.000000 0.000000 X 0.930803 -0.548605 -0.672841 X 0.000000 0.000000 0.000000 @@ -1514,25 +1514,25 @@ X 2.140833 -5.032379 -1.437400 X 0.000000 0.000000 0.000000 X 4.625392 -3.837334 -0.819900 X 0.000000 0.000000 0.000000 -X 8.260644 -6.411199 1.161987 +X 8.260645 -6.411199 1.161987 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 4.669385 -3.544572 -1.014897 +X 4.669386 -3.544572 -1.014897 X -3.654711 0.512686 -0.382804 -X 0.574233 -0.520825 0.271573 +X 0.574233 -0.520824 0.271573 X 0.000000 0.000000 0.000000 -X 0.631885 -0.662187 -0.022231 +X 0.631886 -0.662187 -0.022231 X 0.000000 0.000000 0.000000 -X -2.260999 0.875387 2.108882 +X -2.260998 0.875387 2.108882 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.784027 0.078689 0.022331 X -1.725267 -0.281939 0.413968 -X 0.024650 0.068057 0.035630 +X 0.024651 0.068057 0.035630 X 0.000000 0.000000 0.000000 -X 0.169012 -0.004360 0.040529 +X 0.169013 -0.004360 0.040529 X 0.000000 0.000000 0.000000 X 0.089022 0.022934 0.061287 X 0.000000 0.000000 0.000000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure/colvar10.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure/colvar10.reference index fbd0fc0fc4..d6cca819e8 100644 --- a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure/colvar10.reference +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure/colvar10.reference @@ -1,13 +1,13 @@ #! FIELDS time a11 a23 a24_lessthan - 0.000000 0.0776 0.1689 0.1689 - 0.050000 0.2634 0.1526 0.1526 - 0.100000 0.1157 0.8820 0.8820 - 0.150000 3.2981 0.1347 0.1347 - 0.200000 3.0817 0.1605 0.1605 - 0.250000 0.1527 0.1144 0.1144 - 0.300000 0.2142 0.1041 0.1041 - 0.350000 3.1619 0.1436 0.1436 - 0.400000 0.6667 0.2657 0.2657 - 0.450000 2.2564 0.0041 0.0041 - 0.500000 6.9472 0.0247 0.0247 - 0.550000 0.2019 0.2079 0.2079 + 0.000000 0.0775 0.1665 0.1666 + 0.050000 0.2634 0.1507 0.1508 + 0.100000 0.1156 0.8786 0.8787 + 0.150000 3.2980 0.1158 0.1158 + 0.200000 3.0817 0.1398 0.1399 + 0.250000 0.1526 0.1120 0.1121 + 0.300000 0.2141 0.0863 0.0863 + 0.350000 3.1619 0.1350 0.1351 + 0.400000 0.6666 0.2456 0.2457 + 0.450000 2.2564 0.0000 0.0000 + 0.500000 6.9472 0.0078 0.0078 + 0.550000 0.2018 0.2035 0.2036 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure/forces.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure/forces.reference index f214148204..4bca09bf88 100644 --- a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure/forces.reference +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-secondarystructure/forces.reference @@ -1,5 +1,5 @@ 132 - 5.568243 1.137912 0.399573 + 5.568245 1.137912 0.399574 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -16,21 +16,21 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.030164 0.118781 0.103631 X 0.046976 0.108477 0.079394 -X -1.824685 1.195965 1.113452 +X -1.824685 1.195966 1.113451 X 0.000000 0.000000 0.000000 -X 0.117952 0.205239 0.358571 +X 0.117951 0.205239 0.358571 X 0.000000 0.000000 0.000000 X 1.266543 -0.224111 3.480157 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.302459 0.082436 -0.354105 +X 0.302458 0.082436 -0.354106 X 0.792783 -0.120015 0.026837 X 0.674437 -0.082764 -1.087374 X 0.000000 0.000000 0.000000 X 1.223971 -0.543362 -2.427963 X 0.000000 0.000000 0.000000 -X 0.755275 -0.200949 -2.045344 +X 0.755275 -0.200949 -2.045345 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -55,7 +55,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X -0.774150 0.733423 -0.290932 -X -1.052827 1.712184 -0.287921 +X -1.052827 1.712183 -0.287921 X -0.187773 0.261773 -0.063669 X 0.000000 0.000000 0.000000 X -0.207356 0.251340 -0.100300 @@ -64,8 +64,8 @@ X -0.211285 0.404772 -0.195160 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.178846 0.174955 -0.095634 -X -0.372721 0.274087 -0.194265 +X -0.178846 0.174954 -0.095634 +X -0.372720 0.274087 -0.194265 X 0.078436 -0.044446 0.097044 X 0.000000 0.000000 0.000000 X 0.097601 -0.027548 0.110296 @@ -133,7 +133,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 --14.538402 -11.401277 -2.682653 +-14.538399 -11.401276 -2.682653 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -142,17 +142,17 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.731357 -0.130566 -0.050210 X 0.000000 0.000000 0.000000 -X -0.284621 -0.090758 -0.392268 +X -0.284621 -0.090757 -0.392268 X 0.000000 0.000000 0.000000 -X -0.881635 0.260868 -0.542492 +X -0.881636 0.260868 -0.542492 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.744463 0.060052 0.067277 -X 2.529719 0.535087 0.890442 +X 2.529718 0.535087 0.890442 X 2.488033 -0.172849 -0.848831 X 0.000000 0.000000 0.000000 -X 3.590422 0.267817 0.127008 +X 3.590421 0.267817 0.127008 X 0.000000 0.000000 0.000000 X 5.409994 2.075925 -0.080208 X 0.000000 0.000000 0.000000 @@ -169,7 +169,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.110029 0.186506 -0.756666 -X 0.677646 1.292289 -0.467725 +X 0.677645 1.292289 -0.467725 X 0.265876 1.799659 -0.535830 X 0.000000 0.000000 0.000000 X 0.073645 3.239879 -0.342526 @@ -182,9 +182,9 @@ X -0.464530 1.153887 -0.710565 X -1.961528 4.420168 -1.627722 X -0.183660 0.641684 0.243435 X 0.000000 0.000000 0.000000 -X -0.139456 0.239403 0.150061 +X -0.139456 0.239402 0.150061 X 0.000000 0.000000 0.000000 -X -0.437847 0.822565 0.373163 +X -0.437847 0.822564 0.373163 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -198,7 +198,7 @@ X 0.448798 -0.278382 0.015799 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.332491 -0.195148 0.024847 +X 0.332492 -0.195148 0.024847 X 0.425200 -0.160260 0.018821 X -0.050732 -0.613415 0.017414 X 0.000000 0.000000 0.000000 @@ -267,34 +267,34 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - 9.669876 3.599977 3.750942 + 9.669891 3.599982 3.750943 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 3.576953 1.849004 -1.167364 +X 3.576956 1.849005 -1.167364 X 0.000000 0.000000 0.000000 -X 0.229314 2.112133 0.207667 +X 0.229317 2.112134 0.207667 X 0.000000 0.000000 0.000000 -X -1.553862 -1.552610 1.000911 +X -1.553859 -1.552608 1.000911 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 1.133143 1.028918 -1.178886 -X 3.686958 -0.473257 -2.069997 -X -0.633764 0.542146 -0.703730 +X 1.133145 1.028919 -1.178886 +X 3.686961 -0.473256 -2.069996 +X -0.633763 0.542147 -0.703730 X 0.000000 0.000000 0.000000 -X -0.267154 -0.296217 -0.740280 +X -0.267153 -0.296217 -0.740280 X 0.000000 0.000000 0.000000 X 0.259145 -1.883257 -1.279238 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -2.946007 0.151356 -1.337889 -X -4.461758 0.431423 -1.156194 -X -3.045470 0.144984 -0.622496 +X -2.946006 0.151357 -1.337888 +X -4.461757 0.431425 -1.156193 +X -3.045470 0.144984 -0.622497 X 0.000000 0.000000 0.000000 X -5.039014 -0.000422 0.002031 X 0.000000 0.000000 0.000000 @@ -302,38 +302,38 @@ X -7.263670 -2.236313 0.845172 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -3.815968 0.526753 0.177532 -X -2.135767 1.887583 0.375176 -X 0.685566 0.129598 0.139736 +X -3.815969 0.526753 0.177532 +X -2.135767 1.887582 0.375176 +X 0.685565 0.129598 0.139736 X 0.000000 0.000000 0.000000 -X 0.878116 0.284502 0.296352 +X 0.878114 0.284501 0.296352 X 0.000000 0.000000 0.000000 -X 1.449003 0.654553 0.151475 +X 1.449001 0.654552 0.151475 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.490867 0.217298 0.406710 -X 0.849540 0.103454 0.588397 -X -0.211504 -0.092802 -0.022669 +X 0.490865 0.217298 0.406710 +X 0.849539 0.103454 0.588397 +X -0.211506 -0.092804 -0.022670 X 0.000000 0.000000 0.000000 -X -0.222973 -0.096959 -0.061299 +X -0.222975 -0.096961 -0.061299 X 0.000000 0.000000 0.000000 -X -0.334398 -0.180452 -0.077126 +X -0.334401 -0.180454 -0.077127 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.141499 -0.101938 -0.083478 -X -0.126592 -0.085836 -0.098695 -X -0.146673 0.124439 -0.165368 +X -0.141500 -0.101939 -0.083479 +X -0.126593 -0.085837 -0.098696 +X -0.146673 0.124438 -0.165369 X 0.000000 0.000000 0.000000 -X 0.167172 0.142131 -0.006410 +X 0.167173 0.142131 -0.006410 X 0.000000 0.000000 0.000000 -X 0.187591 0.709673 0.250438 +X 0.187591 0.709672 0.250438 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.324900 0.089790 -0.191599 -X 0.385068 0.432257 0.237534 +X 0.324900 0.089791 -0.191598 +X 0.385069 0.432260 0.237537 X -0.003231 -1.768996 -1.426808 X 0.000000 0.000000 0.000000 X 0.802404 -2.290516 -1.488092 @@ -401,73 +401,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -0.827562 -3.476792 -1.291662 + -0.827554 -3.476719 -1.291609 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.188177 0.614206 -0.306067 +X -0.188189 0.614239 -0.306088 X 0.000000 0.000000 0.000000 -X 0.002011 0.389901 -0.126970 +X 0.002010 0.389922 -0.126979 X 0.000000 0.000000 0.000000 -X 0.199312 0.052519 0.165762 +X 0.199322 0.052522 0.165769 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.128268 0.413331 -0.280224 -X -0.464433 0.568069 -0.769509 -X -0.043525 0.007922 -0.031401 +X -0.128278 0.413352 -0.280244 +X -0.464463 0.568096 -0.769559 +X -0.043520 0.007929 -0.031397 X 0.000000 0.000000 0.000000 -X 0.030792 0.111313 0.126085 +X 0.030792 0.111313 0.126083 X 0.000000 0.000000 0.000000 -X -0.077704 0.158595 -0.050595 +X -0.077696 0.158593 -0.050585 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.033977 0.118553 0.160233 -X -0.026368 0.128719 0.072119 -X 0.090626 0.239133 0.320217 +X 0.033979 0.118551 0.160233 +X -0.026367 0.128720 0.072118 +X 0.090630 0.239123 0.320217 X 0.000000 0.000000 0.000000 -X 0.050137 0.346461 0.394846 +X 0.050142 0.346449 0.394846 X 0.000000 0.000000 0.000000 -X 0.073891 0.530366 0.492369 +X 0.073895 0.530350 0.492369 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.080447 0.170018 0.298667 -X 0.043287 0.147848 0.181503 -X -0.245011 0.245614 0.186077 +X 0.080453 0.170006 0.298671 +X 0.043291 0.147843 0.181506 +X -0.245005 0.245595 0.186087 X 0.000000 0.000000 0.000000 -X -0.211908 -0.094680 0.089541 +X -0.211903 -0.094696 0.089555 X 0.000000 0.000000 0.000000 -X -0.369005 -0.562012 0.110171 +X -0.369003 -0.562030 0.110188 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.270341 -0.271273 0.065249 -X -0.289349 -0.158884 0.072294 -X -0.726530 -1.049750 -0.469702 +X -0.270337 -0.271281 0.065261 +X -0.289345 -0.158889 0.072304 +X -0.726529 -1.049756 -0.469692 X 0.000000 0.000000 0.000000 -X -0.899096 -1.440211 -0.679757 +X -0.899095 -1.440212 -0.679749 X 0.000000 0.000000 0.000000 -X -1.616379 -1.930221 -1.274492 +X -1.616381 -1.930220 -1.274485 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.144251 -1.477458 -0.700302 -X 0.400962 -2.091788 -0.430564 -X 0.050471 -1.474152 -0.950781 +X -0.144250 -1.477456 -0.700300 +X 0.400961 -2.091784 -0.430564 +X 0.050471 -1.474148 -0.950781 X 0.000000 0.000000 0.000000 -X 0.419817 -0.868904 -0.447463 +X 0.419814 -0.868900 -0.447467 X 0.000000 0.000000 0.000000 -X 0.521063 -0.941698 -0.208594 +X 0.521054 -0.941693 -0.208600 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.106204 0.324089 0.604488 -X -0.743651 0.707983 0.700723 +X -0.106205 0.324091 0.604487 +X -0.743654 0.707985 0.700720 X -0.169905 0.910965 0.882331 X 0.000000 0.000000 0.000000 X -0.259280 1.779006 0.621690 @@ -669,7 +669,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -9.822939 -1.262668 -1.460122 + -9.822938 -1.262668 -1.460122 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -678,7 +678,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.062494 0.086945 0.084148 X 0.000000 0.000000 0.000000 -X 0.238219 0.183270 0.174569 +X 0.238218 0.183270 0.174569 X 0.000000 0.000000 0.000000 X 0.330853 0.197704 0.132672 X 0.000000 0.000000 0.000000 @@ -720,7 +720,7 @@ X -0.613515 0.144724 0.445066 X 0.000000 0.000000 0.000000 X -0.302932 -0.107425 -0.106196 X 0.000000 0.000000 0.000000 -X -0.731263 -0.247284 0.431549 +X -0.731263 -0.247283 0.431549 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -735,7 +735,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.132969 -0.001190 0.048875 -X 0.140995 -0.009742 0.047117 +X 0.140995 -0.009741 0.047117 X 0.179232 -0.055394 0.008788 X 0.000000 0.000000 0.000000 X 0.169393 -0.096594 0.020356 @@ -803,73 +803,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -1.759320 1.007148 -1.828166 + -1.759325 1.007166 -1.828166 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.045259 -0.156367 0.874010 +X -0.045256 -0.156372 0.874008 X 0.000000 0.000000 0.000000 -X 0.136012 0.146194 0.365783 +X 0.136015 0.146192 0.365782 X 0.000000 0.000000 0.000000 -X 0.620367 0.149397 -0.182887 +X 0.620372 0.149392 -0.182891 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.357424 0.436000 0.446070 -X 1.067486 0.941502 0.764945 -X -0.285370 0.389574 0.193778 +X 0.357425 0.436000 0.446071 +X 1.067487 0.941504 0.764945 +X -0.285369 0.389575 0.193778 X 0.000000 0.000000 0.000000 -X -0.181454 0.489861 -0.022263 +X -0.181454 0.489865 -0.022263 X 0.000000 0.000000 0.000000 -X 0.058015 0.362958 0.035708 +X 0.058014 0.362961 0.035707 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.339200 0.671529 -0.177430 -X -0.725236 1.176005 -0.734855 -X 0.411883 0.400313 0.149347 +X -0.339199 0.671534 -0.177431 +X -0.725235 1.176013 -0.734858 +X 0.411883 0.400315 0.149347 X 0.000000 0.000000 0.000000 -X 0.167430 0.394261 0.142464 +X 0.167430 0.394262 0.142463 X 0.000000 0.000000 0.000000 -X 0.841282 0.594864 0.982869 +X 0.841282 0.594864 0.982868 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.022730 -0.027702 -0.271718 -X 0.167969 0.442639 0.154127 -X 0.261898 0.137484 0.180383 +X 0.167968 0.442638 0.154126 +X 0.261898 0.137484 0.180384 X 0.000000 0.000000 0.000000 -X 0.117879 0.072456 0.129212 +X 0.117879 0.072456 0.129213 X 0.000000 0.000000 0.000000 -X 0.346995 0.216301 0.103484 +X 0.346995 0.216301 0.103485 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.005307 -0.179418 0.157917 -X 0.040160 0.097241 0.173833 -X -0.078301 -0.677037 -0.042902 +X -0.005307 -0.179420 0.157918 +X 0.040161 0.097242 0.173834 +X -0.078300 -0.677042 -0.042903 X 0.000000 0.000000 0.000000 -X 0.006682 -0.766660 -0.004164 +X 0.006683 -0.766666 -0.004164 X 0.000000 0.000000 0.000000 -X -0.027059 -1.089854 0.159054 +X -0.027059 -1.089863 0.159055 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.036516 -0.469664 0.091244 -X 0.076236 -0.419850 0.011905 -X -0.038461 -0.448408 0.118219 +X 0.036517 -0.469667 0.091245 +X 0.076237 -0.419852 0.011905 +X -0.038461 -0.448409 0.118221 X 0.000000 0.000000 0.000000 -X -0.105674 -0.107073 0.109689 +X -0.105676 -0.107071 0.109691 X 0.000000 0.000000 0.000000 -X -0.072276 -0.151468 0.177865 +X -0.072278 -0.151467 0.177868 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.492487 0.302095 0.006363 -X -1.164611 0.392972 -0.331158 +X -0.492492 0.302100 0.006364 +X -1.164622 0.392978 -0.331159 X 0.458657 -0.500425 -0.209348 X 0.000000 0.000000 0.000000 X 0.482635 -0.152152 -0.096788 @@ -937,73 +937,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - 1.801163 -0.865399 -6.225407 + 1.801171 -0.865388 -6.225383 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.049386 0.290814 -0.084232 +X -0.049392 0.290824 -0.084243 X 0.000000 0.000000 0.000000 -X 0.026371 0.232172 0.025452 +X 0.026369 0.232180 0.025448 X 0.000000 0.000000 0.000000 -X 0.144458 0.074059 0.279396 +X 0.144463 0.074061 0.279404 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.038307 0.235974 -0.045931 -X -0.161211 0.223311 -0.209818 -X -2.311487 -2.416755 0.002418 +X -0.038313 0.235981 -0.045938 +X -0.161223 0.223316 -0.209834 +X -2.311486 -2.416749 0.002417 X 0.000000 0.000000 0.000000 -X -1.128736 -1.369547 0.599363 +X -1.128736 -1.369544 0.599362 X 0.000000 0.000000 0.000000 -X -4.176437 -1.231626 -0.451934 +X -4.176431 -1.231624 -0.451932 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.739843 -0.922292 0.499346 -X -0.365018 -0.049879 0.343305 -X -0.960719 -0.940600 0.425897 +X -0.739843 -0.922290 0.499346 +X -0.365017 -0.049879 0.343306 +X -0.960719 -0.940598 0.425896 X 0.000000 0.000000 0.000000 -X -0.197477 0.817338 0.717830 +X -0.197476 0.817337 0.717830 X 0.000000 0.000000 0.000000 -X 0.348882 0.736865 -0.236257 +X 0.348883 0.736865 -0.236255 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.395850 0.208193 0.401792 -X 0.157499 -0.197410 0.274227 -X -1.277217 0.371213 0.191041 +X -0.395848 0.208191 0.401793 +X 0.157498 -0.197409 0.274226 +X -1.277210 0.371207 0.191046 X 0.000000 0.000000 0.000000 -X -1.120745 0.049828 0.085026 +X -1.120738 0.049823 0.085032 X 0.000000 0.000000 0.000000 -X -1.087565 0.809908 0.035292 +X -1.087555 0.809898 0.035302 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.762521 -0.123462 -0.044752 -X -0.652445 -0.187421 -0.079412 -X -0.792250 -0.211347 -1.021530 +X -0.762515 -0.123465 -0.044745 +X -0.652440 -0.187422 -0.079408 +X -0.792244 -0.211351 -1.021520 X 0.000000 0.000000 0.000000 -X 0.323482 -0.716601 -0.894849 +X 0.323485 -0.716603 -0.894842 X 0.000000 0.000000 0.000000 -X 0.070544 -0.809336 -0.412605 +X 0.070546 -0.809338 -0.412598 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 1.218478 -0.756396 -0.960690 -X 2.011562 -1.057094 -1.828868 -X 1.100765 -0.348538 -0.367486 +X 1.218478 -0.756396 -0.960688 +X 2.011561 -1.057093 -1.828868 +X 1.100763 -0.348538 -0.367488 X 0.000000 0.000000 0.000000 -X 1.295590 0.561904 -0.095938 +X 1.295584 0.561902 -0.095944 X 0.000000 0.000000 0.000000 -X 1.807609 1.092373 -0.410704 +X 1.807599 1.092369 -0.410713 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 1.238349 0.967644 0.535006 -X 1.099611 1.137871 0.870651 +X 1.238341 0.967642 0.535001 +X 1.099602 1.137867 0.870645 X 1.290756 0.840942 1.281637 X 0.000000 0.000000 0.000000 X 0.825995 1.168517 1.526853 @@ -1071,72 +1071,72 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - 14.997336 0.733114 8.653134 + 14.997356 0.733118 8.653136 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.591469 0.408174 -0.276043 +X -0.591471 0.408176 -0.276044 X 0.000000 0.000000 0.000000 -X -0.165110 0.149799 -0.098356 +X -0.165113 0.149800 -0.098357 X 0.000000 0.000000 0.000000 -X 0.236318 0.094013 0.164633 +X 0.236315 0.094014 0.164632 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.025507 0.180409 0.044640 -X -0.097352 0.300857 0.434903 -X -2.957315 -0.821681 -2.534692 +X -0.025510 0.180411 0.044639 +X -0.097355 0.300859 0.434902 +X -2.957317 -0.821681 -2.534692 X 0.000000 0.000000 0.000000 -X -1.521405 -1.178083 -2.315329 +X -1.521407 -1.178083 -2.315329 X 0.000000 0.000000 0.000000 -X -0.384659 -0.875549 -0.974852 +X -0.384660 -0.875549 -0.974852 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.795378 -1.550017 -2.875792 -X -1.507772 0.147242 -1.353310 -X 0.766460 -2.696973 -4.218276 +X -0.795380 -1.550016 -2.875792 +X -1.507774 0.147242 -1.353310 +X 0.766460 -2.696972 -4.218276 X 0.000000 0.000000 0.000000 X 1.757669 -2.235941 -3.574494 X 0.000000 0.000000 0.000000 -X 1.170225 -1.002977 -3.769104 +X 1.170226 -1.002977 -3.769104 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 2.940613 -1.990462 -1.666347 -X 2.208516 -1.132424 -1.250438 -X 3.121061 -1.926020 -0.368147 +X 2.208515 -1.132424 -1.250438 +X 3.121062 -1.926021 -0.368147 X 0.000000 0.000000 0.000000 -X 2.761454 -0.933988 0.318550 +X 2.761455 -0.933988 0.318550 X 0.000000 0.000000 0.000000 -X 0.668492 0.836150 -0.474263 +X 0.668493 0.836149 -0.474262 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 2.950786 -0.170419 1.140943 -X -1.312100 2.664392 0.348445 -X -0.381976 0.705871 0.594855 +X 2.950787 -0.170420 1.140944 +X -1.312099 2.664391 0.348446 +X -0.381975 0.705870 0.594855 X 0.000000 0.000000 0.000000 -X -0.465693 0.655051 0.640175 +X -0.465691 0.655051 0.640175 X 0.000000 0.000000 0.000000 -X -1.131352 1.271131 0.664053 +X -1.131348 1.271130 0.664053 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.312024 0.132543 0.225185 -X 0.103887 0.052308 0.273707 -X -0.277706 0.063811 0.364539 +X 0.312026 0.132543 0.225185 +X 0.103888 0.052308 0.273707 +X -0.277703 0.063811 0.364540 X 0.000000 0.000000 0.000000 -X -0.040344 0.099198 0.162482 +X -0.040342 0.099198 0.162483 X 0.000000 0.000000 0.000000 -X -0.521907 0.519581 0.210775 +X -0.521905 0.519581 0.210777 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.323166 0.181507 -0.092031 +X 0.323167 0.181508 -0.092031 X 0.206807 0.149467 -0.209996 X 0.099822 0.037990 -0.125578 X 0.000000 0.000000 0.000000 @@ -1205,73 +1205,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -1.412818 -4.947633 -2.648604 + -1.412817 -4.947625 -2.648596 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.044776 0.002305 0.091238 +X 0.044777 0.002305 0.091240 X 0.000000 0.000000 0.000000 -X 0.011048 0.010755 0.074934 +X 0.011049 0.010755 0.074936 X 0.000000 0.000000 0.000000 -X -0.002254 -0.002796 0.089480 +X -0.002254 -0.002796 0.089482 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000529 0.009089 0.008561 -X 0.003345 0.001941 -0.029266 +X 0.003345 0.001941 -0.029267 X -0.004759 0.002736 -0.010478 X 0.000000 0.000000 0.000000 -X -0.014266 -0.008805 -0.053123 +X -0.014266 -0.008805 -0.053125 X 0.000000 0.000000 0.000000 -X -0.015048 0.000545 -0.058112 +X -0.015049 0.000545 -0.058114 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.031940 -0.026294 -0.073484 -X -0.063696 -0.037847 -0.113279 -X -0.010197 -0.014537 -0.015856 +X -0.031941 -0.026295 -0.073487 +X -0.063698 -0.037848 -0.113283 +X -0.010197 -0.014538 -0.015857 X 0.000000 0.000000 0.000000 -X -0.014138 -0.019970 -0.011429 +X -0.014138 -0.019971 -0.011430 X 0.000000 0.000000 0.000000 -X -0.000211 -0.000592 -0.003422 +X -0.000212 -0.000592 -0.003423 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.012152 -0.029326 -0.004014 -X -0.012329 -0.043241 -0.012845 -X -0.004367 0.057366 0.076996 +X -0.012153 -0.029327 -0.004015 +X -0.012330 -0.043244 -0.012847 +X -0.004367 0.057365 0.076996 X 0.000000 0.000000 0.000000 -X -0.009819 0.070578 0.080328 +X -0.009819 0.070577 0.080328 X 0.000000 0.000000 0.000000 -X -0.008262 0.033850 0.068191 +X -0.008262 0.033850 0.068192 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.018252 0.085661 0.081734 -X -0.049877 0.121700 0.088245 -X -0.370915 1.775220 1.341013 +X -0.018251 0.085660 0.081734 +X -0.049877 0.121700 0.088244 +X -0.370915 1.775220 1.341014 X 0.000000 0.000000 0.000000 -X -0.621878 1.274394 1.049586 +X -0.621877 1.274395 1.049586 X 0.000000 0.000000 0.000000 -X -0.257478 0.256545 0.097797 +X -0.257477 0.256545 0.097799 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.417528 1.194849 1.036825 +X -0.417528 1.194850 1.036825 X -0.070357 1.902777 1.392615 -X -0.580612 0.505209 0.768872 +X -0.580612 0.505211 0.768873 X 0.000000 0.000000 0.000000 -X -0.234928 0.027084 0.179993 +X -0.234927 0.027086 0.179994 X 0.000000 0.000000 0.000000 -X 0.021137 -0.689308 -0.835167 +X 0.021138 -0.689305 -0.835166 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.182579 0.106163 0.137264 -X -0.219310 0.017758 0.048549 +X -0.182578 0.106164 0.137266 +X -0.219309 0.017760 0.048550 X -0.011325 0.027242 -0.041001 X 0.000000 0.000000 0.000000 X 0.084793 0.270986 -0.007640 @@ -1339,73 +1339,73 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - -1.928213 3.794817 -3.329421 + -1.928215 3.794821 -3.329417 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.824785 -2.298856 -2.077486 +X -0.824780 -2.298844 -2.077475 X 0.000000 0.000000 0.000000 -X -0.717947 -1.545093 -1.053851 +X -0.717943 -1.545085 -1.053845 X 0.000000 0.000000 0.000000 -X -0.698979 -0.700913 -0.451758 +X -0.698975 -0.700910 -0.451756 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.218345 -0.618413 -0.200251 -X -0.276045 0.377158 0.013011 -X -0.002781 -0.383742 0.482732 +X -0.218344 -0.618409 -0.200249 +X -0.276043 0.377156 0.013011 +X -0.002781 -0.383740 0.482730 X 0.000000 0.000000 0.000000 -X -0.475027 1.587263 2.120869 +X -0.475025 1.587256 2.120859 X 0.000000 0.000000 0.000000 -X 0.378528 1.695770 0.839469 +X 0.378526 1.695762 0.839466 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.603978 1.133415 1.520773 -X -0.196268 0.940934 2.081301 -X -0.997639 0.977843 0.294561 +X -0.603975 1.133410 1.520766 +X -0.196267 0.940930 2.081292 +X -0.997634 0.977839 0.294560 X 0.000000 0.000000 0.000000 -X -0.582633 0.271321 -0.244580 +X -0.582630 0.271320 -0.244579 X 0.000000 0.000000 0.000000 -X -0.408679 0.026670 -0.425460 +X -0.408677 0.026670 -0.425457 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.122833 -0.014272 -0.216841 -X 0.153259 -0.213002 -0.222391 -X -0.155358 0.141497 -0.166402 +X -0.122832 -0.014272 -0.216839 +X 0.153258 -0.213001 -0.222390 +X -0.155357 0.141497 -0.166401 X 0.000000 0.000000 0.000000 -X 0.058918 0.130322 -0.101447 +X 0.058918 0.130322 -0.101446 X 0.000000 0.000000 0.000000 -X 0.215079 0.553283 -0.423320 +X 0.215078 0.553281 -0.423317 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.380924 -0.058411 -0.175165 +X 0.380922 -0.058410 -0.175164 X -0.037007 -0.037008 -0.069349 -X 0.929456 -0.239345 -0.039156 +X 0.929451 -0.239344 -0.039155 X 0.000000 0.000000 0.000000 -X 0.811909 -0.042895 0.364014 +X 0.811905 -0.042895 0.364013 X 0.000000 0.000000 0.000000 -X 0.744321 0.600475 0.517988 +X 0.744317 0.600472 0.517986 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.662407 -0.151498 -0.074827 -X 0.581700 0.148023 -0.103934 -X 0.412924 -0.623499 -0.269228 +X 0.662404 -0.151497 -0.074827 +X 0.581697 0.148022 -0.103934 +X 0.412922 -0.623496 -0.269227 X 0.000000 0.000000 0.000000 -X 0.255387 -0.222437 -0.199622 +X 0.255385 -0.222436 -0.199621 X 0.000000 0.000000 0.000000 -X 0.487267 0.130566 0.073997 +X 0.487264 0.130566 0.073997 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 0.164113 -0.202685 -0.313101 -X 0.287451 -0.193301 -0.215659 +X 0.164112 -0.202685 -0.313100 +X 0.287450 -0.193300 -0.215659 X 0.253612 -1.389683 -1.503521 X 0.000000 0.000000 0.000000 X 0.559255 -1.732855 -1.410374 @@ -1473,7 +1473,7 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 132 - 0.628441 6.475398 -4.206281 + 0.628447 6.475399 -4.206281 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 @@ -1482,24 +1482,24 @@ X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X -0.013331 0.122612 0.162416 X 0.000000 0.000000 0.000000 -X -0.469121 0.083496 -0.248613 +X -0.469122 0.083496 -0.248613 X 0.000000 0.000000 0.000000 -X -0.534622 0.099781 -0.146511 +X -0.534622 0.099782 -0.146511 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X -0.040458 0.132420 0.124704 -X 0.312409 0.545181 1.105571 -X -2.307951 -1.045096 -0.857798 +X -0.040459 0.132420 0.124704 +X 0.312408 0.545181 1.105571 +X -2.307952 -1.045096 -0.857798 X 0.000000 0.000000 0.000000 -X 0.231363 -0.518998 -0.527011 +X 0.231362 -0.518998 -0.527011 X 0.000000 0.000000 0.000000 X 1.133245 -0.420025 -0.659573 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.043759 -0.601219 -0.742959 -X -0.930932 -0.635599 -0.778485 +X -0.930933 -0.635599 -0.778485 X -0.349735 -0.682046 0.801166 X 0.000000 0.000000 0.000000 X -0.716627 -1.894568 -0.089447 @@ -1508,31 +1508,31 @@ X -1.712864 1.679244 3.529027 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 -X 2.014256 -2.861622 -1.343418 +X 2.014255 -2.861622 -1.343418 X 3.023301 0.303627 -0.957457 X 2.172209 -5.081802 -1.404604 X 0.000000 0.000000 0.000000 -X 4.632786 -3.938514 -0.806785 +X 4.632786 -3.938514 -0.806784 X 0.000000 0.000000 0.000000 X 8.246847 -6.508360 1.206055 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 4.707659 -3.686986 -1.036940 -X -3.632471 0.414513 -0.386082 -X 0.574233 -0.520825 0.271573 +X -3.632470 0.414513 -0.386082 +X 0.574233 -0.520824 0.271573 X 0.000000 0.000000 0.000000 -X 0.631885 -0.662187 -0.022231 +X 0.631886 -0.662187 -0.022231 X 0.000000 0.000000 0.000000 -X -2.260999 0.875387 2.108882 +X -2.260998 0.875387 2.108882 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.000000 0.000000 0.000000 X 0.784027 0.078689 0.022331 X -1.725267 -0.281939 0.413968 -X 0.024650 0.068057 0.035630 +X 0.024651 0.068057 0.035630 X 0.000000 0.000000 0.000000 -X 0.169012 -0.004360 0.040529 +X 0.169013 -0.004360 0.040529 X 0.000000 0.000000 0.000000 X 0.089022 0.022934 0.061287 X 0.000000 0.000000 0.000000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/Makefile b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/Makefile new file mode 100644 index 0000000000..3703b27cea --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/Makefile @@ -0,0 +1 @@ +include ../../scripts/test.make diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/colvar.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/colvar.reference new file mode 100644 index 0000000000..04bc07132f --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/colvar.reference @@ -0,0 +1,7 @@ +#! FIELDS time b1 b3 b5 p1 p3 p4_lessthan + 0.000000 0.303758 0.334546 0.144235 0.267710 0.357491 0.268067 + 0.050000 70.278344 101.633840 0.002736 14.651541 17.950137 14.657854 + 0.100000 55.079341 81.294678 0.024255 12.999724 15.725365 13.004944 + 0.150000 76.190084 109.259086 0.002997 16.194679 19.085858 16.200907 + 0.200000 8.947340 22.745095 0.034583 57.660876 61.098779 57.666179 + 0.250000 16.457470 34.006412 0.003378 100.703475 103.450373 100.708328 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/config b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/config new file mode 100644 index 0000000000..68228544bb --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/config @@ -0,0 +1,11 @@ +type=driver +# ANTIBETARMSD and PARABETARMSD with USEGPU and TYPE=DRMSD compute the number of segments with +# ANTIBETARMSD_SCALAR_ACC and PARABETARMSD_SCALAR_ACC: with and without STRANDS_CUTOFF and LESS_THAN, STYLE all, inter +# and intra, NOPBC, one (antiparallel) and two (parallel) reference structures. +# The references were computed on the CPU (the same input without USEGPU) +extra_files="../../../../../regtest/secondarystructure/rt33/amyloid.pdb ../../../../../regtest/secondarystructure/rt33/amyloid.xyz" +arg="--plumed plumed.dat --trajectory-stride 10 --timestep 0.005 --ixyz amyloid.xyz --dump-forces forces --dump-forces-fmt=%10.6f" +# keep the first two lines of each frame (number of atoms and virial) and the forces on one atom every 10 +function plumed_regtest_after(){ + awk 'NR==1{natoms=$1} {i=(NR-1)%(natoms+2); if(i<2 || (i-2)%10==0) print}' forces > forces.tmp && mv forces.tmp forces +} diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/forces.reference b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/forces.reference new file mode 100644 index 0000000000..e537306c24 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/forces.reference @@ -0,0 +1,1524 @@ +2520 + -3.018578 -5.610811 -4.766249 +X 0.000000 0.000000 0.000000 +X 0.000108 0.000157 0.000166 +X 0.000162 0.000218 0.000156 +X 0.000000 0.000000 0.000000 +X 0.000511 0.000959 0.000161 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.001311 0.007397 0.000229 +X 0.000000 0.000000 0.000000 +X -0.002653 0.017626 -0.000821 +X 0.000184 0.018450 -0.003419 +X 0.000000 0.000000 0.000000 +X -0.002668 0.006738 -0.003927 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.000395 0.003578 -0.002234 +X -0.000776 0.003030 -0.001403 +X 0.000000 0.000000 0.000000 +X 0.000371 0.000951 -0.000807 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.001512 0.001256 -0.000801 +X 0.000000 0.000000 0.000000 +X 0.000193 -0.000417 0.000060 +X 0.001508 -0.001287 -0.000068 +X 0.000000 0.000000 0.000000 +X 0.001719 -0.001465 0.000811 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.019961 0.147092 0.240002 +X 0.046232 0.148442 0.131782 +X 0.000000 0.000000 0.000000 +X 0.007767 0.184238 0.038447 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.000367 -0.000660 -0.000679 +X 0.000000 0.000000 0.000000 +X -0.002725 0.004689 0.001314 +X -0.002786 0.003887 0.003831 +X 0.000000 0.000000 0.000000 +X -0.001279 0.002585 0.003583 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.000327 -0.002026 0.000387 +X 0.000237 -0.003145 0.002105 +X 0.000000 0.000000 0.000000 +X 0.009581 -0.019320 0.003074 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.025852 -0.040471 -0.024660 +X 0.000000 0.000000 0.000000 +X -0.002047 -0.010475 -0.010483 +X 0.010250 -0.020090 -0.030062 +X 0.000000 0.000000 0.000000 +X 0.011161 -0.008265 -0.014887 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.103668 -0.051841 -0.016302 +X -0.076092 -0.059196 -0.031569 +X 0.000000 0.000000 0.000000 +X -0.021592 -0.122273 -0.029370 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.001981 -0.073116 -0.051980 +X 0.000000 0.000000 0.000000 +X 0.013776 -0.021987 -0.007356 +X 0.019554 -0.049891 -0.016083 +X 0.000000 0.000000 0.000000 +X 0.002604 -0.004630 -0.002071 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.003158 0.001742 0.001064 +X -0.002025 0.002138 0.001065 +X 0.000000 0.000000 0.000000 +X 0.000270 0.003187 -0.002909 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.000476 0.001424 -0.001594 +X 0.000000 0.000000 0.000000 +X -0.000134 0.000202 -0.001416 +X 0.001322 0.000537 -0.001990 +X 0.000000 0.000000 0.000000 +X 0.001926 0.000490 -0.000833 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.005058 -0.000383 -0.000402 +X -0.003593 -0.000421 -0.000702 +X 0.000000 0.000000 0.000000 +X -0.001903 -0.003615 -0.000344 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.001580 -0.000773 -0.000434 +X 0.000000 0.000000 0.000000 +X -0.003080 -0.000112 -0.002584 +X -0.002293 -0.001407 -0.001460 +X 0.000000 0.000000 0.000000 +X -0.000186 -0.002108 -0.000453 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.000053 0.001686 0.000657 +X 0.000159 0.001351 0.000463 +X 0.000000 0.000000 0.000000 +X 0.000183 0.000413 0.000065 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.000176 -0.000034 -0.000109 +X 0.000000 0.000000 0.000000 +X 0.000442 -0.000214 -0.000175 +X 0.000249 -0.000972 -0.000446 +X 0.000000 0.000000 0.000000 +X -0.000162 -0.001080 -0.000511 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.000799 0.001606 -0.001596 +X 0.000965 0.001224 -0.001384 +X 0.000000 0.000000 0.000000 +X 0.008588 0.003763 -0.003038 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.025718 0.012787 -0.004416 +X 0.000000 0.000000 0.000000 +X 0.009148 0.011222 -0.033257 +X 0.009178 0.003183 -0.002699 +X 0.000000 0.000000 0.000000 +X -0.016466 0.031656 0.042236 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.000188 -0.000308 -0.000918 +X -0.000227 -0.000325 -0.000667 +X 0.000000 0.000000 0.000000 +X -0.000490 -0.000271 0.000042 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.000387 -0.000071 0.000231 +X 0.000000 0.000000 0.000000 +X -0.000138 -0.000050 0.000381 +X -0.000170 0.000143 0.000732 +X 0.000000 0.000000 0.000000 +X -0.000082 0.000243 0.000646 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.004262 -0.001620 0.003472 +X -0.004567 -0.002889 0.000076 +X 0.000000 0.000000 0.000000 +X -0.043773 0.015418 -0.026237 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.049347 0.038574 -0.036664 +X 0.000000 0.000000 0.000000 +X -0.002177 0.004645 -0.049430 +X -0.027946 0.038561 -0.064161 +X 0.000000 0.000000 0.000000 +X -0.004938 0.006149 -0.006955 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.025400 0.000633 0.006866 +X -0.014056 0.001838 0.013032 +X 0.000000 0.000000 0.000000 +X -0.003707 0.011761 0.011714 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.011219 0.011792 0.000390 +X 0.000000 0.000000 0.000000 +X 0.012604 0.034707 0.035430 +X 0.019484 0.026476 0.026279 +X 0.000000 0.000000 0.000000 +X 0.003873 0.003220 0.002237 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.005237 -0.004870 -0.006099 +X 0.000430 -0.013054 -0.007149 +X 0.000000 0.000000 0.000000 +X 0.039294 -0.075896 -0.024409 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.030381 -0.054283 -0.004920 +X 0.000000 0.000000 0.000000 +X 0.038370 -0.065921 0.007676 +X 0.042299 -0.047323 0.002512 +X 0.000000 0.000000 0.000000 +X 0.006058 -0.000104 0.001346 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.008980 0.006382 -0.005608 +X 0.007283 0.000536 -0.002366 +X 0.000000 0.000000 0.000000 +X 0.002764 -0.000771 0.031147 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.003025 0.011317 0.056730 +X 0.000000 0.000000 0.000000 +X -0.005966 -0.012854 0.049526 +X -0.015243 0.000061 0.059218 +X 0.000000 0.000000 0.000000 +X -0.007541 0.000614 0.003783 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.002591 0.003099 0.003747 +X 0.002182 -0.004518 0.004265 +X 0.000000 0.000000 0.000000 +X -0.002017 -0.015498 0.005324 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.002044 0.000786 0.002926 +X 0.000000 0.000000 0.000000 +X 0.004607 0.006941 0.012313 +X 0.004581 0.002805 0.010558 +X 0.000000 0.000000 0.000000 +X 0.002734 -0.000657 0.001377 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.001800 0.000472 0.001266 +X -0.001725 0.000092 0.000981 +X 0.000000 0.000000 0.000000 +X -0.000828 0.000465 0.001662 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.000105 0.001054 0.002272 +X 0.000000 0.000000 0.000000 +X 0.000263 0.000317 0.001192 +X 0.001396 0.000691 0.001333 +X 0.000000 0.000000 0.000000 +X 0.001332 0.000727 0.000511 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.000027 -0.000103 0.000018 +X -0.000031 -0.000094 0.000027 +X 0.000000 0.000000 0.000000 +X -0.000076 -0.000186 0.000102 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.000327 -0.000622 0.000297 +X 0.000000 0.000000 0.000000 +X -0.000305 -0.001353 0.000734 +X -0.000370 -0.001110 0.000662 +X 0.000000 0.000000 0.000000 +X -0.000161 -0.000277 0.000308 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.000526 0.000078 0.005191 +X -0.000480 0.000526 0.004428 +X 0.000000 0.000000 0.000000 +X -0.001847 0.001329 0.003995 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.008110 0.003614 0.009476 +X 0.000000 0.000000 0.000000 +X -0.071066 0.034329 0.024891 +X -0.055450 0.020928 0.018689 +X 0.000000 0.000000 0.000000 +X -0.017102 0.004465 0.010614 +X 0.000000 0.000000 0.000000 +2520 +-47446.427803 -33064.231885 -24326.774708 +X 0.000000 0.000000 0.000000 +X -176.926222 130.671005 -28.798432 +X -134.959598 22.830384 70.961613 +X 0.000000 0.000000 0.000000 +X -67.251684 87.976235 47.018631 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -79.521607 -15.104679 115.984310 +X 0.000000 0.000000 0.000000 +X 116.098860 -46.186070 -42.612571 +X 213.021587 65.125666 -112.671158 +X 0.000000 0.000000 0.000000 +X 99.790815 -43.983593 -5.100822 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -72.714991 79.141933 -57.258842 +X -36.161092 49.495286 -18.045960 +X 0.000000 0.000000 0.000000 +X -42.540204 111.494404 -3.232820 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -42.273212 49.840273 -0.301922 +X 0.000000 0.000000 0.000000 +X 80.699708 19.611635 -129.488678 +X 130.885751 41.410998 -95.507222 +X 0.000000 0.000000 0.000000 +X 85.556553 -5.060886 -44.308224 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 239.658669 -59.630001 -7.692853 +X 111.067542 -111.045339 66.287836 +X 0.000000 0.000000 0.000000 +X 115.015386 7.984655 -59.193388 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 82.604329 -96.319133 84.611600 +X 0.000000 0.000000 0.000000 +X -28.061965 136.472989 0.820193 +X -4.986058 212.803931 -83.725878 +X 0.000000 0.000000 0.000000 +X -101.561334 87.732463 0.291123 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 123.881960 -34.501902 -59.123437 +X 48.459732 -36.895437 -44.256561 +X 0.000000 0.000000 0.000000 +X 25.216997 -73.657230 -132.602473 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 12.462601 -24.535600 -82.606712 +X 0.000000 0.000000 0.000000 +X -59.012514 100.487917 -22.153540 +X -122.380547 112.839539 -99.739050 +X 0.000000 0.000000 0.000000 +X -71.761465 80.973202 -32.773588 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 34.557967 -97.620643 -47.248112 +X 71.467210 -116.445836 7.659490 +X 0.000000 0.000000 0.000000 +X 89.544811 -91.688447 -8.359014 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 47.675462 -204.698334 160.793982 +X 0.000000 0.000000 0.000000 +X -60.138531 146.295643 -40.660857 +X -53.112256 244.288287 -122.389502 +X 0.000000 0.000000 0.000000 +X -85.840846 78.861380 11.289352 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 51.297768 -102.115636 -21.073136 +X 34.988853 -46.834359 -3.465078 +X 0.000000 0.000000 0.000000 +X 70.969457 -72.502833 13.632368 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 61.789773 -64.497962 -20.146084 +X 0.000000 0.000000 0.000000 +X -101.727782 -51.415661 29.189114 +X -123.790276 -85.996261 137.760512 +X 0.000000 0.000000 0.000000 +X -62.346962 1.245670 45.739000 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -111.646223 65.317064 127.163032 +X -111.914265 152.600950 0.215286 +X 0.000000 0.000000 0.000000 +X -96.309352 -30.554513 48.231489 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -98.422067 147.577777 -74.100440 +X 0.000000 0.000000 0.000000 +X 60.491715 -149.474905 116.972511 +X 39.560622 -213.506029 96.203573 +X 0.000000 0.000000 0.000000 +X 101.520917 -76.195602 -7.652414 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -195.914174 134.246908 6.460068 +X -141.832666 19.460057 95.848129 +X 0.000000 0.000000 0.000000 +X -82.200968 83.223072 52.995384 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -107.996543 -28.311407 179.024701 +X 0.000000 0.000000 0.000000 +X 25.312927 1.186213 -29.914906 +X 189.014253 67.902773 -160.821479 +X 0.000000 0.000000 0.000000 +X 131.506647 -47.938136 -64.370816 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -136.100527 125.141994 -148.720387 +X -172.805870 14.070837 30.945105 +X 0.000000 0.000000 0.000000 +X -59.232465 102.991900 -102.285877 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -132.326941 -107.676477 41.992227 +X 0.000000 0.000000 0.000000 +X 196.650488 -56.683750 -205.846928 +X 116.237186 73.182870 -152.397958 +X 0.000000 0.000000 0.000000 +X 95.232750 -67.126358 -43.070838 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -74.728162 87.415513 -39.107512 +X -56.696209 41.365176 4.148239 +X 0.000000 0.000000 0.000000 +X -46.808083 209.667292 -21.973924 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -9.489642 128.843301 -47.096937 +X 0.000000 0.000000 0.000000 +X 21.515081 85.538966 -236.258141 +X 127.707832 98.467859 -113.715564 +X 0.000000 0.000000 0.000000 +X 73.868361 17.996239 -47.514631 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 168.037201 19.864774 -41.324033 +X 153.303486 -107.447236 43.207877 +X 0.000000 0.000000 0.000000 +X 117.401941 39.628424 -142.822552 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -1.485952 -49.247510 68.264762 +X 0.000000 0.000000 0.000000 +X -109.017665 102.781658 210.474101 +X -70.578646 185.890033 -101.964032 +X 0.000000 0.000000 0.000000 +X -118.543083 131.738769 26.987943 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -186.695115 69.841983 22.008593 +X -142.297659 -22.866686 152.876829 +X 0.000000 0.000000 0.000000 +X -12.377118 90.336256 104.250822 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -95.982009 -60.439391 102.443029 +X 0.000000 0.000000 0.000000 +X 78.532223 -198.344268 -40.738251 +X 156.560786 74.927136 -129.029695 +X 0.000000 0.000000 0.000000 +X 125.683043 -42.358409 -59.219962 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 118.630827 -43.598098 -34.117025 +X 74.910574 -118.073725 20.010358 +X 0.000000 0.000000 0.000000 +X 19.825564 -51.354394 -16.951877 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 8.605793 -164.417300 62.031278 +X 0.000000 0.000000 0.000000 +X -39.864717 -51.120849 89.296156 +X -59.576609 49.301783 -30.618059 +X 0.000000 0.000000 0.000000 +X -43.252514 2.532122 40.713637 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 132.862591 -131.978372 -43.650302 +X 143.400605 10.807150 -105.768222 +X 0.000000 0.000000 0.000000 +X 79.168450 -96.214968 60.351013 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 149.042569 98.233066 -146.512232 +X 0.000000 0.000000 0.000000 +X -174.065063 -36.236776 98.194740 +X -159.329646 -35.901968 165.450569 +X 0.000000 0.000000 0.000000 +X -106.928837 0.655238 46.840054 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -134.508156 36.518210 100.193132 +X -107.550913 137.604193 -24.813198 +X 0.000000 0.000000 0.000000 +X -102.692113 1.795722 36.836337 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -31.307444 214.576845 -98.307146 +X 0.000000 0.000000 0.000000 +X 95.840085 -52.066591 48.684807 +X 97.153419 -195.949471 64.649331 +X 0.000000 0.000000 0.000000 +X 104.787861 -50.885472 7.176904 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 80.128535 -46.040993 -40.986962 +X 95.326733 39.750206 -118.035269 +X 0.000000 0.000000 0.000000 +X 36.456593 -23.479428 -20.346041 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 67.761683 103.581333 -127.982045 +X 0.000000 0.000000 0.000000 +X -18.740531 14.702513 -25.426161 +X -52.812742 -14.550026 46.488382 +X 0.000000 0.000000 0.000000 +X -50.641533 36.129856 -11.847896 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 10.696230 -96.681707 -1.456399 +X 33.987139 -122.420867 35.172585 +X 0.000000 0.000000 0.000000 +X 6.343215 -24.072128 29.280080 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.138389 -110.779293 120.843687 +X 0.000000 0.000000 0.000000 +X -55.663087 37.548114 26.316580 +X -7.365219 63.002374 -46.525449 +X 0.000000 0.000000 0.000000 +X -42.128568 17.886759 38.919133 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -2.436637 -1.645593 1.908140 +X 29.905403 -134.434416 14.058692 +X 0.000000 0.000000 0.000000 +X 9.534745 -22.321983 -63.625840 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -51.227623 -193.675506 11.256025 +X 0.000000 0.000000 0.000000 +X -42.312483 -56.473919 76.440883 +X -58.319717 -6.761590 -93.389741 +X 0.000000 0.000000 0.000000 +X -81.513042 5.730985 27.045939 +X 0.000000 0.000000 0.000000 +2520 +-20234.000463 -26822.026786 -22812.529251 +X 0.000000 0.000000 0.000000 +X -99.082742 -84.105652 -130.687183 +X -47.326486 -119.706612 -42.561937 +X 0.000000 0.000000 0.000000 +X -88.019785 30.455075 -72.891253 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 40.994010 -139.231287 -49.366354 +X 0.000000 0.000000 0.000000 +X 160.783301 188.757870 134.070252 +X -30.380623 166.072957 116.661125 +X 0.000000 0.000000 0.000000 +X 11.291810 61.917661 47.402459 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -12.701967 10.449513 -95.181413 +X -22.661656 4.194751 -45.251972 +X 0.000000 0.000000 0.000000 +X -74.053365 6.422023 -60.014442 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -53.003445 30.572151 -19.970368 +X 0.000000 0.000000 0.000000 +X 38.183774 47.394723 58.213130 +X -37.698308 106.444328 112.142123 +X 0.000000 0.000000 0.000000 +X -22.756933 30.730143 81.603231 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -36.008899 48.639966 165.759239 +X 48.107857 -5.027332 101.419857 +X 0.000000 0.000000 0.000000 +X 32.007531 81.220701 75.854060 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 43.781736 -102.082849 44.628449 +X 0.000000 0.000000 0.000000 +X -140.392530 93.188682 -124.843275 +X -110.695986 134.018042 -146.598567 +X 0.000000 0.000000 0.000000 +X -48.689035 11.096262 -72.021621 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -5.654815 28.181918 14.255622 +X -21.648946 25.760407 -9.236771 +X 0.000000 0.000000 0.000000 +X -179.598469 171.616894 -92.979431 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 6.395894 46.227311 8.594441 +X 0.000000 0.000000 0.000000 +X -78.164203 -94.054054 -69.626360 +X -44.783543 -22.935977 -93.854190 +X 0.000000 0.000000 0.000000 +X 19.322109 -34.298667 -88.882467 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 57.083567 52.446327 52.724733 +X 83.205094 -5.111913 89.280738 +X 0.000000 0.000000 0.000000 +X 77.440029 45.815266 89.510763 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 79.929253 -135.400524 71.997112 +X 0.000000 0.000000 0.000000 +X -26.413363 103.819670 -50.708152 +X -119.649351 77.768896 -108.585815 +X 0.000000 0.000000 0.000000 +X -70.813525 -30.912064 -45.749207 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 117.278097 64.313478 5.680917 +X 43.937807 24.676254 22.962410 +X 0.000000 0.000000 0.000000 +X 68.205174 32.976401 76.110421 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 49.731309 20.884199 28.107787 +X 0.000000 0.000000 0.000000 +X 138.110094 -165.739959 -48.839337 +X 82.640169 -157.566030 18.421560 +X 0.000000 0.000000 0.000000 +X -21.434339 -82.346729 -2.544761 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -85.557028 -170.034929 -33.360617 +X -93.211559 -58.715521 -101.458371 +X 0.000000 0.000000 0.000000 +X 0.373639 -68.195069 -88.215847 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -143.333828 21.638209 -63.185194 +X 0.000000 0.000000 0.000000 +X 186.377999 -25.295192 128.905029 +X 206.396792 -4.799990 108.221578 +X 0.000000 0.000000 0.000000 +X 41.669217 -27.418148 10.912464 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -52.289396 -19.614934 -51.784554 +X -20.460967 -106.281672 -25.485349 +X 0.000000 0.000000 0.000000 +X -25.271107 -17.414322 -22.863904 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 15.448153 -123.285206 32.353242 +X 0.000000 0.000000 0.000000 +X 6.751848 -16.099883 9.613246 +X -39.651882 54.760941 49.317694 +X 0.000000 0.000000 0.000000 +X 44.941570 2.994595 29.486961 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -44.218904 -166.580910 -145.128232 +X -25.930989 -112.614235 -22.057497 +X 0.000000 0.000000 0.000000 +X -82.429938 -33.702731 -62.838436 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 130.900975 -52.549712 52.803257 +X 0.000000 0.000000 0.000000 +X 283.595205 6.657520 60.661426 +X 144.157472 183.529896 67.923673 +X 0.000000 0.000000 0.000000 +X 7.103962 65.737384 -8.861603 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 0.144276 -0.014045 0.861844 +X 0.238780 -0.010450 0.652997 +X 0.000000 0.000000 0.000000 +X 0.251611 0.802240 1.677014 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -1.115230 8.314490 12.875277 +X 0.000000 0.000000 0.000000 +X 6.816460 5.488527 5.018616 +X 0.392362 10.211701 10.596488 +X 0.000000 0.000000 0.000000 +X 0.423834 9.901703 8.059593 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 26.309692 24.226985 -18.283826 +X -16.003357 15.447090 -12.183832 +X 0.000000 0.000000 0.000000 +X -147.131373 36.271695 -5.266624 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -116.834170 76.310061 -66.507902 +X 0.000000 0.000000 0.000000 +X -127.257711 -98.504679 -28.207764 +X -165.473473 61.087895 -101.401395 +X 0.000000 0.000000 0.000000 +X -22.806692 21.141949 -22.844315 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -53.483428 -85.829471 -90.169978 +X -21.887332 -62.846323 -28.571738 +X 0.000000 0.000000 0.000000 +X -3.905059 -169.519241 57.858858 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 175.174561 -61.309821 47.051440 +X 0.000000 0.000000 0.000000 +X 90.123002 101.067953 -186.065942 +X 80.969376 247.870796 -2.009471 +X 0.000000 0.000000 0.000000 +X -5.828751 1.522305 -21.873601 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 147.064506 -35.813560 223.654674 +X 119.657215 -39.067968 106.135984 +X 0.000000 0.000000 0.000000 +X 8.267670 69.947995 33.202507 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 89.656736 -60.176016 64.218917 +X 0.000000 0.000000 0.000000 +X -50.616209 -1.269468 0.507791 +X -76.911483 23.053444 -14.540758 +X 0.000000 0.000000 0.000000 +X -9.294567 -46.354682 -3.869234 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 134.766039 125.754194 63.760953 +X -6.543009 136.112088 73.828711 +X 0.000000 0.000000 0.000000 +X 43.764167 60.483779 99.465650 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -32.677565 143.026980 23.329332 +X 0.000000 0.000000 0.000000 +X 36.577971 -127.299428 -33.025917 +X 44.272830 -179.946281 -26.997101 +X 0.000000 0.000000 0.000000 +X 12.071836 -75.974404 -42.208087 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -34.283783 -118.277879 -49.142353 +X -73.848229 -28.541730 -118.097846 +X 0.000000 0.000000 0.000000 +X 22.921001 -62.842614 -58.663760 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -91.753504 48.178084 -64.208750 +X 0.000000 0.000000 0.000000 +X 0.680072 24.400048 104.546378 +X 112.781680 -0.758828 154.997079 +X 0.000000 0.000000 0.000000 +X 55.484525 -6.323827 56.320865 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 9.992097 96.300863 78.905857 +X -50.032243 111.233555 44.732442 +X 0.000000 0.000000 0.000000 +X 16.446809 18.709008 13.760930 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -25.032915 104.214452 -49.445010 +X 0.000000 0.000000 0.000000 +X 28.665912 -17.708959 -52.390666 +X 30.165775 -59.403083 -29.822584 +X 0.000000 0.000000 0.000000 +X -6.353623 -7.651943 -46.095064 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -1.198588 0.436080 -1.991836 +X -0.971383 0.015580 -1.647249 +X 0.000000 0.000000 0.000000 +X -8.630693 -9.186738 -17.604337 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -5.073322 -7.999180 -15.060571 +X 0.000000 0.000000 0.000000 +X -7.562032 -11.285283 -17.173114 +X -3.679774 -10.881691 -12.067956 +X 0.000000 0.000000 0.000000 +X -0.282075 -1.162941 -1.021512 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 35.420447 57.070473 44.683451 +X 84.207176 6.367661 66.705661 +X 0.000000 0.000000 0.000000 +X 12.333465 28.080065 -7.306715 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 130.267786 -52.362371 66.490143 +X 0.000000 0.000000 0.000000 +X 5.548249 -122.089979 17.109772 +X -37.868230 -46.272591 -94.760090 +X 0.000000 0.000000 0.000000 +X -2.333646 -30.964166 -11.813850 +X 0.000000 0.000000 0.000000 +2520 +-45476.024174 -30341.081517 -44365.485450 +X 0.000000 0.000000 0.000000 +X 27.308997 42.977886 169.176517 +X -15.029215 78.218561 124.920257 +X 0.000000 0.000000 0.000000 +X 65.062209 36.168598 127.974380 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -92.355022 99.361451 223.838309 +X 0.000000 0.000000 0.000000 +X 156.860951 -119.544700 -174.239801 +X 145.763964 -195.443412 -190.276542 +X 0.000000 0.000000 0.000000 +X -41.888237 -69.876919 -96.404215 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 55.395088 38.994608 154.744380 +X -5.733505 123.811547 127.433687 +X 0.000000 0.000000 0.000000 +X 109.074652 12.916087 149.120008 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -132.450024 100.749184 181.661495 +X 0.000000 0.000000 0.000000 +X 172.891840 -62.087138 -67.453637 +X 140.178385 -171.479912 -128.325266 +X 0.000000 0.000000 0.000000 +X -50.820135 -58.713231 -106.157089 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -38.470797 -43.322374 -94.536288 +X -132.689910 -71.963583 -89.501720 +X 0.000000 0.000000 0.000000 +X -63.045578 -100.948179 -113.997465 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -216.824548 -52.145775 -10.271737 +X 0.000000 0.000000 0.000000 +X 33.159472 0.035111 39.885016 +X 210.386153 -2.887099 92.786953 +X 0.000000 0.000000 0.000000 +X 68.599540 56.937774 101.074383 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 9.041412 -96.003596 -76.594367 +X -1.143668 -47.037537 -41.571380 +X 0.000000 0.000000 0.000000 +X 28.937843 -71.433744 -54.490229 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -9.350614 -72.904200 -54.681349 +X 0.000000 0.000000 0.000000 +X 207.152308 -102.409475 76.784803 +X 288.008880 -59.957082 26.602515 +X 0.000000 0.000000 0.000000 +X 71.808782 -24.656174 16.024660 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -53.552776 -55.605654 -135.026729 +X -115.742369 -72.085870 -69.884460 +X 0.000000 0.000000 0.000000 +X 13.235547 -75.795192 -66.114643 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -234.420443 -35.747446 6.226230 +X 0.000000 0.000000 0.000000 +X 160.927297 46.948560 151.810359 +X 318.694824 5.803419 53.017719 +X 0.000000 0.000000 0.000000 +X 34.149704 70.742013 112.606832 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -102.110565 -9.381200 -82.819084 +X -45.308818 -20.858177 -30.081614 +X 0.000000 0.000000 0.000000 +X -52.261395 -44.591313 -57.834364 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -13.635010 22.948806 -52.795707 +X 0.000000 0.000000 0.000000 +X 60.175593 -8.594481 -74.614415 +X -121.934353 132.049114 140.061812 +X 0.000000 0.000000 0.000000 +X -1.380194 44.270153 32.903603 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 63.453080 117.511040 -6.773801 +X 111.336496 104.746292 38.353238 +X 0.000000 0.000000 0.000000 +X -58.875181 141.749522 86.230431 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 132.477228 95.580908 20.593424 +X 0.000000 0.000000 0.000000 +X -169.410253 -17.284464 -109.917202 +X -252.145018 -68.020093 -90.397885 +X 0.000000 0.000000 0.000000 +X -86.689168 -33.638552 -22.282696 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 117.296244 72.805152 154.194446 +X 21.123248 97.686338 112.348813 +X 0.000000 0.000000 0.000000 +X 142.006014 37.606699 109.979990 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -136.930288 99.479471 179.368040 +X 0.000000 0.000000 0.000000 +X 83.568594 -92.872388 -73.476567 +X 79.254247 -168.434735 -163.712349 +X 0.000000 0.000000 0.000000 +X -45.414805 -64.002693 -102.323018 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 42.205082 241.698137 222.496405 +X -25.670296 123.920616 140.962996 +X 0.000000 0.000000 0.000000 +X -91.246809 62.184372 196.929936 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -65.468819 112.785693 160.362088 +X 0.000000 0.000000 0.000000 +X -16.630320 -136.655144 -81.514306 +X 106.245868 -156.684254 -81.542544 +X 0.000000 0.000000 0.000000 +X -37.022971 -69.020000 -86.192414 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 110.144963 92.634130 233.435016 +X 21.623541 66.507698 112.992875 +X 0.000000 0.000000 0.000000 +X 157.859625 39.898231 47.963692 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -67.693349 126.429569 92.079336 +X 0.000000 0.000000 0.000000 +X -17.987654 -89.447486 -184.066389 +X 66.998243 -145.716634 -208.345037 +X 0.000000 0.000000 0.000000 +X 17.210942 -33.677448 -83.082678 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -136.459551 -65.551863 -48.249984 +X 2.364444 -100.359714 -150.439849 +X 0.000000 0.000000 0.000000 +X -107.387330 -69.015229 -75.247403 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 86.347929 -64.856156 -174.878379 +X 0.000000 0.000000 0.000000 +X -42.750485 151.082413 -5.940216 +X -110.078455 180.437551 143.864824 +X 0.000000 0.000000 0.000000 +X 15.097550 92.480048 57.729511 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -28.523981 83.810711 59.877291 +X 129.592696 70.969300 103.343782 +X 0.000000 0.000000 0.000000 +X 4.876255 136.369807 79.021729 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 199.307432 40.086775 -48.006461 +X 0.000000 0.000000 0.000000 +X -217.225360 -0.595345 77.504292 +X -277.435280 -27.945146 -5.032588 +X 0.000000 0.000000 0.000000 +X -55.025234 -70.361987 -88.990892 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -0.884090 9.416773 -7.467261 +X 40.933073 -54.632906 -112.662021 +X 0.000000 0.000000 0.000000 +X -237.347477 -81.106476 -110.712386 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -165.596735 47.719968 -136.434358 +X 0.000000 0.000000 0.000000 +X -262.198205 239.954537 103.190580 +X -283.411489 166.517460 121.784020 +X 0.000000 0.000000 0.000000 +X 11.840710 80.627746 55.296558 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -30.455640 -139.545996 -186.087643 +X -141.014688 -27.331266 -94.717166 +X 0.000000 0.000000 0.000000 +X -6.186666 -36.302423 -163.863629 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -159.662121 31.613145 -83.508275 +X 0.000000 0.000000 0.000000 +X -18.326768 84.211087 183.766578 +X 242.176697 23.257779 21.085199 +X 0.000000 0.000000 0.000000 +X 84.372511 30.835561 93.871993 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 51.683341 21.496839 23.420275 +X -40.984302 112.700598 100.015363 +X 0.000000 0.000000 0.000000 +X 179.863080 55.537481 27.803583 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 255.763093 99.073602 64.559934 +X 0.000000 0.000000 0.000000 +X 342.098282 -49.010684 -183.254047 +X 294.861609 -106.035907 -159.338668 +X 0.000000 0.000000 0.000000 +X -23.527241 -29.364736 -95.219253 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 9.610435 -71.793688 -106.856770 +X 7.551662 -31.542130 -64.203624 +X 0.000000 0.000000 0.000000 +X 2.080092 -22.418007 -91.396717 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -7.216600 3.439144 -65.047456 +X 0.000000 0.000000 0.000000 +X 100.973323 33.294145 115.207053 +X 234.934282 -6.607522 40.406269 +X 0.000000 0.000000 0.000000 +X 18.432519 44.157454 41.825433 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -67.191686 -94.646128 -52.712836 +X -155.464402 -53.964988 6.275251 +X 0.000000 0.000000 0.000000 +X -15.498275 -79.129088 -19.694321 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -202.885462 -9.826837 75.880890 +X 0.000000 0.000000 0.000000 +X -10.399458 -43.773563 101.958454 +X 93.286632 -33.845575 34.671768 +X 0.000000 0.000000 0.000000 +X -12.751775 50.420669 57.001210 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -34.525163 -90.805219 -165.405844 +X -113.400173 -54.795031 -102.740013 +X 0.000000 0.000000 0.000000 +X 34.809330 -114.812416 -100.856489 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -148.723461 -22.673748 -31.143828 +X 0.000000 0.000000 0.000000 +X 138.452667 -76.189179 181.640487 +X 204.439069 -25.907826 83.290841 +X 0.000000 0.000000 0.000000 +X 64.267306 -22.541552 82.817087 +X 0.000000 0.000000 0.000000 +2520 +-56697.300029 -47285.923113 -44196.047242 +X 0.000000 0.000000 0.000000 +X 33.811065 3.695001 -23.415437 +X 13.372245 1.648636 -19.356363 +X 0.000000 0.000000 0.000000 +X -1.746472 -3.967319 -148.987500 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 24.928383 41.785264 -45.095290 +X 0.000000 0.000000 0.000000 +X 76.818217 -96.826077 -183.597643 +X -12.442749 -95.190466 -52.766125 +X 0.000000 0.000000 0.000000 +X -58.852569 6.968238 -12.854190 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 5.530253 -0.336970 -0.179682 +X -19.432915 3.382087 -26.314714 +X 0.000000 0.000000 0.000000 +X -154.530736 69.727116 -171.135266 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -90.664199 61.160990 -63.077731 +X 0.000000 0.000000 0.000000 +X -133.837829 94.843654 -106.291085 +X -125.964236 48.133427 -66.617125 +X 0.000000 0.000000 0.000000 +X -17.018100 12.795089 -0.922668 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 4.603423 3.643146 -8.103346 +X 5.771637 -3.914979 -9.928186 +X 0.000000 0.000000 0.000000 +X 61.429447 -6.725418 -43.771908 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 66.555774 70.404475 -167.611365 +X 0.000000 0.000000 0.000000 +X 29.732549 -16.564531 -6.154155 +X 28.889578 23.605349 -106.960655 +X 0.000000 0.000000 0.000000 +X 3.333532 10.623696 -24.941907 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 30.949566 51.850809 27.434569 +X 20.167299 19.328007 14.748772 +X 0.000000 0.000000 0.000000 +X 116.315469 -64.102980 -33.240000 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 57.951962 22.755916 -7.716998 +X 0.000000 0.000000 0.000000 +X 245.229050 -140.672697 -43.762843 +X 52.039852 -87.057903 36.744208 +X 0.000000 0.000000 0.000000 +X -64.848373 7.901842 -68.435434 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 176.786924 295.022530 109.290846 +X 32.760067 189.037235 115.937152 +X 0.000000 0.000000 0.000000 +X 57.596236 418.766394 518.654837 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 6.318451 288.331187 311.081868 +X 0.000000 0.000000 0.000000 +X -298.308377 671.157174 335.109707 +X -121.014673 185.172686 235.203467 +X 0.000000 0.000000 0.000000 +X -59.399960 21.964394 179.685420 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -6.390202 -27.115906 18.461931 +X 5.660049 -0.114102 36.657924 +X 0.000000 0.000000 0.000000 +X 48.043784 65.404356 157.503937 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 13.133766 29.906928 63.298186 +X 0.000000 0.000000 0.000000 +X 50.524972 10.283662 70.034389 +X 39.221507 26.407797 48.160603 +X 0.000000 0.000000 0.000000 +X 7.399822 11.652400 10.839381 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -117.277263 -88.769719 -37.533446 +X -207.223252 -73.771979 -39.387143 +X 0.000000 0.000000 0.000000 +X -176.345698 -168.207528 36.903088 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -197.593952 -15.354591 -135.413825 +X 0.000000 0.000000 0.000000 +X -50.918905 117.329972 -48.234799 +X -28.174333 -17.688659 -41.660623 +X 0.000000 0.000000 0.000000 +X 43.012331 120.319089 -85.189252 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 851.944460 -1019.286366 553.938268 +X 336.832098 -212.148157 176.642077 +X 0.000000 0.000000 0.000000 +X -77.830952 -25.249021 47.516106 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 122.683114 -198.436902 239.307034 +X 0.000000 0.000000 0.000000 +X 235.098128 -98.954064 12.977758 +X 86.148374 95.686766 -126.576061 +X 0.000000 0.000000 0.000000 +X 133.625883 26.637143 -30.610698 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -430.768747 68.693248 179.715058 +X -420.644431 -112.706002 94.038849 +X 0.000000 0.000000 0.000000 +X -205.796255 108.320088 150.208707 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 108.933794 -91.096131 177.419831 +X 0.000000 0.000000 0.000000 +X -295.842252 -139.526118 -341.028705 +X 72.969524 434.249873 -615.547850 +X 0.000000 0.000000 0.000000 +X 170.747075 166.840573 -146.648116 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 372.535826 947.816520 -471.286013 +X 124.813835 312.022862 -155.011136 +X 0.000000 0.000000 0.000000 +X -128.500689 30.078507 -513.048156 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 334.666132 54.786640 -176.861440 +X 0.000000 0.000000 0.000000 +X -193.546531 319.949466 -188.108418 +X -410.911890 -193.548788 -112.539142 +X 0.000000 0.000000 0.000000 +X -209.043746 -175.022252 71.843580 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -4.062821 -80.334562 99.079826 +X -1.372505 -63.726498 29.252031 +X 0.000000 0.000000 0.000000 +X 16.329984 -193.715132 39.774120 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -11.027306 -53.731296 12.139966 +X 0.000000 0.000000 0.000000 +X 6.887811 -35.818666 -3.894781 +X -1.577521 -31.560600 -0.265858 +X 0.000000 0.000000 0.000000 +X -2.729084 -5.458957 -1.143041 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 1158.534347 -252.401132 470.599683 +X 370.552456 -87.582552 159.020010 +X 0.000000 0.000000 0.000000 +X 315.657107 -307.147362 -313.094260 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 362.805022 -517.940636 -156.170383 +X 0.000000 0.000000 0.000000 +X -21.651880 5.100123 499.454421 +X -63.802039 -435.949960 -44.564371 +X 0.000000 0.000000 0.000000 +X -56.587893 -284.299426 161.149799 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 31.318337 379.310714 -231.396592 +X 36.706289 109.915834 -94.309910 +X 0.000000 0.000000 0.000000 +X 43.981941 -6.116894 -136.425029 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 74.455167 -24.506363 -78.346020 +X 0.000000 0.000000 0.000000 +X -242.356122 131.620918 -37.125518 +X -340.669710 -197.776473 3.924639 +X 0.000000 0.000000 0.000000 +X -194.433067 -65.922511 8.232299 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 471.730786 478.078235 -200.681510 +X 273.329399 138.331342 -1.289555 +X 0.000000 0.000000 0.000000 +X 189.847263 219.372727 -324.690952 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 302.178468 53.917447 21.556612 +X 0.000000 0.000000 0.000000 +X -364.377772 251.799178 -81.674558 +X -522.562117 -129.323641 -44.000909 +X 0.000000 0.000000 0.000000 +X -133.113707 -78.786903 123.711423 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -170.215741 -66.583304 256.351650 +X -166.159846 -143.255907 125.543117 +X 0.000000 0.000000 0.000000 +X -16.533775 73.606723 145.921440 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 84.273127 -16.738233 60.792332 +X 0.000000 0.000000 0.000000 +X 181.478686 58.850283 -332.647464 +X 106.940102 345.225885 -410.081902 +X 0.000000 0.000000 0.000000 +X 129.225514 110.526660 -148.484796 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 79.652655 98.269055 -180.856527 +X 202.754950 145.057292 -75.997650 +X 0.000000 0.000000 0.000000 +X 181.809252 11.143727 -141.919601 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 237.104734 -99.965105 91.553664 +X 0.000000 0.000000 0.000000 +X -433.273237 68.241751 5.550191 +X -565.635605 -224.764055 -16.834080 +X 0.000000 0.000000 0.000000 +X -234.271519 -136.487780 119.603653 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 341.303175 -0.379558 4.588710 +X 228.591401 80.311213 44.814279 +X 0.000000 0.000000 0.000000 +X 837.025551 -365.890791 513.050880 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 68.133546 88.060307 145.719209 +X 0.000000 0.000000 0.000000 +X 188.055893 12.096409 207.882848 +X 46.149675 26.457461 209.774649 +X 0.000000 0.000000 0.000000 +X -26.589733 7.838762 19.866327 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 4.026503 47.128592 -27.348601 +X -14.164608 44.831189 -32.552403 +X 0.000000 0.000000 0.000000 +X -643.576556 494.768528 -349.204255 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -178.312180 120.888519 -10.068773 +X 0.000000 0.000000 0.000000 +X -307.365793 180.610983 -194.122533 +X -263.862215 86.634049 -93.778131 +X 0.000000 0.000000 0.000000 +X -60.624528 25.644172 8.723359 +X 0.000000 0.000000 0.000000 +2520 +-84156.552651 -164917.239221 -81173.798530 +X 0.000000 0.000000 0.000000 +X -212.709566 175.458787 82.802422 +X -284.159342 284.139905 -61.634620 +X 0.000000 0.000000 0.000000 +X -157.558064 191.940556 20.989108 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -234.924093 -10.175733 -264.652213 +X 0.000000 0.000000 0.000000 +X 127.628072 -463.169469 -648.794327 +X 432.208070 -612.325813 -101.683408 +X 0.000000 0.000000 0.000000 +X 231.517445 -222.350117 -192.664628 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 376.805978 480.619051 -245.111243 +X 172.984677 163.381276 -69.934821 +X 0.000000 0.000000 0.000000 +X 232.578412 630.043474 -119.058201 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 61.172537 140.398173 -65.289226 +X 0.000000 0.000000 0.000000 +X 386.659218 -463.788345 276.384291 +X 141.094134 -174.644457 113.453025 +X 0.000000 0.000000 0.000000 +X 16.726878 -216.833194 390.884057 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -114.570593 -208.068075 88.198199 +X 1.783538 -323.082552 187.637317 +X 0.000000 0.000000 0.000000 +X -639.450275 -536.483774 -640.041510 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -908.573043 18.797138 -481.310522 +X 0.000000 0.000000 0.000000 +X -766.936449 -318.450706 -863.790223 +X -1114.510352 706.668764 -853.988384 +X 0.000000 0.000000 0.000000 +X -69.243716 467.064760 -105.325150 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 36.247087 18.273941 25.733467 +X -17.965418 36.013687 22.896575 +X 0.000000 0.000000 0.000000 +X -197.336563 57.646886 13.830432 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -81.455134 2.861431 171.119277 +X 0.000000 0.000000 0.000000 +X -98.036526 -80.536383 154.919601 +X -201.257623 -51.374249 197.211980 +X 0.000000 0.000000 0.000000 +X -58.945909 -97.657637 -2.705603 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -341.603814 307.437696 137.200968 +X -271.580250 421.732064 1.938897 +X 0.000000 0.000000 0.000000 +X -277.667916 310.494802 63.050630 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -600.379752 430.372322 -118.116702 +X 0.000000 0.000000 0.000000 +X 457.254284 -70.379867 183.224349 +X 628.506787 -755.295178 154.251447 +X 0.000000 0.000000 0.000000 +X 255.213569 -222.981913 -27.419515 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 73.186858 -186.390860 -314.913188 +X -28.661494 -233.442509 -262.793240 +X 0.000000 0.000000 0.000000 +X 7.802866 -111.584468 -178.020666 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -280.129803 -151.451123 -363.889105 +X 0.000000 0.000000 0.000000 +X -67.142795 174.015992 260.708995 +X -142.364089 363.106468 375.076690 +X 0.000000 0.000000 0.000000 +X -1003.159819 218.684763 -311.061311 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -106.378302 -479.546466 139.832535 +X 67.414705 -382.513056 56.115325 +X 0.000000 0.000000 0.000000 +X -28.648583 -225.220576 302.107517 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 72.307055 151.489693 354.184784 +X 0.000000 0.000000 0.000000 +X -258.886749 -6.258233 -814.700040 +X -349.527628 800.814567 -163.623997 +X 0.000000 0.000000 0.000000 +X -140.435982 318.199613 -172.869774 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 202.442243 -218.014316 -273.076451 +X 141.673068 -335.455014 -184.608328 +X 0.000000 0.000000 0.000000 +X 234.405280 -256.255020 -89.152150 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -186.768329 -17.813014 -353.222713 +X 0.000000 0.000000 0.000000 +X 340.043575 -196.302538 1050.369237 +X 133.187447 765.623350 763.840952 +X 0.000000 0.000000 0.000000 +X 43.889147 219.699697 37.899701 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 308.551353 -210.609476 -182.199207 +X 163.701959 -369.765125 -233.587346 +X 0.000000 0.000000 0.000000 +X 267.907122 -355.851587 -190.718759 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -4.236452 -377.874342 -414.997060 +X 0.000000 0.000000 0.000000 +X 63.604037 -15.129385 526.760929 +X 41.878884 579.205930 438.468857 +X 0.000000 0.000000 0.000000 +X -168.058027 298.606173 215.577742 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -118.201958 332.064684 150.445850 +X -170.238979 462.431717 -49.790820 +X 0.000000 0.000000 0.000000 +X -144.210710 345.515132 233.636978 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -423.248954 17.135158 -368.101297 +X 0.000000 0.000000 0.000000 +X 813.154548 447.865935 282.649773 +X 316.751240 -435.041774 75.250313 +X 0.000000 0.000000 0.000000 +X -400.120722 -1217.822946 -739.925730 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 252.379302 -967.566154 195.832551 +X 165.374132 -440.387311 -81.194407 +X 0.000000 0.000000 0.000000 +X 1090.181020 -656.628904 1187.318498 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 852.777042 -239.970894 255.933533 +X 0.000000 0.000000 0.000000 +X -470.133389 199.856816 624.592641 +X 483.767898 319.543115 344.764648 +X 0.000000 0.000000 0.000000 +X -279.042244 277.494657 -241.434930 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -167.189134 236.170853 137.292711 +X -261.428930 435.637742 -9.668643 +X 0.000000 0.000000 0.000000 +X -229.152195 314.354642 142.644824 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -507.933998 298.459084 -269.907863 +X 0.000000 0.000000 0.000000 +X 663.023662 112.494977 414.018983 +X 579.409778 -726.282716 245.314329 +X 0.000000 0.000000 0.000000 +X 229.012597 -228.173531 56.193504 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 125.392060 419.314603 -39.749191 +X 102.110081 385.902253 -249.193872 +X 0.000000 0.000000 0.000000 +X 60.630312 594.236789 42.440970 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -322.928264 226.846682 -225.960052 +X 0.000000 0.000000 0.000000 +X 903.877940 20.017690 384.769442 +X 175.004331 -544.051757 547.578664 +X 0.000000 0.000000 0.000000 +X 64.377902 -315.780929 115.626695 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -26.023892 369.946494 61.550718 +X -40.978690 392.081071 -113.784134 +X 0.000000 0.000000 0.000000 +X -50.880987 439.640267 108.211767 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -413.324776 -75.639287 -66.548137 +X 0.000000 0.000000 0.000000 +X 596.911174 106.401677 163.094633 +X 228.464891 -689.343999 407.921084 +X 0.000000 0.000000 0.000000 +X 82.622143 -501.481427 82.923138 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 263.259207 -430.084774 -55.115707 +X 61.637839 -404.038601 -195.525122 +X 0.000000 0.000000 0.000000 +X 205.902115 -574.939959 -255.273340 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -58.982495 -348.285743 -551.185309 +X 0.000000 0.000000 0.000000 +X -399.401553 -208.820087 338.034834 +X 64.973077 587.487643 366.281151 +X 0.000000 0.000000 0.000000 +X 16.506995 301.926875 218.504636 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -111.017596 402.690593 130.241966 +X -142.194853 528.956056 -99.873683 +X 0.000000 0.000000 0.000000 +X -259.350855 663.368047 81.789682 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -169.844114 -37.966915 -65.270098 +X 0.000000 0.000000 0.000000 +X 1089.888787 942.644722 764.960487 +X 643.268547 -97.900953 876.252408 +X 0.000000 0.000000 0.000000 +X 507.021328 -367.648856 522.709160 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 161.042570 -112.061838 -17.641520 +X 60.008754 -66.855536 -43.268839 +X 0.000000 0.000000 0.000000 +X 48.932245 -30.480735 -28.480051 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -13.518322 -107.847793 -165.791605 +X 0.000000 0.000000 0.000000 +X -55.767576 39.934052 -10.684956 +X -2.417657 126.345002 64.432722 +X 0.000000 0.000000 0.000000 +X -81.959022 79.122233 -23.590343 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X -211.797981 -406.338657 267.558691 +X -101.247853 -153.544334 182.839098 +X 0.000000 0.000000 0.000000 +X -5.685647 -183.939449 459.620353 +X 0.000000 0.000000 0.000000 +X 0.000000 0.000000 0.000000 +X 36.608263 127.016851 195.874176 +X 0.000000 0.000000 0.000000 +X 264.380256 692.583820 44.258247 +X 518.702731 111.235195 486.187740 +X 0.000000 0.000000 0.000000 +X 285.029859 155.441974 194.080695 +X 0.000000 0.000000 0.000000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/plumed.dat b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/plumed.dat new file mode 100644 index 0000000000..4147aeb8e2 --- /dev/null +++ b/plugins/openaccPTM/regtest/targetGPU/rt-GPU-sheet-scalar/plumed.dat @@ -0,0 +1,10 @@ +LOAD FILE=../../../../plumedOpenACC.so +MOLINFO STRUCTURE=amyloid.pdb +b1: ANTIBETARMSD RESIDUES=all STRANDS_CUTOFF=1 R_0=0.1 USEGPU +b3: ANTIBETARMSD RESIDUES=all STYLE=inter NOPBC STRANDS_CUTOFF=1.2 R_0=0.12 USEGPU +b5: ANTIBETARMSD RESIDUES=all STYLE=intra R_0=0.1 STRANDS_CUTOFF=0 USEGPU +p1: PARABETARMSD RESIDUES=all STRANDS_CUTOFF=1 R_0=0.1 USEGPU +p3: PARABETARMSD RESIDUES=all STYLE=inter NOPBC R_0=0.1 STRANDS_CUTOFF=0 USEGPU +p4: PARABETARMSD RESIDUES=all STRANDS_CUTOFF=1 LESS_THAN={RATIONAL R_0=0.1 NN=8 MM=12} USEGPU +RESTRAINT ARG=b1,b3,b5,p1,p3,p4.lessthan AT=0,0,0,0,0,0 KAPPA=1,2,3,4,5,6 +PRINT ARG=b1,b3,b5,p1,p3,p4.lessthan FILE=colvar FMT=%10.6f diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-adjmat-matprod-nogather/plumed.dat b/plugins/openaccPTM/regtest/targetGPU/rt-adjmat-matprod-nogather/plumed.dat index 0043a09e12..5e2f37c932 100644 --- a/plugins/openaccPTM/regtest/targetGPU/rt-adjmat-matprod-nogather/plumed.dat +++ b/plugins/openaccPTM/regtest/targetGPU/rt-adjmat-matprod-nogather/plumed.dat @@ -3,7 +3,7 @@ LOAD FILE=../../../../plumedOpenACC.so UNITS LENGTH=A w: CONTACT_MATRIX GROUPA=1,2 GROUPB=3,4,5,6,7,8,9,10,11,12,13,14 SWITCH={CUSTOM FUNC=1/(1+exp((x-4.3)/0.3)) R_0=1} wt: TRANSPOSE ARG=w -m: MATRIX_PRODUCT ARG=w,wt USEGPU +m: MATRIX_PRODUCT ARG=w,wt USEGPU AVOID_THREAD_GATHER s: SUM ARG=m PERIODIC=NO bv: BIASVALUE ARG=s PRINT FILE=colvar ARG=s FMT=%8.4f diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-nbonds-one-q6/forces.reference b/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-nbonds-one-q6/forces.reference index 2e600497ca..80c18ab86c 100644 --- a/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-nbonds-one-q6/forces.reference +++ b/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-nbonds-one-q6/forces.reference @@ -1,66 +1,66 @@ 64 - -0.0001 -0.0000 0.0001 -X 0.0000 0.0000 0.0000 -X 0.0000 0.0000 -0.0000 -X -0.0000 -0.0000 0.0000 -X 0.0000 -0.0000 -0.0000 -X 0.0000 -0.0000 -0.0000 -X 0.0000 0.0000 -0.0000 -X 0.0000 -0.0000 -0.0000 -X -0.0000 0.0000 -0.0000 + -0.0000 0.0000 -0.0000 X -0.0000 0.0000 -0.0000 -X 0.0000 0.0000 -0.0000 +X -0.0000 -0.0000 -0.0000 X -0.0000 -0.0000 0.0000 X -0.0000 -0.0000 -0.0000 -X 0.0000 -0.0000 0.0000 +X -0.0000 -0.0000 0.0000 +X -0.0000 -0.0000 0.0000 X -0.0000 -0.0000 -0.0000 X 0.0000 -0.0000 0.0000 -X 0.0000 0.0000 0.0000 -X -0.0000 0.0000 -0.0000 +X 0.0000 0.0000 -0.0000 X -0.0000 0.0000 0.0000 -X -0.0000 -0.0000 -0.0000 +X 0.0000 -0.0000 0.0000 X 0.0000 0.0000 0.0000 -X -0.0000 0.0000 0.0000 X -0.0000 -0.0000 -0.0000 X 0.0000 -0.0000 0.0000 -X -0.0000 -0.0000 0.0000 -X -0.0000 -0.0000 0.0000 +X -0.0000 -0.0000 -0.0000 +X 0.0000 -0.0000 0.0000 X -0.0000 0.0000 0.0000 X 0.0000 0.0000 0.0000 +X -0.0000 0.0000 -0.0000 X 0.0000 -0.0000 -0.0000 X 0.0000 0.0000 -0.0000 -X -0.0000 -0.0000 0.0000 -X 0.0000 0.0000 0.0000 +X 0.0000 -0.0000 -0.0000 +X -0.0000 0.0000 0.0000 X 0.0000 0.0000 0.0000 -X 0.0000 -0.0000 0.0000 X -0.0000 0.0000 -0.0000 +X 0.0000 -0.0000 0.0000 X 0.0000 0.0000 0.0000 -X -0.0000 0.0000 -0.0000 -X -0.0000 -0.0000 0.0000 -X -0.0000 -0.0000 -0.0000 -X -0.0000 -0.0000 0.0000 +X 0.0000 -0.0000 0.0000 X 0.0000 0.0000 0.0000 X 0.0000 0.0000 0.0000 X 0.0000 0.0000 -0.0000 +X -0.0000 -0.0000 -0.0000 +X 0.0000 0.0000 0.0000 X 0.0000 0.0000 -0.0000 +X -0.0000 0.0000 0.0000 X 0.0000 0.0000 0.0000 -X 0.0000 -0.0000 -0.0000 +X -0.0000 0.0000 0.0000 +X 0.0000 0.0000 -0.0000 +X -0.0000 0.0000 -0.0000 +X -0.0000 0.0000 0.0000 X -0.0000 -0.0000 -0.0000 +X 0.0000 0.0000 0.0000 X -0.0000 0.0000 -0.0000 +X 0.0000 -0.0000 -0.0000 +X 0.0000 0.0000 0.0000 X -0.0000 -0.0000 -0.0000 -X 0.0000 0.0000 -0.0000 X -0.0000 0.0000 0.0000 -X 0.0000 0.0000 0.0000 -X 0.0000 -0.0000 0.0000 +X -0.0000 0.0000 -0.0000 X 0.0000 -0.0000 0.0000 -X -0.0000 -0.0000 -0.0000 +X -0.0000 -0.0000 0.0000 +X -0.0000 -0.0000 0.0000 +X 0.0000 -0.0000 -0.0000 X 0.0000 0.0000 -0.0000 +X 0.0000 -0.0000 0.0000 X 0.0000 0.0000 0.0000 X -0.0000 0.0000 0.0000 -X 0.0000 -0.0000 -0.0000 +X 0.0000 -0.0000 0.0000 +X 0.0000 0.0000 0.0000 X 0.0000 0.0000 -0.0000 X -0.0000 -0.0000 -0.0000 -X -0.0000 -0.0000 -0.0000 -X 0.0000 0.0000 0.0000 -X -0.0000 0.0000 0.0000 +X 0.0000 -0.0000 -0.0000 +X 0.0000 0.0000 -0.0000 +X -0.0000 0.0000 -0.0000 X 0.0000 -0.0000 0.0000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-nbonds-q6/forces.reference b/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-nbonds-q6/forces.reference index a9482b974a..5e4d38090a 100644 --- a/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-nbonds-q6/forces.reference +++ b/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-nbonds-q6/forces.reference @@ -1,66 +1,66 @@ 64 - -0.001 0.001 0.001 -X -0.000 -0.000 -0.000 -X 0.000 0.000 0.000 -X 0.000 -0.000 0.000 -X -0.000 0.000 -0.000 -X 0.000 -0.000 0.000 + -0.000 -0.000 0.000 +X -0.000 -0.000 0.000 X 0.000 -0.000 0.000 +X -0.000 -0.000 0.000 +X -0.000 -0.000 -0.000 X -0.000 0.000 0.000 -X 0.000 0.000 0.000 +X 0.000 -0.000 0.000 +X -0.000 -0.000 0.000 +X -0.000 -0.000 0.000 X -0.000 0.000 0.000 X 0.000 0.000 0.000 -X -0.000 0.000 0.000 X 0.000 -0.000 -0.000 +X -0.000 0.000 -0.000 X 0.000 0.000 -0.000 +X 0.000 -0.000 0.000 +X -0.000 0.000 0.000 X -0.000 -0.000 0.000 X -0.000 0.000 -0.000 -X 0.000 -0.000 0.000 X 0.000 0.000 0.000 X -0.000 0.000 -0.000 +X -0.000 -0.000 -0.000 +X -0.000 0.000 0.000 X 0.000 -0.000 -0.000 X 0.000 0.000 0.000 -X -0.000 0.000 0.000 X 0.000 0.000 -0.000 +X -0.000 0.000 -0.000 X -0.000 -0.000 0.000 -X -0.000 -0.000 0.000 -X -0.000 -0.000 -0.000 -X -0.000 -0.000 -0.000 X 0.000 -0.000 -0.000 -X 0.000 -0.000 -0.000 -X 0.000 -0.000 -0.000 -X -0.000 -0.000 0.000 -X 0.000 -0.000 0.000 -X -0.000 -0.000 -0.000 X 0.000 -0.000 0.000 +X 0.000 0.000 0.000 +X 0.000 0.000 -0.000 X -0.000 0.000 0.000 -X -0.000 0.000 -0.000 +X 0.000 0.000 -0.000 X 0.000 0.000 0.000 +X -0.000 -0.000 0.000 X 0.000 -0.000 -0.000 X 0.000 0.000 -0.000 -X -0.000 0.000 -0.000 X -0.000 -0.000 0.000 -X 0.000 0.000 -0.000 -X 0.000 -0.000 -0.000 +X 0.000 -0.000 0.000 X 0.000 -0.000 -0.000 +X 0.000 0.000 -0.000 +X -0.000 -0.000 0.000 X 0.000 0.000 0.000 X -0.000 0.000 0.000 +X -0.000 -0.000 0.000 X 0.000 0.000 0.000 -X 0.000 -0.000 0.000 +X 0.000 -0.000 -0.000 +X -0.000 0.000 -0.000 +X -0.000 0.000 -0.000 X -0.000 -0.000 0.000 -X -0.000 -0.000 -0.000 -X -0.000 -0.000 -0.000 X 0.000 0.000 -0.000 +X -0.000 -0.000 0.000 +X 0.000 -0.000 0.000 X 0.000 0.000 0.000 X 0.000 -0.000 0.000 -X -0.000 -0.000 -0.000 -X 0.000 0.000 -0.000 -X -0.000 -0.000 0.000 -X 0.000 0.000 -0.000 -X -0.000 0.000 -0.000 -X -0.000 0.000 0.000 +X 0.000 0.000 0.000 X -0.000 0.000 -0.000 -X -0.000 0.000 0.000 X -0.000 -0.000 0.000 -X 0.000 0.000 -0.000 +X -0.000 0.000 -0.000 X 0.000 0.000 0.000 +X -0.000 -0.000 -0.000 +X -0.000 -0.000 -0.000 +X 0.000 -0.000 0.000 +X -0.000 0.000 -0.000 +X 0.000 -0.000 0.000 diff --git a/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-rt-q6-minthreadgather/plumed.dat b/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-rt-q6-minthreadgather/plumed.dat index 021b2570a1..8bf5f78dce 100644 --- a/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-rt-q6-minthreadgather/plumed.dat +++ b/plugins/openaccPTM/regtest/targetGPU/rt-symfunc-rt-q6-minthreadgather/plumed.dat @@ -1,4 +1,5 @@ LOAD FILE=../../../../plumedOpenACC.so +# the chain of Q6 written out (Q6 USEGPU computes the sums without the matrix), on the GPU # Compute sigma(r_ij) and the (x_ij,y_ij,z_ij) vectors q6mat: CONTACT_MATRIX ... @@ -6,10 +7,10 @@ GROUP=@mdatoms COMPONENTS USEGPU SWITCH={RATIONAL D_0=3.0 R_0=1.5} ... # Evaluate the Y_l^m values for each bond -q6sh: SPHERICAL_HARMONIC ARG=q6mat.x,q6mat.y,q6mat.z,q6mat.w L=6 +q6sh: SPHERICAL_HARMONIC ARG=q6mat.x,q6mat.y,q6mat.z,q6mat.w L=6 USEGPU # Calculate the vector of q_lm(i) values aones: ONES SIZE=@natoms -q6sp: MATRIX_VECTOR_PRODUCT ARG=q6sh.*,aones +q6sp: MATRIX_VECTOR_PRODUCT ARG=q6sh.*,aones USEGPU # Evaluate the |q_l(i)| values q6norm2: COMBINE ... PERIODIC=NO ARG=q6sp.* diff --git a/plugins/openaccPTM/src/ACCDevice.cpp b/plugins/openaccPTM/src/ACCDevice.cpp index 5fd1a34173..a6c99b6e82 100644 --- a/plugins/openaccPTM/src/ACCDevice.cpp +++ b/plugins/openaccPTM/src/ACCDevice.cpp @@ -27,6 +27,8 @@ #include +#include + #if defined(PLUMED_OPENACC_GPU) && defined(__linux__) #include #endif @@ -99,6 +101,32 @@ class NoCurrentContext { NoCurrentContext& operator=(const NoCurrentContext&)=delete; }; +/// The rank of this process among the processes of its node, as set by the MPI launcher +/// in the environment (-1 if not set); var is the variable it was read from +int localRank(const char*& var) { + // the variables of the launchers first: SLURM_LOCALID is also set (to 0) in the batch + // step of a job, where a launcher like OpenMPI's mpirun may be used + static const char* const vars[]= {"OMPI_COMM_WORLD_LOCAL_RANK","MV2_COMM_WORLD_LOCAL_RANK","MPI_LOCALRANKID", + "PMI_LOCAL_RANK","PALS_LOCAL_RANKID","FLUX_TASK_LOCAL_ID","SLURM_LOCALID" + }; + for(const char* v : vars) { + if(const char* e=std::getenv(v)) { + char* end=nullptr; + const long r=std::strtol(e,&end,10); + if(end!=e && *end=='\0' && r>=0) { + var=v; + return static_cast(r); + } + } + } + return -1; +} + +/// True if the user chose the OpenACC device with the environment +bool deviceSetInEnvironment() { + return std::getenv("ACC_DEVICE_NUM") || std::getenv("NVCOMPILER_ACC_DEVICE_NUM") || std::getenv("PGI_ACC_DEVICE_NUM"); +} + } int currentCudaDevice() { @@ -125,6 +153,15 @@ int Device::resolve(const Action& action) { } else if(caller>=0 && caller1 && !deviceSetInEnvironment()) ? localRank(var) : -1; + if(lr>=0) { + id_=lr%ndevices; + action.log.printf(" %s runs on GPU %d (process %d of the node, from %s, with %d GPUs)\n", + action.getLabel().c_str(),id_,lr,var,ndevices); + return id_; + } id_=acc_get_device_num(acc_device_not_host); } action.log.printf(" %s runs on GPU %d\n",action.getLabel().c_str(),id_); diff --git a/plugins/openaccPTM/src/ACCDevice.h b/plugins/openaccPTM/src/ACCDevice.h index e05a32d254..b77660c2b0 100644 --- a/plugins/openaccPTM/src/ACCDevice.h +++ b/plugins/openaccPTM/src/ACCDevice.h @@ -33,8 +33,11 @@ and every part of the plugin follows them in the same way: time it is needed with Device::resolve(action), which also writes it in the log of the action ("