wiki:u/bliu/OpenMP

Version 6 (modified by Baowei Liu, 7 years ago) ( diff )

Bluehive

Nodes number of tasks number of threads per task total time (secs)
1 22 1 20.9
1 22 2 32.2
1 22 4 64.21
1 11 1 31.95
#!/bin/bash

#SBATCH -J test           # Job name
#SBATCH -o test.o%j       # Name of stdout output file
#SBATCH -e test.e%j       # Name of stderr error file
#SBATCH -p debug 
#SBATCH -N 1               # Total # of nodes (now required)
#SBATCH --ntasks-per-node=22        # Total # of mpi tasks
#SBATCH -t 00:30:00        # Run time (hh:mm:ss)
#SBATCH --mail-user=baowei.liu@rochester.edu
#SBATCH --mail-type=all    # Send email at begin and end of job

# Other commands must follow all #SBATCH directives...

export OMP_NUM_THREADS=4  #Number of threads to use

module load astrobear/b1
module list
pwd
date

((nCores=SLURM_NTASKS/OMP_NUM_THREADS))
# Launch MPI job...

mpirun -np $nCores ./Bondi

Stampede2

  1. System: 4200 Knights Landing (KNL) Nodes. Each has 68 cores at 1.4GHz and each core has 4 threads. 96G~112G RAM.
  2. Performance of Bondi
Nodes number of tasks number of threads per task total time (secs)
1 68 1 50.41
1 68 2 63.21
1 68 4 88.43

Comet

  1. system Intel Xeon E5 processor with 128G RAM, 24 core and 2.5GHz.
  2. Performance of Bondi
Nodes number of tasks number of threads per task total time (secs)
1 24 1 16.22
1 24 2 24.05
1 24 4 44.11
Nodes number of tasks number of threads per task total time (secs)
2 48 1 11.98
2 48 2 15.75
2 48 4 24.09
#!/bin/bash
##SBATCH -A TG-AST160054
#SBATCH --job-name="Damp_RGB"
#SBATCH --output="slurm.%j.%N.out"
#SBATCH --partition=compute
#SBATCH -N 72
#SBATCH --ntasks-per-node=24
#SBATCH --export=ALL
#SBATCH -t 4:00:00
#SBATCH --mail-type=ALL
#SBATCH --mail-user=baowei.liu@rochester.edu

#Number of threads per task 
export OMP_NUM_THREADS=2

((nPerND=SLURM_NTASKS_PER_NODE/OMP_NUM_THREADS))
ibrun --npernode $nPerND ./Bondi

Bondi Model

  1. global.data
  2. physics.data
  3. problem.data
  4. solver.data
Note: See TracWiki for help on using the wiki.