Bluehive

Nodes	number of tasks	number of threads per task	total time (secs)
1	22	1	20.9
1	22	2	32.2
1	22	4	64.21

#!/bin/bash

#SBATCH -J test           # Job name
#SBATCH -o test.o%j       # Name of stdout output file
#SBATCH -e test.e%j       # Name of stderr error file
#SBATCH -p debug 
#SBATCH -N 1               # Total # of nodes (now required)
#SBATCH --ntasks-per-node=22        # Total # of mpi tasks
#SBATCH -t 00:30:00        # Run time (hh:mm:ss)
#SBATCH --mail-user=baowei.liu@rochester.edu
#SBATCH --mail-type=all    # Send email at begin and end of job

# Other commands must follow all #SBATCH directives...

export OMP_NUM_THREADS=4  #Number of threads to use

module load astrobear/b1
module list
pwd
date

((nCores=SLURM_NTASKS/OMP_NUM_THREADS))
# Launch MPI job...

mpirun -np $nCores ./Bondi

Stampede2

1. ​System: 4200 Knights Landing (KNL) Nodes. Each has 68 cores at 1.4GHz and each core has 4 threads. 96G~112G RAM.
2. Performance of Bondi

Nodes	number of tasks	number of threads per task	total time (secs)
1	68	1	50.41
1	68	2	63.21
1	68	4	88.43

Comet

1. ​system Intel Xeon E5 processor with 128G RAM, 24 core and 2.5GHz.
2. Performance of Bondi

Nodes	number of tasks	number of threads per task	total time (secs)
2	48	1	11.98
2	48	2	15.75
2	48	4	24.09

#!/bin/bash
##SBATCH -A TG-AST160054
#SBATCH --job-name="Damp_RGB"
#SBATCH --output="slurm.%j.%N.out"
#SBATCH --partition=compute
#SBATCH -N 72
#SBATCH --ntasks-per-node=24
#SBATCH --export=ALL
#SBATCH -t 4:00:00
#SBATCH --mail-type=ALL
#SBATCH --mail-user=baowei.liu@rochester.edu

#Number of threads per task 
export OMP_NUM_THREADS=2

((nPerND=SLURM_NTASKS_PER_NODE/OMP_NUM_THREADS))
ibrun --npernode $nPerND ./Bondi

Bondi Model

1. ​global.data
2. ​physics.data
3. ​problem.data
4. ​solver.data