Changes between Version 3 and Version 4 of ScramblerPaper


Ignore:
Timestamp:
05/09/11 11:15:56 (14 years ago)
Author:
Jonathan
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • ScramblerPaper

    v3 v4  
    11* Introduction
    2  * Discuss future trends in HPC and need for algorithms that use less memory and don't require load balancing on every level.  Discussion of design philosophy (atomic grid operations for simplicity and nested grids for simplicity - and possibly discuss supergridding experiment)
     2 * Larger and larger clusters alone will not allow larger and larger simulations to be performed in the same wall time without either an increase in CPU speed or a decrease in the workload of each processor.  Since CPU speeds are not expected to keep pace with the requirements of large simulations, the only option is to decrease the work load of each processor.  This however requires highly parallelized and efficient algorithms for managing the AMR infrastructure and the necessary computations.  Scrambler, unlike many other AMR codes, uses a distributed tree so that each processor is only aware of the AMR structure it needs to be aware of in order to carry out its computations.  While currently, this additional memory is small compared to the resources typically available to a CPU, future clusters will have much less memory per processor similar to what is already seen in GPU's.  Additionally Scrambler uses a distributed control structure that mirrors the nested AMR grid hierarchy.  Processors have child processors just as AMR grids have child grids.  These child processors receive new grids, and all necessary tree information from their parent.  This eliminates the need for global sharing of tree data.  Processors only need to communicate with parent processors(processors containing parent grids), neighbor processors (processors containing adjacent grids), overlapping processors (processors containing previous AMR grids that overlap with the processors current grids), and child processors (processors assigned to child grids).  Additionally the allocation of resources among child grids is done using a Hilbert space filling curve.  This allows neighboring processors to be physically close on the network (or on the same core) and allows Scrambler to take advantage of the network topology.
     3 * In addition to being completely parallelized between processors, Scrambler makes use of threading to allow for parallel advancing of multiple AMR levels.  This allows for total load balancing instead of balancing each level of the AMR hierarchy.  This becomes especially important for deep simulations (simulations with low filling fractions but many levels of AMR) as opposed to shallow simulations (high filling fractions and only a few levels of AMR).  Processors with coarse grids can advance their grids simultaneously while processors with finer grids advance theirs.  Without this capability, base grids would need to be large enough to be able to be distributed across all of the processors.  For simulations with large base grids to be able to finish in a reasonable wall time, only a few levels of AMR can be used.  With threading this restriction is lifted.
     4
    35
    46* Distributed Tree/Control Algorithm