diff --git a/doc/src/Developer_parallel.rst b/doc/src/Developer_parallel.rst index bba8b086d9..ee749cf160 100644 --- a/doc/src/Developer_parallel.rst +++ b/doc/src/Developer_parallel.rst @@ -85,14 +85,18 @@ the load imbalance: |decomp1| |decomp2| |decomp3| |decomp4| -The pictures above demonstrate the differences for a 2d system with 12 MPI ranks. -Due to the vacuum in the system, the default decomposition is unbalanced -with several MPI ranks without atoms (left). By forcing a 1x12x1 processor -grid, every MPI rank does computations now, but the amount of communication -between sub-domains is increased (center left). With a 2x6x1 processor grid and -shifting the sub-domain divisions, the load imbalance is also reduced and -the amount of communication required between sub-domains is less (center right). -And using the recursive bisectioning leads to further improved decomposition (right). +The pictures above demonstrate different decompositions for a 2d system +with 12 MPI ranks. The atom colors indicate the load imbalance with +green being optimal and red the least optimal. Due to the vacuum in the system, the default +decomposition is unbalanced with several MPI ranks without atoms +(left). By forcing a 1x12x1 processor grid, every MPI rank does +computations now, but number of atoms per sub-domain is still uneven and +the thin slice shape increases the amount of communication between sub-domains +(center left). With a 2x6x1 processor grid and shifting the +sub-domain divisions, the load imbalance is further reduced and the amount +of communication required between sub-domains is less (center right). +And using the recursive bisectioning leads to further improved +decomposition (right). Communication diff --git a/doc/src/img/decomp-balance.png b/doc/src/img/decomp-balance.png index 7ac72c5114..eb00e8e89a 100644 Binary files a/doc/src/img/decomp-balance.png and b/doc/src/img/decomp-balance.png differ diff --git a/doc/src/img/decomp-processors.png b/doc/src/img/decomp-processors.png index 7fa9e98d6c..0d68f3679f 100644 Binary files a/doc/src/img/decomp-processors.png and b/doc/src/img/decomp-processors.png differ diff --git a/doc/src/img/decomp-rcb.png b/doc/src/img/decomp-rcb.png index 03ab2a1395..0e38efa7ea 100644 Binary files a/doc/src/img/decomp-rcb.png and b/doc/src/img/decomp-rcb.png differ diff --git a/doc/src/img/decomp-regular.png b/doc/src/img/decomp-regular.png index 7607a42737..a8c645033d 100644 Binary files a/doc/src/img/decomp-regular.png and b/doc/src/img/decomp-regular.png differ