Commit Graph

61 Commits

Author SHA1 Message Date
345a2a42f1 ENH: simplify method names for reading argList options and arguments
- use succincter method names that more closely resemble dictionary
  and HashTable method names. This improves method name consistency
  between classes and also requires less typing effort:

    args.found(optName)        vs.  args.optionFound(optName)
    args.readIfPresent(..)     vs.  args.optionReadIfPresent(..)
    ...
    args.opt<scalar>(optName)  vs.  args.optionRead<scalar>(optName)
    args.read<scalar>(index)   vs.  args.argRead<scalar>(index)

- the older method names forms have been retained for code compatibility,
  but are now deprecated
2018-01-08 15:35:18 +01:00
d8d6030ab6 INT: Integration of Mattijs' collocated parallel IO additions
Original commit message:
------------------------

Parallel IO: New collated file format

When an OpenFOAM simulation runs in parallel, the data for decomposed fields and
mesh(es) has historically been stored in multiple files within separate
directories for each processor.  Processor directories are named 'processorN',
where N is the processor number.

This commit introduces an alternative "collated" file format where the data for
each decomposed field (and mesh) is collated into a single file, which is
written and read on the master processor.  The files are stored in a single
directory named 'processors'.

The new format produces significantly fewer files - one per field, instead of N
per field.  For large parallel cases, this avoids the restriction on the number
of open files imposed by the operating system limits.

The file writing can be threaded allowing the simulation to continue running
while the data is being written to file.  NFS (Network File System) is not
needed when using the the collated format and additionally, there is an option
to run without NFS with the original uncollated approach, known as
"masterUncollated".

The controls for the file handling are in the OptimisationSwitches of
etc/controlDict:

OptimisationSwitches
{
    ...

    //- Parallel IO file handler
    //  uncollated (default), collated or masterUncollated
    fileHandler uncollated;

    //- collated: thread buffer size for queued file writes.
    //  If set to 0 or not sufficient for the file size threading is not used.
    //  Default: 2e9
    maxThreadFileBufferSize 2e9;

    //- masterUncollated: non-blocking buffer size.
    //  If the file exceeds this buffer size scheduled transfer is used.
    //  Default: 2e9
    maxMasterFileBufferSize 2e9;
}

When using the collated file handling, memory is allocated for the data in the
thread.  maxThreadFileBufferSize sets the maximum size of memory in bytes that
is allocated.  If the data exceeds this size, the write does not use threading.

When using the masterUncollated file handling, non-blocking MPI communication
requires a sufficiently large memory buffer on the master node.
maxMasterFileBufferSize sets the maximum size in bytes of the buffer.  If the
data exceeds this size, the system uses scheduled communication.

The installation defaults for the fileHandler choice, maxThreadFileBufferSize
and maxMasterFileBufferSize (set in etc/controlDict) can be over-ridden within
the case controlDict file, like other parameters.  Additionally the fileHandler
can be set by:
- the "-fileHandler" command line argument;
- a FOAM_FILEHANDLER environment variable.

A foamFormatConvert utility allows users to convert files between the collated
and uncollated formats, e.g.
    mpirun -np 2 foamFormatConvert -parallel -fileHandler uncollated

An example case demonstrating the file handling methods is provided in:
$FOAM_TUTORIALS/IO/fileHandling

The work was undertaken by Mattijs Janssens, in collaboration with Henry Weller.
2017-07-07 11:39:56 +01:00
0211b0a43b STYLE: correct the documented input names in header files (fixes #360) 2016-12-21 12:15:03 +01:00
c0f44ac4f3 MRG: Integrated foundation code 2016-12-12 12:10:29 +00:00
81de1dc9ac topoSet: cellZoneSet, pointZoneSet extensions
cellZones and pointZones can now be created in one action without the
need to first create a cellSet or pointSet and converting that to the
corresponding zone, e.g.

actions
(
    // Example: create cellZone from a box region
    {
        name    c0;
        type    cellZoneSet;
        action  new;
        source  boxToCell;
        sourceInfo
        {
            box   (0.04 0 0)(0.06 100 100);
        }
    }
);
2016-11-25 16:01:41 +00:00
5f13806591 Updated headers 2016-04-21 21:07:28 +01:00
0aaf154100 utilities/mesh/manipulation: Rationalized "End" message 2016-04-21 21:06:45 +01:00
efb39a8790 ENH: (further) Doxygen documentation updates for module support 2016-06-27 20:34:19 +01:00
fd9d801e2d GIT: Initial commit after latest foundation merge 2016-04-25 11:40:48 +01:00
f0c3e8d599 STYLE: Updated version to 'plus' 2015-12-22 23:14:17 +00:00
0e01c44129 GIT: Resolved conflict 2015-12-09 16:19:28 +00:00
8837a89237 STYLE: Updated links from openfoam.org to openfoam.com 2015-12-09 15:03:05 +00:00
8f1d043364 GIT: Resolved conflict 2015-12-09 09:32:38 +00:00
73dac8c7ee ENH: Updating utilities based on internal development line 2015-12-02 10:17:28 +00:00
e2ef006b91 applications: Update ...ErrorIn -> ...ErrorInFunction
Avoids the clutter and maintenance effort associated with providing the
function signature string.
2015-11-10 17:53:31 +00:00
9fb26d59d3 GIT: Repo update 2014-12-11 08:35:10 +00:00
fbb3ddf2c4 Updated for release 2.3.0 2014-02-17 10:21:46 +00:00
7a2269eccb ENH: setsToFaceZone: allow flipping 2013-10-17 14:04:22 +01:00
77d47e9125 ENH: surfaceToCell: use surface orientation 2013-08-20 16:01:18 +01:00
bbb2077160 ENH: searhcableSurfacetoFaceZone: allow triSurfaceMesh specification 2013-04-11 15:04:39 +01:00
951c8436aa ENH: Applying Gijs' patch: Update header documentation for utilities 2013-02-21 10:54:34 +00:00
774db288aa ENH: regionToCell: allow multiple regions and erosion 2012-12-18 14:49:35 +00:00
9ccd5809b8 BUG: sampleDict: missing type 2012-12-05 15:21:00 +00:00
d1d6421b49 ENH: searchableSurfaceToFaceZone: selection of faces and normals 2012-11-30 15:52:36 +00:00
4a3948383b ENH: topoSetDict: add zoneToPoint 2012-09-20 12:59:32 +01:00
d6f7fd0939 ENH: targetVolumeToCell: added mask 2012-08-01 15:52:42 +01:00
bd5fafddec ENH: targetVolumeToCell: new cellSetSource 2012-07-11 15:35:53 +01:00
413d25fbd2 ENH: boxToCell/face/point: have 'boxes' for multiple boxes 2012-07-10 10:02:01 +01:00
8476c1228a ENH: topoSet: added regionToFace source 2012-06-20 04:41:26 +01:00
6ac73b7d58 STYLE:topoSetDict: make consistent with code 2012-03-20 17:27:09 +00:00
c440f4fbb9 ENH: topoSet: added pointToCell/Face with edge option 2012-03-20 14:12:51 +00:00
5f777fb2de BUG: topoSet: use type() of unconstructed set 2012-02-09 18:06:42 +00:00
cd01c8f1a2 BUG: mergePolyMesh: merging zones 2012-02-03 15:53:37 +00:00
4dd7cc3bf5 ENH: topoSet: print type of set 2012-02-03 12:45:46 +00:00
2d7b3363ed ENH: patchToFace: allow patch groups in patchToFace 2011-12-12 16:33:11 +00:00
f1aa8b5f2a ENH: topoSet: add remove support 2011-11-15 17:58:10 +00:00
09247dd122 ENH: topoSetDict: corrected comment 2011-10-19 18:26:09 +01:00
46616b54ec STYLE: topoSetDict: adapted comment 2011-09-20 13:44:39 +01:00
c2dd153a14 Copyright transfered to the OpenFOAM Foundation 2011-08-14 12:17:30 +01:00
d9c6591451 topoSet: minor reformatting 2011-08-06 21:31:24 +01:00
471a6becc1 ENH: reduce output in parallel. 2011-07-05 13:23:41 +01:00
f7f069083d COMP: timeSelector: remove local copy 2011-06-30 17:46:38 +01:00
d2ad25fdd6 ENH: topoSet: time loop
Conflicts:

	applications/utilities/mesh/manipulation/topoSet/topoSet.C
2011-06-23 10:55:58 +01:00
8650e477e4 STYLE: modification date 2011-06-20 15:35:18 +01:00
b2d32246b8 ENH: topoSet: added time options 2011-06-20 15:34:14 +01:00
c720299876 ENH: Reverted back to version dev 2011-06-17 10:08:20 +01:00
4f47ff0219 STYLE: dictionaries: update version number 2011-06-10 17:22:56 +01:00
acd7554ae0 STYLE: dictionaries in $FOAM_UTILITIES: header 2011-04-06 19:15:15 +01:00
eaef8d482b STYLE: Updated 1991 start copyright year to 2004 2011-01-14 16:08:00 +00:00
099cc39e2e Revert "STYLE: 2011 copyright date."
This reverts commit b18f6cc1ce.
2011-01-05 18:24:29 +00:00