next up previous contents
Next: Scalability Up: Efficiency of performance Previous: Reusing the communication schedule   Contents

Data caching

As OOC data do not fit into main memory, only a part of them can be processed at a time. Therefore, there is need to exchange data between memory and disk. lip supports an IO buffer mapping data structure that stores information about memory contents so there is no need to read data again. The detailed description of this behavior is described below. Additionally the IO latency is minimized by means of derived data types [*] that allow reading non-contiguous data from disk via only one MPI-IO routine. This is usually implemented using the data sieving technique [*]


Created by Katarzyna Zając