The GetData Project is the reference implementation of the Dirfile Standards, a filesystem-based, column-oriented database format for time-ordered binary data. The Dirfile database format is designed to provide a fast, simple format for storing and reading data.
Features of GetData and the Dirfile Standards include:
- fast, efficient storage and retrieval of binary data suitable for concurrent reads and writes
- data access times independent of database size
- automatic data type conversion and endianness correction
- derived channels which encode calibration and other data manipulation tasks within the database metadata
GetData was originally written for the BOOMERanG and BLAST experiments as a data format suitable for use for both quick-look and data reduction. It is now used by many other cosmological and astrophysical experiments including ACT, Planck, Spider, as well as other projects. GetData began life as one of the native data formats supported by the kst plotting program, which was also written to provide quick-look capability to BOOMERanG and BLAST. Because it is used as a data access library by analysis software for many different projects, it is now a stand-alone library. Dirfiles in use for BLAST data analysis typically contain ~104 fields with ~108 samples each.
The complete source code for official releases of the GetData project are available from SourceForge.
- The latest version of GetData, released 14 May, 2015, is GetData 0.8.8.
The API is fully documented in Unix man pages provided with the distribution. Further documentation is available below:
GetData is free software; you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as published by the Free Software Foundation: either version 2.1 of the License, or (at your option) any later version.
GetData is distributed in the hope that it will be useful, but without any warranty; without even the implied warranty of merchantability or fitness for a particular purpose. See the GNU Lesser General Public License for more details.
GetData and the Dirfile Standards were originally written by C. B. Netterfield. They are both now maintained by D. V. Wiebe.
Questions and comments about GetData are best directed to the GetData mailing list (firstname.lastname@example.org).