Core Scientific Dataset Model: A lightweight and portable model and file format for multi-dimensional scientific data

Deepansh J Srivastava (1) , Thomas Vosegaard (2) , Dominique Massiot (3, 4) , Philip Grandinetti (1)

1 OSU - Ohio State University [Columbus]
2 Aarhus University [Aarhus]
3 CEMHTI - Conditions Extrêmes et Matériaux : Haute Température et Irradiation
4 UO - Université d'Orléans

The Core Scientific Dataset (CSD) model with JavaScript Object Notation (JSON) serialization is presented as a lightweight, portable, and versatile standard for intra-and interdisciplinary scientific data exchange. This model supports datasets with a p-component dependent variable, {U 0 ,. .. , U q ,. .. , U p 1 }, discretely sampled at M unique points in a d-dimensional independent variable (X 0 ,. .. X k ,. .. X d 1) space. Moreover, this sampling is over an orthogonal grid, regular or rectilinear, where the principal coordinate axes of the grid are the independent variables. It can also hold correlated datasets assuming the different physical quantities (dependent variables) are sampled on the same orthogonal grid of independent variables. The model encapsulates the dependent variables' sampled data values and the minimum metadata needed to accurately represent this data in an appropriate coordinate system of independent variables. The CSD model can serve as a re-usable building block in the development of more sophisticated portable scientific dataset file standards.

Mots clés: information storage and retrieval; biology and life sciences; data reduction; data management; open data; software tools; data processing; data mining; databases; metadata; computer software; physical sciences; engineering; earth sciences

Domaines: Matériaux; Analyse de données, Statistiques et Probabilités [physics.data-an]

Deepansh J Srivastava, Thomas Vosegaard, Dominique Massiot, Philip Grandinetti. Core Scientific Dataset Model: A lightweight and portable model and file format for multi-dimensional scientific data. PLoS ONE, 2020, 15, pp.e0225953. ⟨10.1371/journal.pone.0225953⟩. ⟨hal-02413965v2⟩