Big Data architecture for large-scale scientific computing

Benoit Lange 1 Toan Nguyen 1
1 OPALE - Optimization and control, numerical algorithms and integration of complex multidiscipline systems governed by PDE
CRISAM - Inria Sophia Antipolis - Méditerranée , JAD - Laboratoire Jean Alexandre Dieudonné : UMR6621
Abstract : Today, the scientific community uses massively simulations to test their theories and to understand physical phenomena. Simulation is however limited by two important factors: the number of elements used and the number of time-steps which are computed and stored. Both limits are constrained by hardware capabilities (computation nodes and/or storage). From this observation arises the VELaSSCo project1. The goal is to design, implement and deploy a platform to store data for DEM (Discrete Element Method) and FEM (Finite Element Method) simulations. These simulations can produce huge amounts of data regarding to the number of elements (particles in DEM) which are computed, and also regarding to the number of time-steps processed. The VELaSSCo platform solves this problem by providing a framework fulfilling the application needs and running on any available hardware. This platform is composed of different software modules: a Hadoop distribution and some specific plug-ins. The plug- ins which are designed deal with the data produced by the simulations. The output of the platform is designed to fit with requirements of available visualization software.
Type de document :
Communication dans un congrès
world academy of science - ABDA 2014, Sep 2014, Las Vegas, United States
Liste complète des métadonnées

Littérature citée [11 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01061641
Contributeur : Benoit Lange <>
Soumis le : lundi 8 septembre 2014 - 10:31:21
Dernière modification le : lundi 4 décembre 2017 - 15:14:10
Document(s) archivé(s) le : mardi 9 décembre 2014 - 11:45:29

Fichier

ABDA.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01061641, version 1

Collections

Citation

Benoit Lange, Toan Nguyen. Big Data architecture for large-scale scientific computing. world academy of science - ABDA 2014, Sep 2014, Las Vegas, United States. 〈hal-01061641〉

Partager

Métriques

Consultations de la notice

287

Téléchargements de fichiers

450