An Oracle-based event index for ATLAS

Abstract : The ATLAS Eventlndex System has amassed a set of key quantities for a large number of ATLAS events into a Hadoop based infrastructure for the purpose of providing the experiment with a number of event-wise services. Collecting this data in one place provides the opportunity to investigate various storage formats and technologies and assess which best serve the various use cases as well as consider what other benefits alternative storage systems provide. In this presentation we describe how the data are imported into an Oracle RDBMS (relational database management system), the services we have built based on this architecture, and our experience with it. We’ve indexed about 26 billion real data events thus far and have designed the system to accommodate future data which has expected rates of 5 and 20 billion events per year. We have found this system offers outstanding performance for some fundamental use cases. In addition, profiting from the co-location of this data with other complementary metadata in ATLAS, the system has been easily extended to perform essential assessments of data integrity and completeness and to identify event duplication, including at what step in processing the duplication occurred.
Type de document :
Communication dans un congrès
22nd International Conference on Computing in High Energy and Nuclear Physics, Oct 2016, San Francisco, United States. J.Phys.Conf.Ser., 898 (4), pp.042033, 2017, 〈10.1088/1742-6596/898/4/042033〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01669616
Contributeur : Inspire Hep <>
Soumis le : mercredi 20 décembre 2017 - 23:46:06
Dernière modification le : jeudi 15 mars 2018 - 15:04:10

Lien texte intégral

Identifiants

Citation

E.J. Gallas, G. Dimitrov, P. Vasileva, Z. Baranowski, L. Canali, et al.. An Oracle-based event index for ATLAS. 22nd International Conference on Computing in High Energy and Nuclear Physics, Oct 2016, San Francisco, United States. J.Phys.Conf.Ser., 898 (4), pp.042033, 2017, 〈10.1088/1742-6596/898/4/042033〉. 〈hal-01669616〉

Partager

Métriques

Consultations de la notice

15