An efficient and flexible inference system for serving heterogeneous ensembles of deep neural networks

Pierrick Pochelu (1) , Serge Petiton (2) , Bruno Conche

1 TotalEnergies SE
2 CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189

Domaines: Informatique [cs]; Intelligence artificielle [cs.AI]; Combinatoire [math.CO]

Pierrick Pochelu, Serge Petiton, Bruno Conche. An efficient and flexible inference system for serving heterogeneous ensembles of deep neural networks. IEEE BigData 2021, Dec 2021, Virtual, United States. ⟨hal-03494431⟩