On Demand Solid Texture Synthesis Using Deep 3D Networks

Jorge Gutierrez 1 Julien Rabin 2 Bruno Galerne 3 Thomas Hurtut 1
2 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
Abstract : This paper describes a novel approach for on demand volumetric texture synthesis based on a deep learning framework that allows for generation of high quality 3D data at interactive rates. Based on a few example images of textures, a generative network is trained to synthesize coherent solid textures that reproduce the visual characteristics of the examples along some directions. To cope with memory limitations and computation complexity that are inherent to both high resolution and 3D processing on GPU, only 2D textures referred to as “slices” are generated during the training stage. These synthetic textures are compared to exemplar images via a perceptual loss function based on a pre-trained deep network. The proposed network is very light (less than 100k parameters), therefore it only requires sustainable training (i.e. few hours) and is capable of very fast generation (around a second for 256^3 voxels) on a single GPU. The synthesized volumes have good visual results that are at least equivalent to the state-of-the-art patch based approaches. They are naturally seamlessly tileable and can be fully generated in parallel.
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01678122
Contributeur : Jorge Alberto Gutierrez Ortega <>
Soumis le : dimanche 30 décembre 2018 - 18:32:46
Dernière modification le : mardi 5 février 2019 - 12:12:45

Fichier

OnDemandSolidTextureSynthesisU...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01678122, version 2

Citation

Jorge Gutierrez, Julien Rabin, Bruno Galerne, Thomas Hurtut. On Demand Solid Texture Synthesis Using Deep 3D Networks. 2018. 〈hal-01678122v2〉

Partager

Métriques

Consultations de la notice

103

Téléchargements de fichiers

100