Pseudo-Cyclic Network for Unsupervised Colorization with Handcrafted Translation and Output Spatial Pyramids

Abstract : We present a novel pseudo-cyclic adversarial learning approach for unsupervised colorization of grayscale images. We investigate the use of a non-trainable, lightweight and well-defined Handcrafted Translation to enforce the generation of realistic images and replace one of the two deep convolutional generative adversarial neural networks classically used in cyclic models. Additionally, we propose to use Output Spatial Pyramids to jointly constrain the deep latent spaces of an encoder-decoder generator to preserve spatial structures and improve the quality of the generated images. We demonstrate the interest of our approach compared with the state of the art on standard datasets (paintings, landscapes, aerial, thumbnails) that we modified for the purpose of colorization. We evaluate colorization quality of the generated images along the training with deterministic and reproducible criteria. In complement, we demonstrate the ability of our method to generate representations that are prone to make a classification network generalize well to slightly different color spaces. We believe our approach has potential applications in arts and cultural heritage to produce alternative representations without requiring paired data.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-02321600
Contributor : Rémi Ratajczak <>
Submitted on : Monday, October 21, 2019 - 1:06:04 PM
Last modification on : Wednesday, December 4, 2019 - 7:53:56 AM

Identifiers

Citation

Rémi Ratajczak, Carlos Crispim-Junior, Béatrice Fervers, Élodie Faure, Laure Tougne. Pseudo-Cyclic Network for Unsupervised Colorization with Handcrafted Translation and Output Spatial Pyramids. SUMAC @ ACM Multimedia, Oct 2019, Nice, France. pp.5-13, ⟨10.1145/3347317.3357243⟩. ⟨hal-02321600⟩

Share

Metrics

Record views

38