Interactive Example-based Hatching

Moritz Gerl (1) , Tobias Isenberg (2)

1 Bernoulli Institute for Mathematics and Computer Science and Artificial Intelligence
2 AVIZ - Analysis and Visualization

We present an approach for interactively generating pen-and-ink hatching renderings based on hand-drawn examples. We aim to overcome the regular and synthetic appearance of the results of existing methods by incorporating human virtuosity and illustration skills in the computer generation of such imagery. To achieve this goal, we propose to integrate an automatic style transfer with user interactions. This approach leverages the potential of example-based hatching while giving users the control and creative freedom to enhance the aesthetic appearance of the results. Using a scanned-in hatching illustration as input, we use image processing and machine learning methods to learn a model of the drawing style in the example illustration. We then apply this model to semi-automatically synthesize hatching illustrations of 3D meshes in the learned drawing style. In the learning stage, we first establish an analytical description of the hand-drawn example illustration using image processing. A 3D scene registered with the example drawing allows us to infer object-space information related to the 2D drawing elements. We employ a hierarchical style transfer model that captures drawing characteristics on four levels of abstraction, which are global, patch, stroke, and pixel levels. In the synthesis stage, an explicit representation of hatching strokes and hatching patches enables us to synthesize the learned hierarchical drawing characteristics. Our representation makes it possible to directly and intuitively interact with the hatching illustration. Amongst other interactions, users of our system can brush with patches of hatching strokes onto a 3D mesh. This interaction capability allows illustrators who are working with our system to make use of their artistic skills. Furthermore, the proposed interactions allow people without a background in hatching to interactively generate visually appealing hatching illustrations.

Mots clés: Illustrative rendering; non-photorealistic rendering; interactive illustrative rendering; style transfer; hatching; learning hatching; hatching by example; illustrations by example; example-based; interactive example-based; pen-and-ink

Domaines: Synthèse d'image et réalité virtuelle [cs.GR]

Moritz Gerl, Tobias Isenberg. Interactive Example-based Hatching. Computers and Graphics, 2013, 37 (1-2), pp.65-80. ⟨10.1016/j.cag.2012.11.003⟩. ⟨hal-00781065⟩