Skip to Main content Skip to Navigation
Journal articles

A Benchmark for Rough Sketch Cleanup

Abstract : Sketching is a foundational step in the design process. Decades of sketch processing research have produced algorithms for 3D shape interpretation, beautification, animation generation, colorization, etc. However, there is a mismatch between sketches created in the wild and the clean, sketch-like input required by these algorithms, preventing their adoption in practice. The recent flurry of sketch vectorization, simplification, and cleanup algorithms could be used to bridge this gap. However, they differ wildly in the assumptions they make on the input and output sketches. We present the first benchmark to evaluate and focus sketch cleanup research. Our dataset consists of 281 sketches obtained in the wild and a curated subset of 101 sketches. For this curated subset along with 40 sketches from previous work, we commissioned manual vectorizations and multiple ground truth cleaned versions by professional artists. The sketches span artistic and technical categories and were created by a variety of artists with different styles. Most sketches have Creative Commons licenses; the rest permit academic use. Our benchmark's metrics measure the similarity of automatically cleaned rough sketches to artist-created ground truth; the ambiguity and messiness of rough sketches; and low-level properties of the output parameterized curves. Our evaluation identifies shortcomings among state-of-the-art cleanup algorithms and discusses open problems for future research.
Document type :
Journal articles
Complete list of metadata
Contributor : David Vanderhaeghe Connect in order to contact the contributor
Submitted on : Wednesday, September 30, 2020 - 3:40:36 PM
Last modification on : Monday, July 4, 2022 - 9:11:03 AM


A Benchmark for Rough Sketch C...
Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Chuan Yan, David Vanderhaeghe, Yotam Gingold. A Benchmark for Rough Sketch Cleanup. ACM Transactions on Graphics, Association for Computing Machinery, 2020, 39 (6), pp.163.1 - 163.14. ⟨10.1145/3414685.3417784⟩. ⟨hal-02939477⟩



Record views


Files downloads