Winding Number Features for Vector Sketch Colorization

Daniel Scrivener1, Ellis Coldren1, Edward Chien1
1Boston University
SGP 2024

Lineart vector sketches often feature potential stroke junctions that are hard to disambiguate. We sidestep this challenge by leveraging winding number features, which instead focus on capturing a notion of region closure. Our resulting multi-region segmentation method outperforms existing methods on inputs with a diverse set of gap sizes. (Left) An uncolored vector sketch. (Middle Left) The winding number generated by the sketch’s default stroke directions, unsuitable for clustering on its own. (Middle Right) Several winding numbers for random sets of stroke orientations, sorted by total variation, which is used to differentially weight certain features. (Right) The automatically colored sketch after applying k-means clustering.

Presentation at SGP 2024

Abstract

Vector sketch software (e.g. Adobe Illustrator, Inkscape) and touch-interactive technologies have long aided artists in the creation of resolution-independent digital drawings that mimic the unconstrained nature of freehand sketches. However, artist intent behind stroke topology is often ambiguous, complicating traditional segmentation tasks such as coloring. For inspiration, we turn to the winding number, a classic geometric property of interest for binary segmentation in the presence of boundary data. Its direct application for multi-region segmentation poses two main challenges: (1) strokes may not be consistently oriented to best identify perceptually salient regions; (2) for interior strokes there is no ''correct'' orientation, as either choice better distinguishes one of two neighboring regions. Thus, we form a harmonic feature space from multiple winding number fields and perform segmentation via Voronoi/power diagrams in this domain. Our perspective allows both for automatic fill region detection and for a semi-automatic framework that naturally incorporates user hints and interactive sculpting of results, unlike competing automatic methods. Our method is agnostic to curve orientation and gracefully handles varying gap sizes in the sketch boundary, outperforming state-of-the-art colorization methods on these ''gappy'' inputs. Moreover, it inherits the ability of winding numbers to specify ''fuzzy'' boundaries, leading to simple strategies for color diffusion and single-parameter-driven growing and shrinking of regions.

Links

BibTeX

@article{scrivener24winding, journal = {Computer Graphics Forum}, title = {Winding Number Features for Vector Sketch Colorization}, author = {Scrivener, Daniel and Coldren, Ellis and Chien, Edward}, year = {2024}, publisher = {The Eurographics Association and John Wiley & Sons Ltd.}, ISSN = {1467-8659}, DOI = {10.1111/cgf.15141} }