Doodle Master: A Doodle Beautification System Based on Auto-encoding Generative Adversarial Networks

project_fig

陳建文

Chien-Wen Chen
project_fig

陳文正

Wen-Cheng Chen

For those people without artistic talent, they can only draw rough or even awful doodles to express their ideas. We propose a doodle beautification system named Doodle Master, which can transfer a rough doodle to a plausible image and also keep the semantic concepts of the drawings. The Doodle Master applies the VAE/GAN model to decode and generate the beautified result from a constrained latent space. To achieve better performance for sketch data which is more like discrete distribution, a shared-weight method is proposed to improve the learnt features of the discriminator with the aid of the encoder. Furthermore, we design an interface for the user to draw with basic drawing tools and adjust the number of reconstruction times. The experiments show that the proposed Doodle Master system can successfully beautify the rough doodle or sketch in real-time.

project_fig

BibTeX

@inproceedings{Chen:2018:DMD:3209693.3209695, author = {Chen, Chien-Wen and Chen, Wen-Cheng and Hu, Min-Chun}, title = {Doodle Master: A Doodle Beautification System Based on Auto-encoding Generative Adversarial Networks}, booktitle = {Proceedings of the 2018 International Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia}, series = {MMArt\&\#38;ACM'18}, year = {2018}, isbn = {978-1-4503-5798-2}, location = {Yokohama, Japan}, pages = {2--7}, numpages = {6}, url = {http://doi.acm.org/10.1145/3209693.3209695}, doi = {10.1145/3209693.3209695}, acmid = {3209695}, publisher = {ACM}, address = {New York, NY, USA}, keywords = {auto-encoding generative adversarial networks, doodle master, image beautification, vae/gan}, }

Paper Download