Typography Research Collection

[hackmd][github] [github pages]

Typography is the cross between technology and liberal arts. This page is a research collection that includes computer graphics, computer vision, machine learning that related to typography.

Font Stye Transfer and Glyph Generation

NN Approach

• Handwritten Chinese Font Generation with Collaborative Stroke Refinement

  • [paper]
  • Chuan Wen, Jie Chang, Ya Zhang, Siheng Chen, Yanfeng Wang, Mei Han, Qi Tian
  • arxiv

• A Learned Representation for Scalable Vector Graphics

  • [paper]
  • Raphael Gontijo Lopes, David Ha, Douglas Eck, Jonathon Shlens
  • ICCV 2019
  • ICLR workshop 2019

• Large-scale Tag-based Font Retrieval with Generative Feature Learning

  • [paper][page]
  • Tianlang Chen, Zhaowen Wang, Ning Xu, Hailin Jin, Jiebo Luo
  • ICCV 2019

• DynTypo: Example-based Dynamic Text Effects Transfer

  • [paper]
  • Yifang Men, Zhouhui Lian, Yingmin Tang, Jianguo Xiao
  • CVPR 2019

<iframe width="560" height="315" src="https://www.youtube.com/embed/FkFQ6bV1s-o" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

• DeepGlyph
  • [websites]

<iframe width="560" height="315" src="https://www.youtube.com/embed/T70k-0qgccs" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

• Coconditional Autoencoding Adversarial Networks for Chinese Font Feature Learning

  • [paper]
  • Zhizhan Zheng, Feiyun Zhang

• TET-GAN: Text Effects Transfer via Stylization and Destylization

  • [paper]
  • Shuai Yang, Jiaying Liu, Wenjing Wang, Zongming Guo
  • AAAI2019

• SCFont: Structure-Guided Chinese Font Generation via Deep Stacked Networks

  • [paper]
  • Yue Jiang, Zhouhui Lian*, Yingmin Tang, Jianguo Xiao
  • AAAI 2019

• Separating Style and Content for Generalized Style Transfer

  • [paper][code]
  • Yexun Zhang, Ya Zhang, Wenbin Cai
  • CVPR 2018

Networks

results

• Deep Learning for Classical Japanese Literature
  • [paper][GitHub]
  • Tarin Clanuwat, Mikel Bober-Irizar, Asanobu Kitamoto, Alex Lamb, Kazuaki Yamamoto, David Ha
  • NeurIPS 2018
  • Kuzushiji-MNIST,Kuzushiji-49 and Kuzushiji-Kanji

Kuzushiji-MNIST Kuzushiji-Kanji

• Multi-Content GAN for Few-Shot Font Style Transfer
  • [code][paper][blog]
  • Azadi, Samaneh, Matthew Fisher, Vladimir Kim, Zhaowen Wang, Eli Shechtman, and Trevor Darrell.
  • CVPR2018

• Learning to Write Stylized Chinese Characters by Reading a Handful of Examples

  • [paper]
  • Danyang Sun∗, Tongzheng Ren∗, Chongxuan Li, Hang Su†, Jun Zhu†
  • IJCAI 2018
  • SA-VAE

• DCFont: An End-To-End Deep Chinese Font Generation System

  • [paper]
  • Juncheng Liu, Zhouhui Lian, Jianguo Xiao
  • SIGGRAPH Asia 2017

• zi2zi: Master Chinese Calligraphy with Conditional Adversarial Networks

  • [blog] [code]
  • Yuchen Tian
  • 2017

• Rewrite: Neural Style Transfer For Chinese Fonts
  • [code]
  • Yuchen Tian
  • 2016

• Automatic generation of large-scale handwriting fonts via style learning
  • [paper]
  • Zhouhui Lian, Bo Zhao, and Jianguo Xiao
  • SIGGRAPH ASIA 2016

• A Book from the Sky 天书: Exploring the Latent Space of Chinese Handwriting
  • [blog]
  • Gene Kogan

• Letter Spirit: An Emergent Model of the Perception and Creation of Alphabetic Style
  • [paper]
  • Douglas Hofstadter, Gary McGraw
  • 1993

Other Approach

• Automatic Generation of Typographic Font from a Small Font Subset
  • [paper]
  • Tomo Miyazaki, Tatsunori Tsuchiya, Yoshihiro Sugaya, Shinichiro Omachi, Masakazu Iwamura, Seiichi Uchida, Koichi Kise
  • 2017

• FlexyFont: Learning Transferring Rules for Flexible Typeface Synthesis
  • [paper]
  • H. Q. Phan, H. Fu, and A. B. Chan
  • 2015 Computer Graphics Forum

• Awesome Typography: Statistics-Based Text Effects Transfer
  • [paper][code]
  • Shuai Yang, Jiaying Liu, Zhouhui Lian and Zongming Guo
  • CVPR 2017

• Easy generation of personal Chinese handwritten fonts
  • [paper]
  • Baoyao Zhou, Weihong Wang, and Zhanghui Chen
  • 2011 ICME(IEEE International Conference on Multimedia and Expo)

• Automatic shape morphing for Chinese characters
  • [paper]
  • Zhouhui Lian, and Zhouhui Lian
  • SIGGRAPH Asia 2012

Struture Learning

• Analyzing 50k fonts using deep neural networks
  • [blog]
  • Erik Bernhardsson
  • 2016

• Learning a Manifold of Fonts
  • [paper][project(demo)]
  • Neill D.F. Campbell, and Jan Kautz
  • SIGGRAPH 2014

DataSet

• Chinese Handwriting Recognition Competition 2013https://raw.githubusercontent.com/kaonashi-tyc/Rewrite/master/images/single_font_progress.gif
  • [paper]
  • http://www.nlpr.ia.ac.cn/databases/handwriting/Download.html

• Deep Learning for Classical Japanese Literature
  • [paper][GitHub]
  • Tarin Clanuwat, Mikel Bober-Irizar, Asanobu Kitamoto, Alex Lamb, Kazuaki Yamamoto, David Ha
  • NeurIPS 2018
  • Kuzushiji-MNIST,Kuzushiji-49 and Kuzushiji-Kanji

Kuzushiji-MNIST Kuzushiji-Kanji

Other Application

• FontCode: Embedding Information in Text Documents Using Glyph Perturbation
  • [paper][project page]
  • Chang Xiao, Cheng Zhang, Changxi Zheng
  • SIGGRAPH 2018

<iframe width="560" height="315" src="https://www.youtube.com/embed/dejrBf9jW24" frameborder="0" allow="autoplay; encrypted-media" allowfullscreen></iframe>