To reflect this, it is important to make the model not only aware of its own style, but other fonts’ styles as well. Imagine a human designer work on a new typeface, they are definitely not learning the alphabet from scratch! Real world designers go through years of training to understand the structure of the letters/characters and the fundamental principles, before they could design a font on their own. The structure of Encoder, Decoder and Discriminator are directly borrowed from the pix2pix, specifically the Unet model, which are detailed in the original paper’s Appendix section Intuition The network structure is illustrated below.
It is a pleasant surprise that the Rewrite project gets a fair amount of attention and interests, however, looking back, the result feels underwhelming.
Zi2zi is the follow-up work for my last project, once again tackling the same problem of style transfer between Chinese fonts.
DIFFERENT CHINESE FONTS CODE
Related code can be found here Motivation