门怡芳同学论文《Controllable Person Image Synthesis with Attribute-Decomposed GAN》被CVPR 2020录用!
CVPR是计算机视觉、模式识别和人工智能领域国际顶级会议,2020年将在美国西雅图召开。
本文提出了一种基于属性分解GAN的可控人图自动生成方法。
门怡芳同学是本论文第一作者,现为实验室三年级硕士研究生。
http://cvpr2020.thecvf.com
Y. Men, Y. Mao, Y. Jiang, W. Ma, Z. Lian*.Controllable Person Image Synthesis with Attribute-Decomposed GAN. CVPR 2020 (accepted)
This paper introduces Attribute-Decomposed GAN, a novel generative model for controllable person image synthesis, which can produce realistic person images with desired human attributes (e.g., pose, head, upper clothes and pants) provided in various source inputs. The core idea of the proposed model is to embed human attributes into the latent space as independent codes and thus achieve flexible and continuous control of attributes via mixing and interpolation operations in explicit style representations. Specifically, a new architecture consisting of two encoding pathways with style block connections is proposed to decompose the original hard mapping into multiple more accessible subtasks. In source pathway, we further extract component layouts with an off-the-shelf human parser and feed them into a shared global texture encoder for decomposed latent codes. This strategy allows for the synthesis of more realistic output images and automatic separation of un-annotated attributes. Experimental results demonstrate the proposed method’s superiority over the state of the art in pose transfer and its effectiveness in the brand-new task of component attributes transfer.