Kanglai Qian, Bin Wang, Huarong Chen
School of Software, Room 10-403, East Main Building, Tsinghua University, Beijing 100084, PR China
Computers & Graphics Volume 45, December 2014, Pages 64–74

Abstract

In this paper, we propose a system for flexible face replacement in photos that does not require human intervention. The proposed replacement algorithm is able to efficiently paste one person׳s face into another׳s with different head poses and/or hairstyles. This work can enhance the quality of group photos that contain human faces, as they are seldom flawless. Previous methods require complex user interaction or auxiliary data such as a 3D head model library or a photo library, while our system does not. Given a photo, the faces are automatically detected and transformed into similar poses by fitting corresponding facial features. We then construct an energy function and optimize it for a better face contour between the transformed source face and the target one, followed by applying seamless cloning. Our system removes hair before face transfer and adds it back afterwards, maintaining the same hairstyles. We demonstrate that our system produces high-quality results without manual tuning of parameters.

Downloads

Paper [PDF], Code [RAR]

Acknowledgements

We would like to thank Peng Qi & Jiating Chen for discussions, Xiaoxiao Song for improving writing, and the anonymous reviewers for valuable suggestion;s. The research was supported by National Basic Research Program of China (2010CB328001), National Science Foundation of China (61373071).