3D Object Manipulation in a Single Photograph using Stock 3D Models

July 2014

3D Object Manipulation in a Single Photograph using Stock 3D Models

Authors:

Natasha Kholgade, Tomas Simon, Alexei Efros, and Yaser Sheikh

Abstract:

Photo-editing software restricts the control of objects in a photograph to the 2D image plane. We present a method that enables users to perform the full range of 3D manipulations, including scaling, rotation, translation, and nonrigid deformations, to an object in a photograph. As 3D manipulations often reveal parts of the object that are hidden in the original photograph, our approach uses publicly available 3D models to guide the completion of the geometry and appearance of the revealed areas of the object. The completion process leverages the structure and symmetry in the stock 3D model to factor out the effects of illumination, and to complete the appearance of the object. We demonstrate our system by producing object manipulations that would be impossible in traditional 2D photo editing programs, such as turning a car over, making a paper-crane flap its wings, or manipulating airplanes in a historical photograph to change its story.
@article{Kholgade-2014-103985,
author = {Natasha Kholgade And Tomas Simon And Alexei Efros And Yaser Sheikh},
title = {3D Object Manipulation in a Single Photograph using Stock 3D Models},
journal = {Proceedings of ACM Transactions on Graphics (TOG)},
year = {2014},
month = {July},
volume = {33},
number = {4},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.