510 Rice Hall
85 Engineer's Way, Box 400740
Charlottesville, VA 22904
connelly AT cs.virginia.edu
Research Interests and Bio
My group develops techniques that are on the boundary between computer graphics and computer vision, with a focus on graphics. We tend to incorporate in our research machine learning techniques such as non-parametric and recently, deep learning models. We focus on applications in computational photography, image and video synthesis, art, and hiding visual information. Many computer graphics algorithms are more useful if they are interactive, therefore, we also have a focus on efficiency and optimization, including some compiler technologies.

I am currently recruiting Ph.D. students so let me know if you are interested in applying to my lab (see admissions).

I received my Ph.D. from Princeton University in 2011. See my C.V. for more information.
Impact and Press Coverage
The PatchMatch technology that I researched for my Ph.D. was incorporated into Adobe Photoshop CS5 as content-aware fill. This received 8 million views on YouTube [1] [2], and was featured in press such as Popular Science and PC Magazine. In later Photoshop versions, Content-aware Patch, Move, and Color Adaptation were built on this technology [3].

I collaborated on the Halide project, which has been used at Google. My collaboration on camouflage has been featured on Wired and Gizmodo, with 170,000 views on YouTube.
Graduate Students
Research Publications (Google Scholar)
Automatic Image Defect Diagnosis
Ning Yu, Xiaohui Shen, Zhe Lin, Radomír Měch, Connelly Barnes
arXiv preprint, 2016
A Survey of the State-of-the-art in Patch-based Synthesis
Connelly Barnes, Fang-Lue Zhang
Computational Visual Media 2016
VizGen: Accelerating Visual Computing Prototypes in Dynamic Languages
Yuting Yang, Sam Prestwood, Connelly Barnes
Halide: A Language and Compiler for Optimizing Parallelism, Locality, and Recomputation in Image Processing Pipelines
Jonathan Ragan-Kelley, Andrew Adams, Dillon Sharlet, Connelly Barnes, Sylvain Paris, Marc Levoy, Saman Amarasinghe, Frédo Durand
Communications of the ACM: Research Highlights (to appear)
Image Perforation: Automatically Accelerating Image Pipelines by Intelligently Skipping Samples
Liming Lou, Paul Nguyen, Jason Lawrence, Connelly Barnes
ACM Transactions on Graphics 2016 (to appear at ACM SIGGRAPH 2016)
Towards Automatic Band-Limited Procedural Shaders
Jonathan Dorn, Connelly Barnes, Jason Lawrence, Westley Weimer
Pacific Graphics 2015
PatchTable: Efficient Patch Queries for Large Datasets and Applications
Connelly Barnes, Fang-Lue Zhang, Liming Lou, Xian Wu, Shi-Min Hu
Synthesis of Complex Image Appearance from Limited Exemplars
Olga Diamanti, Connelly Barnes, Sylvain Paris, Eli Shechtman, Olga Sorkine-Hornung
ACM Transactions on Graphics 2015 (presented at ACM SIGGRAPH)
RealPigment: Paint Compositing by Example
Jingwan Lu, Stephen DiVerdi, Willa Chen, Connelly Barnes, Adam Finkelstein
NPAR 2014: Symposium on Non-Photorealistic Animation and Rendering
Stylized Keyframe Animation of Fluid Simulations
Mark Browning, Connelly Barnes, Samantha Ritter, Adam Finkelstein
NPAR 2014: Symposium on Non-Photorealistic Animation and Rendering
Style Transfer for Headshot Portraits
YiChang Shih, Sylvain Paris, Connelly Barnes, Frédo Durand, William Freeman
DecoBrush: Drawing Structured Decorative Patterns by Example
Jingwan Lu, Connelly Barnes, Connie Wan, Adam Finkelstein, Paul Asente, Radomír Měch
Camouflaging an Object from Many Viewpoints
Andrew Owens, Connelly Barnes, Alex Flint, Hanumant Singh, Bill Freeman
CVPR 2014 (oral presentation)
Patch-based High Dynamic Range Video
Nima Khademi Kalantari, Eli Shechtman, Connelly Barnes, Soheil Darabi, Dan B Goldman, Pradeep Sen
RealBrush: Painting with Examples of Physical Media
Jingwan Lu, Connelly Barnes, Stephen DiVerdi, Adam Finkelstein
Halide: A Language and Compiler for Optimizing Parallelism, Locality and Recomputation in Image Processing Pipelines
Jonathan Ragan-Kelley, Connelly Barnes, Andrew Adams, Sylvain Paris, Frédo Durand, Saman Amarasinghe
Image Melding: Combining Inconsistent Images using Patch-based Synthesis
Soheil Darabi, Eli Shechtman, Connelly Barnes, Dan B Goldman, Pradeep Sen
The PatchMatch Randomized Matching Algorithm for Image Manipulation
Connelly Barnes, Dan B Goldman, Eli Shechtman, Adam Finkelstein
Communications of the ACM: Research Highlights, 2011
PatchMatch: A Fast Randomized Matching Algorithm with Application to Image and Video
Connelly Barnes
Ph.D. Dissertation, Princeton University, 2011
The Generalized PatchMatch Correspondence Algorithm
Connelly Barnes, Eli Shechtman, Dan B Goldman, Adam Finkelstein
ECCV 2010
Video Tapestries with Continuous Temporal Zoom
Connelly Barnes, Dan B Goldman, Eli Shechtman, Adam Finkelstein
PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing
Connelly Barnes, Eli Shechtman, Adam Finkelstein, Dan B Goldman
Video Puppetry: A Performative Interface for Cutout Animation
Connelly Barnes, David E. Jacobs, Jason Sanders, Dan B Goldman, Szymon Rusinkiewicz, Adam Finkelstein, Maneesh Agrawala
Digital Bas-Relief from 3D Scenes
Tim Weyrich, Jia Deng, Connelly Barnes, Szymon Rusinkiewicz, Adam Finkelstein
Education Publications
Enhancement of Student Learning in Experimental Design Using a Virtual Laboratory
Milo Koretsky, Danielle Amatore, Connelly Barnes, Sho Kimura
IEEE Transactions on Education, 2008
Experiential Learning of Design of Experiments Using a Virtual CVD Reactor
Milo Koretsky, Sho Kimura, Connelly Barnes, Danielle Amatore, Derek Meyers-Graham
American Society for Engineering Education Conference, 2006. Award for best paper in Chemical Engineering.
The Virtual CVD Learning Platform
Milo Koretsky, Danielle Amatore, Connelly Barnes, Sho Kimura
Frontiers in Education Conference, 2006.
ThermoSolver: An Integrated Educational Thermodynamics Software Program
Connelly Barnes
Undergraduate honors thesis, 2006. Oregon State University Library
Thanks for research funding from the following organizations: the National Science Foundation, Adobe, and the Chinese Scholarship Council.
Other Resources
My personal website includes other resources such as: