Face Swapping

Sushubh

Creator of new threads from offtopic posts
Messages
407,143
Location
Gurugram
ISP
Excitel/Airtel
This is incredible stuff! [video=vimeo;29279198]http://vimeo.com/29279198[/video]
 

amish

Star gazer
Messages
24,823
Location
Mumbai
ISP
MTNL Mumbai BB_600 @12mbps
Was there some kind of projector which was projecting some rays on his face?
 

Sushubh

Creator of new threads from offtopic posts
Messages
407,143
Location
Gurugram
ISP
Excitel/Airtel
from the video page.

This is a technical demo for face substitution technique. The application works in real time and it's developed using the opensource framework for creative coding openFrameworks: openFrameworks.cc

Most of the "magic" happens thanks to Jason Saragih's c++ library for face tracking web.mac.com/​jsaragih/​FaceTracker/​FaceTracker.html. The face tracking library returns a mesh that matches the contour of the eyes, nose, mouth and other facial features.

That way the mesh obtained from a photo is matched to my own face in the video. Applying some color interpolation algorithms from Kevin Atkinson's image clone code: methodart.blogspot.com/​ gives it the blending effect that can be seen in the final footage.

I'm also using Kyle McDonald's ofxFaceTracker addon for openframeworks github.com/​kylemcdonald/​ofxFaceTracker which wraps Jason's library for easier use.

Kyle has uploaded another video giving a try at a different blending algorithm, which get rids of the artifacts and an even creepier look: vimeo.com/​29348533
 


Sushubh

Creator of new threads from offtopic posts
Messages
407,143
Location
Gurugram
ISP
Excitel/Airtel
[video=vimeo;29348533]http://vimeo.com/29348533[/video]
 
Top