This innovative research into using high resolution photos in conjunction with lower quality video leads to some very interesting possibilities… the depth mapping conjures visions of adjustable depth-of-field in post, for example.
Check out the video examples:
The work presents a system for automatically producing a wide variety of video enhancements and visual effects. Unlike traditional visual effects software (e.g., After Effects, Shake, Boujou, etc), the system is completely automatic and no manual labor is required from the user. The major limitation of the work is that it can currently handle only videos of static scenes (i.e., videos shot with a moving camera but containing no moving objects in the scene). Efforts are being made to lift this restriction in future work.
Applications of the system include:
High resolution/definition video,
High dynamic range video,
Removing objects from a video,
Creating painterly (NPR) videos,
Easy video editing
More info here.