Phase-based video motion processing

We introduce a technique to manipulate small movements in videos based on an analysis of motion in complex-valued image pyramids. Phase variations of the coefficients of a complex-valued steerable pyramid over time correspond to motion, and can be temporally processed and amplified to reveal imperceptible motions, or attenuated to remove distracting changes. This processing does not involve the computation of optical flow, and in comparison to the previous Eulerian Video Magnification method it supports larger amplification factors and is significantly less sensitive to noise. These improved capabilities broaden the set of applications for motion processing in videos. We demonstrate the advantages of this…

• NS
  National Science Foundation

  Award: CGV-1111415
• UD
  U.S. Department of Defense
• MR
  Microsoft Research
• DA
  Defense Advanced Research Projects Agency
• ND
  National Defense Science and Engineering Graduate