Analysis of Differential and Matching Methods for Optical Flow
Several algorithms for optical flow are studied theoretically and experimentally. Differential and matching methods are examined; these two methods have differing domains of application- differential methods are best when displacements in the image are small (<2 pixels) while matching metho...
| Main Authors: | , |
|---|---|
| Language: | en_US |
| Published: |
2004
|
| Online Access: | http://hdl.handle.net/1721.1/6494 |
| _version_ | 1811076598220193792 |
|---|---|
| author | Little, James J. Verri, Alessandro |
| author_facet | Little, James J. Verri, Alessandro |
| author_sort | Little, James J. |
| collection | MIT |
| description | Several algorithms for optical flow are studied theoretically and experimentally. Differential and matching methods are examined; these two methods have differing domains of application- differential methods are best when displacements in the image are small (<2 pixels) while matching methods work well for moderate displacements but do not handle sub-pixel motions. Both types of optical flow algorithm can use either local or global constraints, such as spatial smoothness. Local matching and differential techniques and global differential techniques will be examined. Most algorithms for optical flow utilize weak assumptions on the local variation of the flow and on the variation of image brightness. Strengthening these assumptions improves the flow computation. The computational consequence of this is a need for larger spatial and temporal support. Global differential approaches can be extended to local (patchwise) differential methods and local differential methods using higher derivatives. Using larger support is valid when constraint on the local shape of the flow are satisfied. We show that a simple constraint on the local shape of the optical flow, that there is slow spatial variation in the image plane, is often satisfied. We show how local differential methods imply the constraints for related methods using higher derivatives. Experiments show the behavior of these optical flow methods on velocity fields which so not obey the assumptions. Implementation of these methods highlights the importance of numerical differentiation. Numerical approximation of derivatives require care, in two respects: first, it is important that the temporal and spatial derivatives be matched, because of the significant scale differences in space and time, and, second, the derivative estimates improve with larger support. |
| first_indexed | 2024-09-23T10:24:41Z |
| id | mit-1721.1/6494 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T10:24:41Z |
| publishDate | 2004 |
| record_format | dspace |
| spelling | mit-1721.1/64942019-04-10T18:34:03Z Analysis of Differential and Matching Methods for Optical Flow Little, James J. Verri, Alessandro Several algorithms for optical flow are studied theoretically and experimentally. Differential and matching methods are examined; these two methods have differing domains of application- differential methods are best when displacements in the image are small (<2 pixels) while matching methods work well for moderate displacements but do not handle sub-pixel motions. Both types of optical flow algorithm can use either local or global constraints, such as spatial smoothness. Local matching and differential techniques and global differential techniques will be examined. Most algorithms for optical flow utilize weak assumptions on the local variation of the flow and on the variation of image brightness. Strengthening these assumptions improves the flow computation. The computational consequence of this is a need for larger spatial and temporal support. Global differential approaches can be extended to local (patchwise) differential methods and local differential methods using higher derivatives. Using larger support is valid when constraint on the local shape of the flow are satisfied. We show that a simple constraint on the local shape of the optical flow, that there is slow spatial variation in the image plane, is often satisfied. We show how local differential methods imply the constraints for related methods using higher derivatives. Experiments show the behavior of these optical flow methods on velocity fields which so not obey the assumptions. Implementation of these methods highlights the importance of numerical differentiation. Numerical approximation of derivatives require care, in two respects: first, it is important that the temporal and spatial derivatives be matched, because of the significant scale differences in space and time, and, second, the derivative estimates improve with larger support. 2004-10-04T15:12:56Z 2004-10-04T15:12:56Z 1988-08-01 AIM-1066 http://hdl.handle.net/1721.1/6494 en_US AIM-1066 3864719 bytes 1522929 bytes application/postscript application/pdf application/postscript application/pdf |
| spellingShingle | Little, James J. Verri, Alessandro Analysis of Differential and Matching Methods for Optical Flow |
| title | Analysis of Differential and Matching Methods for Optical Flow |
| title_full | Analysis of Differential and Matching Methods for Optical Flow |
| title_fullStr | Analysis of Differential and Matching Methods for Optical Flow |
| title_full_unstemmed | Analysis of Differential and Matching Methods for Optical Flow |
| title_short | Analysis of Differential and Matching Methods for Optical Flow |
| title_sort | analysis of differential and matching methods for optical flow |
| url | http://hdl.handle.net/1721.1/6494 |
| work_keys_str_mv | AT littlejamesj analysisofdifferentialandmatchingmethodsforopticalflow AT verrialessandro analysisofdifferentialandmatchingmethodsforopticalflow |