3D Shape-Encoded Particle Filter for Object Tracking and Its Application to Human Body Tracking
We present a nonlinear state estimation approach using particle filters, for tracking objects whose approximate 3D shapes are known. The unnormalized conditional density for the solution to the nonlinear filtering problem leads to the Zakai equation, and is realized by the weights of the particles....
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2008-03-01
|
| Series: | EURASIP Journal on Image and Video Processing |
| Online Access: | http://dx.doi.org/10.1155/2008/596989 |
| _version_ | 1819018419584892928 |
|---|---|
| author | R. Chellappa H. Moon |
| author_facet | R. Chellappa H. Moon |
| author_sort | R. Chellappa |
| collection | DOAJ |
| description | We present a nonlinear state estimation approach using particle filters, for tracking objects whose approximate 3D shapes are known. The unnormalized conditional density for the solution to the nonlinear filtering problem leads to the Zakai equation, and is realized by the weights of the particles. The weight of a particle represents its geometric and temporal fit, which is computed bottom-up from the raw image using a shape-encoded filter. The main contribution of the paper is the design of smoothing filters for feature extraction combined with the adoption of unnormalized conditional density weights. The “shape filter†has the overall form of the predicted 2D projection of the 3D model, while the cross-section of the filter is designed to collect the gradient responses along the shape. The 3D-model-based representation is designed to emphasize the changes in 2D object shape due to motion, while de-emphasizing the variations due to lighting and other imaging conditions. We have found that the set of sparse measurements using a relatively small number of particles is able to approximate the high-dimensional state distribution very effectively. As a measures to stabilize the tracking, the amount of random diffusion is effectively adjusted using a Kalman updating of the covariance matrix. For a complex problem of human body tracking, we have successfully employed constraints derived from joint angles and walking motion. |
| first_indexed | 2024-12-21T03:19:07Z |
| format | Article |
| id | doaj.art-bce6082fee9344e88c093feec411793d |
| institution | Directory Open Access Journal |
| issn | 1687-5176 1687-5281 |
| language | English |
| last_indexed | 2024-12-21T03:19:07Z |
| publishDate | 2008-03-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | EURASIP Journal on Image and Video Processing |
| spelling | doaj.art-bce6082fee9344e88c093feec411793d2022-12-21T19:17:44ZengSpringerOpenEURASIP Journal on Image and Video Processing1687-51761687-52812008-03-01200810.1155/2008/5969893D Shape-Encoded Particle Filter for Object Tracking and Its Application to Human Body TrackingR. ChellappaH. MoonWe present a nonlinear state estimation approach using particle filters, for tracking objects whose approximate 3D shapes are known. The unnormalized conditional density for the solution to the nonlinear filtering problem leads to the Zakai equation, and is realized by the weights of the particles. The weight of a particle represents its geometric and temporal fit, which is computed bottom-up from the raw image using a shape-encoded filter. The main contribution of the paper is the design of smoothing filters for feature extraction combined with the adoption of unnormalized conditional density weights. The “shape filter†has the overall form of the predicted 2D projection of the 3D model, while the cross-section of the filter is designed to collect the gradient responses along the shape. The 3D-model-based representation is designed to emphasize the changes in 2D object shape due to motion, while de-emphasizing the variations due to lighting and other imaging conditions. We have found that the set of sparse measurements using a relatively small number of particles is able to approximate the high-dimensional state distribution very effectively. As a measures to stabilize the tracking, the amount of random diffusion is effectively adjusted using a Kalman updating of the covariance matrix. For a complex problem of human body tracking, we have successfully employed constraints derived from joint angles and walking motion.http://dx.doi.org/10.1155/2008/596989 |
| spellingShingle | R. Chellappa H. Moon 3D Shape-Encoded Particle Filter for Object Tracking and Its Application to Human Body Tracking EURASIP Journal on Image and Video Processing |
| title | 3D Shape-Encoded Particle Filter for Object Tracking and Its Application to Human Body Tracking |
| title_full | 3D Shape-Encoded Particle Filter for Object Tracking and Its Application to Human Body Tracking |
| title_fullStr | 3D Shape-Encoded Particle Filter for Object Tracking and Its Application to Human Body Tracking |
| title_full_unstemmed | 3D Shape-Encoded Particle Filter for Object Tracking and Its Application to Human Body Tracking |
| title_short | 3D Shape-Encoded Particle Filter for Object Tracking and Its Application to Human Body Tracking |
| title_sort | 3d shape encoded particle filter for object tracking and its application to human body tracking |
| url | http://dx.doi.org/10.1155/2008/596989 |
| work_keys_str_mv | AT rchellappa 3dshapeencodedparticlefilterforobjecttrackinganditsapplicationtohumanbodytracking AT hmoon 3dshapeencodedparticlefilterforobjecttrackinganditsapplicationtohumanbodytracking |