Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents

Collective behaviors characterize the intrinsic dynamics of the crowds. Automatically understanding collective crowd behaviors has important applications to video surveillance, traffic management and crowd control, while it is closely related to scientific fields such as statistical physics and biol...

Full description

Bibliographic Details
Main Authors: Zhou, Bolei, Tang, Xiaoou, Wang, Xiaogang
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:English
Published: Springer US 2016
Online Access:http://hdl.handle.net/1721.1/103360
https://orcid.org/0000-0002-3570-4396
_version_ 1811091229668016128
author Zhou, Bolei
Tang, Xiaoou
Wang, Xiaogang
author2 Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
author_facet Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Zhou, Bolei
Tang, Xiaoou
Wang, Xiaogang
author_sort Zhou, Bolei
collection MIT
description Collective behaviors characterize the intrinsic dynamics of the crowds. Automatically understanding collective crowd behaviors has important applications to video surveillance, traffic management and crowd control, while it is closely related to scientific fields such as statistical physics and biology. In this paper, a new mixture model of dynamic pedestrian-Agents (MDA) is proposed to learn the collective behavior patterns of pedestrians in crowded scenes from video sequences. From agent-based modeling, each pedestrian in the crowd is driven by a dynamic pedestrian-agent, which is a linear dynamic system with initial and termination states reflecting the pedestrian’s belief of the starting point and the destination. The whole crowd is then modeled as a mixture of dynamic pedestrian-agents. Once the model parameters are learned from the trajectories extracted from videos, MDA can simulate the crowd behaviors. It can also infer the past behaviors and predict the future behaviors of pedestrians given their partially observed trajectories, and classify them different pedestrian behaviors. The effectiveness of MDA and its applications are demonstrated by qualitative and quantitative experiments on various video surveillance sequences.
first_indexed 2024-09-23T14:59:01Z
format Article
id mit-1721.1/103360
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T14:59:01Z
publishDate 2016
publisher Springer US
record_format dspace
spelling mit-1721.1/1033602022-10-01T23:45:29Z Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents Zhou, Bolei Tang, Xiaoou Wang, Xiaogang Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Zhou, Bolei Collective behaviors characterize the intrinsic dynamics of the crowds. Automatically understanding collective crowd behaviors has important applications to video surveillance, traffic management and crowd control, while it is closely related to scientific fields such as statistical physics and biology. In this paper, a new mixture model of dynamic pedestrian-Agents (MDA) is proposed to learn the collective behavior patterns of pedestrians in crowded scenes from video sequences. From agent-based modeling, each pedestrian in the crowd is driven by a dynamic pedestrian-agent, which is a linear dynamic system with initial and termination states reflecting the pedestrian’s belief of the starting point and the destination. The whole crowd is then modeled as a mixture of dynamic pedestrian-agents. Once the model parameters are learned from the trajectories extracted from videos, MDA can simulate the crowd behaviors. It can also infer the past behaviors and predict the future behaviors of pedestrians given their partially observed trajectories, and classify them different pedestrian behaviors. The effectiveness of MDA and its applications are demonstrated by qualitative and quantitative experiments on various video surveillance sequences. Research Grants Council (Hong Kong, China) (Project No. CUHK417110) Research Grants Council (Hong Kong, China) (Project No. CUHK417011) Research Grants Council (Hong Kong, China) (Project No. CUHK 429412). 2016-06-27T19:30:55Z 2016-06-27T19:30:55Z 2014-06 2013-09 2016-05-23T12:14:39Z Article http://purl.org/eprint/type/JournalArticle 0920-5691 1573-1405 http://hdl.handle.net/1721.1/103360 Zhou, Bolei, Xiaoou Tang, and Xiaogang Wang. "Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents." International Journal of Computer Vision 111:1 (January 2015), pp 50-68. https://orcid.org/0000-0002-3570-4396 en http://dx.doi.org/10.1007/s11263-014-0735-3 International Journal of Computer Vision Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. Springer Science+Business Media New York application/pdf Springer US Springer US
spellingShingle Zhou, Bolei
Tang, Xiaoou
Wang, Xiaogang
Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents
title Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents
title_full Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents
title_fullStr Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents
title_full_unstemmed Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents
title_short Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents
title_sort learning collective crowd behaviors with dynamic pedestrian agents
url http://hdl.handle.net/1721.1/103360
https://orcid.org/0000-0002-3570-4396
work_keys_str_mv AT zhoubolei learningcollectivecrowdbehaviorswithdynamicpedestrianagents
AT tangxiaoou learningcollectivecrowdbehaviorswithdynamicpedestrianagents
AT wangxiaogang learningcollectivecrowdbehaviorswithdynamicpedestrianagents