Bird-Count: a multi-modality benchmark and system for bird population counting in the wild

The fluctuation of the bird population reflects the change in the ecosystem, which plays a vital role in ecosystem conservation. However, manual counting is still the mainstream method for bird population counting, which is time-consuming and laborious. One major bottleneck in developing efficient,...

Full description

Bibliographic Details
Main Authors: Wang, Hongchang, Lu, Huaxiang, Guo, Huimin, Jian, Haifang, Gan, Chuang, Liu, Wu
Other Authors: MIT-IBM Watson AI Lab
Format: Article
Language:English
Published: Springer US 2023
Online Access:https://hdl.handle.net/1721.1/153063
_version_ 1811094736224649216
author Wang, Hongchang
Lu, Huaxiang
Guo, Huimin
Jian, Haifang
Gan, Chuang
Liu, Wu
author2 MIT-IBM Watson AI Lab
author_facet MIT-IBM Watson AI Lab
Wang, Hongchang
Lu, Huaxiang
Guo, Huimin
Jian, Haifang
Gan, Chuang
Liu, Wu
author_sort Wang, Hongchang
collection MIT
description The fluctuation of the bird population reflects the change in the ecosystem, which plays a vital role in ecosystem conservation. However, manual counting is still the mainstream method for bird population counting, which is time-consuming and laborious. One major bottleneck in developing efficient, accurate, and intelligent learning algorithms to counting birds is the lack of large-scale datasets. In this paper, the first large-scale bird population counting dataset, named Bird-Count, with multi-modality morphology annotations is proposed. This paper first evaluates various state-of-the-art (SOTA) models for crowd counting on the Bird-Count and gets poor results. The reason is that the forms, appearances, and postures among different birds are more variant than the crowd. To mitigate these challenges, a simple yet effective plug-and-play framework, called Morphology Prior Knowledge Fusion Network (MPKNet), which can be used on-site to help generate a high-precision bird population density map by incorporating morphological prior knowledge, is proposed. Comprehensive evaluations show that the proposed method can reduce the error rate by 6.02% compared with the current SOTA crowd counting algorithms on average. Moreover, with the above technologies, the intelligent bird population monitoring system is deployed in several important wetland national nature reserves for bird protection.
first_indexed 2024-09-23T16:04:16Z
format Article
id mit-1721.1/153063
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T16:04:16Z
publishDate 2023
publisher Springer US
record_format dspace
spelling mit-1721.1/1530632024-09-16T04:48:44Z Bird-Count: a multi-modality benchmark and system for bird population counting in the wild Wang, Hongchang Lu, Huaxiang Guo, Huimin Jian, Haifang Gan, Chuang Liu, Wu MIT-IBM Watson AI Lab The fluctuation of the bird population reflects the change in the ecosystem, which plays a vital role in ecosystem conservation. However, manual counting is still the mainstream method for bird population counting, which is time-consuming and laborious. One major bottleneck in developing efficient, accurate, and intelligent learning algorithms to counting birds is the lack of large-scale datasets. In this paper, the first large-scale bird population counting dataset, named Bird-Count, with multi-modality morphology annotations is proposed. This paper first evaluates various state-of-the-art (SOTA) models for crowd counting on the Bird-Count and gets poor results. The reason is that the forms, appearances, and postures among different birds are more variant than the crowd. To mitigate these challenges, a simple yet effective plug-and-play framework, called Morphology Prior Knowledge Fusion Network (MPKNet), which can be used on-site to help generate a high-precision bird population density map by incorporating morphological prior knowledge, is proposed. Comprehensive evaluations show that the proposed method can reduce the error rate by 6.02% compared with the current SOTA crowd counting algorithms on average. Moreover, with the above technologies, the intelligent bird population monitoring system is deployed in several important wetland national nature reserves for bird protection. 2023-11-29T14:38:16Z 2023-11-29T14:38:16Z 2023-04-29 2023-11-29T04:24:37Z Article http://purl.org/eprint/type/JournalArticle https://hdl.handle.net/1721.1/153063 Wang, Hongchang, Lu, Huaxiang, Guo, Huimin, Jian, Haifang, Gan, Chuang et al. 2023. "Bird-Count: a multi-modality benchmark and system for bird population counting in the wild." en https://doi.org/10.1007/s11042-023-14833-z Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature application/pdf Springer US Springer US
spellingShingle Wang, Hongchang
Lu, Huaxiang
Guo, Huimin
Jian, Haifang
Gan, Chuang
Liu, Wu
Bird-Count: a multi-modality benchmark and system for bird population counting in the wild
title Bird-Count: a multi-modality benchmark and system for bird population counting in the wild
title_full Bird-Count: a multi-modality benchmark and system for bird population counting in the wild
title_fullStr Bird-Count: a multi-modality benchmark and system for bird population counting in the wild
title_full_unstemmed Bird-Count: a multi-modality benchmark and system for bird population counting in the wild
title_short Bird-Count: a multi-modality benchmark and system for bird population counting in the wild
title_sort bird count a multi modality benchmark and system for bird population counting in the wild
url https://hdl.handle.net/1721.1/153063
work_keys_str_mv AT wanghongchang birdcountamultimodalitybenchmarkandsystemforbirdpopulationcountinginthewild
AT luhuaxiang birdcountamultimodalitybenchmarkandsystemforbirdpopulationcountinginthewild
AT guohuimin birdcountamultimodalitybenchmarkandsystemforbirdpopulationcountinginthewild
AT jianhaifang birdcountamultimodalitybenchmarkandsystemforbirdpopulationcountinginthewild
AT ganchuang birdcountamultimodalitybenchmarkandsystemforbirdpopulationcountinginthewild
AT liuwu birdcountamultimodalitybenchmarkandsystemforbirdpopulationcountinginthewild