Deep learning–assisted biodiversity assessment in deep-sea benthic megafauna communities: a case study in the context of polymetallic nodule mining
IntroductionTechnological developments have facilitated the collection of large amounts of imagery from isolated deep-sea ecosystems such as abyssal nodule fields. Application of imagery as a monitoring tool in these areas of interest for deep-sea exploitation is extremely valuable. However, in orde...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2024-04-01
|
| Series: | Frontiers in Marine Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fmars.2024.1366078/full |
| _version_ | 1797202657648050176 |
|---|---|
| author | Daphne Cuvelier Martin Zurowietz Tim W. Nattkemper |
| author_facet | Daphne Cuvelier Martin Zurowietz Tim W. Nattkemper |
| author_sort | Daphne Cuvelier |
| collection | DOAJ |
| description | IntroductionTechnological developments have facilitated the collection of large amounts of imagery from isolated deep-sea ecosystems such as abyssal nodule fields. Application of imagery as a monitoring tool in these areas of interest for deep-sea exploitation is extremely valuable. However, in order to collect a comprehensive number of species observations, thousands of images need to be analysed, especially if a high diversity is combined with low abundances such is the case in the abyssal nodule fields. As the visual interpretation of large volumes of imagery and the manual extraction of quantitative information is time-consuming and error-prone, computational detection tools may play a key role to lessen this burden. Yet, there is still no established workflow for efficient marine image analysis using deep learning–based computer vision systems for the task of fauna detection and classification.MethodsIn this case study, a dataset of 2100 images from the deep-sea polymetallic nodule fields of the eastern Clarion-Clipperton Fracture zone from the SO268 expedition (2019) was selected to investigate the potential of machine learning–assisted marine image annotation workflows. The Machine Learning Assisted Image Annotation method (MAIA), provided by the BIIGLE system, was applied to different set-ups trained with manually annotated fauna data. The results computed with the different set-ups were compared to those obtained by trained marine biologists regarding accuracy (i.e. recall and precision) and time.ResultsOur results show that MAIA can be applied for a general object (i.e. species) detection with satisfactory accuracy (90.1% recall and 13.4% precision), when considered as one intermediate step in a comprehensive annotation workflow. We also investigated the performance for different volumes of training data, MAIA performance tuned for individual morphological groups and the impact of sediment coverage in the training data.DiscussionWe conclude that: a) steps must be taken to enable computer vision scientists to access more image data from the CCZ to improve the system’s performance and b) computational species detection in combination with a posteriori filtering by marine biologists has a higher efficiency than fully manual analyses. |
| first_indexed | 2024-04-24T08:06:55Z |
| format | Article |
| id | doaj.art-3e03d5b2b0b14d35af6029dd7cfcc723 |
| institution | Directory Open Access Journal |
| issn | 2296-7745 |
| language | English |
| last_indexed | 2024-04-24T08:06:55Z |
| publishDate | 2024-04-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Marine Science |
| spelling | doaj.art-3e03d5b2b0b14d35af6029dd7cfcc7232024-04-17T09:48:09ZengFrontiers Media S.A.Frontiers in Marine Science2296-77452024-04-011110.3389/fmars.2024.13660781366078Deep learning–assisted biodiversity assessment in deep-sea benthic megafauna communities: a case study in the context of polymetallic nodule miningDaphne Cuvelier0Martin Zurowietz1Tim W. Nattkemper2Institute of Marine Sciences - Okeanos, University of the Azores, Horta, PortugalBiodata Mining Group, Faculty of Technology, Bielefeld University, Bielefeld, GermanyBiodata Mining Group, Faculty of Technology, Bielefeld University, Bielefeld, GermanyIntroductionTechnological developments have facilitated the collection of large amounts of imagery from isolated deep-sea ecosystems such as abyssal nodule fields. Application of imagery as a monitoring tool in these areas of interest for deep-sea exploitation is extremely valuable. However, in order to collect a comprehensive number of species observations, thousands of images need to be analysed, especially if a high diversity is combined with low abundances such is the case in the abyssal nodule fields. As the visual interpretation of large volumes of imagery and the manual extraction of quantitative information is time-consuming and error-prone, computational detection tools may play a key role to lessen this burden. Yet, there is still no established workflow for efficient marine image analysis using deep learning–based computer vision systems for the task of fauna detection and classification.MethodsIn this case study, a dataset of 2100 images from the deep-sea polymetallic nodule fields of the eastern Clarion-Clipperton Fracture zone from the SO268 expedition (2019) was selected to investigate the potential of machine learning–assisted marine image annotation workflows. The Machine Learning Assisted Image Annotation method (MAIA), provided by the BIIGLE system, was applied to different set-ups trained with manually annotated fauna data. The results computed with the different set-ups were compared to those obtained by trained marine biologists regarding accuracy (i.e. recall and precision) and time.ResultsOur results show that MAIA can be applied for a general object (i.e. species) detection with satisfactory accuracy (90.1% recall and 13.4% precision), when considered as one intermediate step in a comprehensive annotation workflow. We also investigated the performance for different volumes of training data, MAIA performance tuned for individual morphological groups and the impact of sediment coverage in the training data.DiscussionWe conclude that: a) steps must be taken to enable computer vision scientists to access more image data from the CCZ to improve the system’s performance and b) computational species detection in combination with a posteriori filtering by marine biologists has a higher efficiency than fully manual analyses.https://www.frontiersin.org/articles/10.3389/fmars.2024.1366078/fullmarine imagingbiodiversitybenthic communitiescomputer visiondeep learning |
| spellingShingle | Daphne Cuvelier Martin Zurowietz Tim W. Nattkemper Deep learning–assisted biodiversity assessment in deep-sea benthic megafauna communities: a case study in the context of polymetallic nodule mining Frontiers in Marine Science marine imaging biodiversity benthic communities computer vision deep learning |
| title | Deep learning–assisted biodiversity assessment in deep-sea benthic megafauna communities: a case study in the context of polymetallic nodule mining |
| title_full | Deep learning–assisted biodiversity assessment in deep-sea benthic megafauna communities: a case study in the context of polymetallic nodule mining |
| title_fullStr | Deep learning–assisted biodiversity assessment in deep-sea benthic megafauna communities: a case study in the context of polymetallic nodule mining |
| title_full_unstemmed | Deep learning–assisted biodiversity assessment in deep-sea benthic megafauna communities: a case study in the context of polymetallic nodule mining |
| title_short | Deep learning–assisted biodiversity assessment in deep-sea benthic megafauna communities: a case study in the context of polymetallic nodule mining |
| title_sort | deep learning assisted biodiversity assessment in deep sea benthic megafauna communities a case study in the context of polymetallic nodule mining |
| topic | marine imaging biodiversity benthic communities computer vision deep learning |
| url | https://www.frontiersin.org/articles/10.3389/fmars.2024.1366078/full |
| work_keys_str_mv | AT daphnecuvelier deeplearningassistedbiodiversityassessmentindeepseabenthicmegafaunacommunitiesacasestudyinthecontextofpolymetallicnodulemining AT martinzurowietz deeplearningassistedbiodiversityassessmentindeepseabenthicmegafaunacommunitiesacasestudyinthecontextofpolymetallicnodulemining AT timwnattkemper deeplearningassistedbiodiversityassessmentindeepseabenthicmegafaunacommunitiesacasestudyinthecontextofpolymetallicnodulemining |