Machine learning framework to segment sarcomeric structures in SMLM data

Abstract Object detection is an image analysis task with a wide range of applications, which is difficult to accomplish with traditional programming. Recent breakthroughs in machine learning have made significant progress in this area. However, these algorithms are generally compatible with traditio...

Full description

Bibliographic Details
Main Authors: Dániel Varga, Szilárd Szikora, Tibor Novák, Gergely Pap, Gábor Lékó, József Mihály, Miklós Erdélyi
Format: Article
Language:English
Published: Nature Portfolio 2023-01-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-023-28539-7
_version_ 1811175879361953792
author Dániel Varga
Szilárd Szikora
Tibor Novák
Gergely Pap
Gábor Lékó
József Mihály
Miklós Erdélyi
author_facet Dániel Varga
Szilárd Szikora
Tibor Novák
Gergely Pap
Gábor Lékó
József Mihály
Miklós Erdélyi
author_sort Dániel Varga
collection DOAJ
description Abstract Object detection is an image analysis task with a wide range of applications, which is difficult to accomplish with traditional programming. Recent breakthroughs in machine learning have made significant progress in this area. However, these algorithms are generally compatible with traditional pixelated images and cannot be directly applied for pointillist datasets generated by single molecule localization microscopy (SMLM) methods. Here, we have improved the averaging method developed for the analysis of SMLM images of sarcomere structures based on a machine learning object detection algorithm. The ordered structure of sarcomeres allows us to determine the location of the proteins more accurately by superimposing SMLM images of identically assembled proteins. However, the area segmentation process required for averaging can be extremely time-consuming and tedious. In this work, we have automated this process. The developed algorithm not only finds the regions of interest, but also classifies the localizations and identifies the true positive ones. For training, we used simulations to generate large amounts of labelled data. After tuning the neural network’s internal parameters, it could find the localizations associated with the structures we were looking for with high accuracy. We validated our results by comparing them with previous manual evaluations. It has also been proven that the simulations can generate data of sufficient quality for training. Our method is suitable for the identification of other types of structures in SMLM data.
first_indexed 2024-04-10T19:44:09Z
format Article
id doaj.art-6d123d4c14bc4e989666171ba99c42f1
institution Directory Open Access Journal
issn 2045-2322
language English
last_indexed 2024-04-10T19:44:09Z
publishDate 2023-01-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj.art-6d123d4c14bc4e989666171ba99c42f12023-01-29T12:10:05ZengNature PortfolioScientific Reports2045-23222023-01-0113111010.1038/s41598-023-28539-7Machine learning framework to segment sarcomeric structures in SMLM dataDániel Varga0Szilárd Szikora1Tibor Novák2Gergely Pap3Gábor Lékó4József Mihály5Miklós Erdélyi6Department of Optics and Quantum Electronics, University of SzegedInstitute of Genetics, Biological Research CentreDepartment of Optics and Quantum Electronics, University of SzegedDepartment of Computer Algorithms and Artificial Intelligence, University of SzegedDepartment of Software Engineering, University of SzegedInstitute of Genetics, Biological Research CentreDepartment of Optics and Quantum Electronics, University of SzegedAbstract Object detection is an image analysis task with a wide range of applications, which is difficult to accomplish with traditional programming. Recent breakthroughs in machine learning have made significant progress in this area. However, these algorithms are generally compatible with traditional pixelated images and cannot be directly applied for pointillist datasets generated by single molecule localization microscopy (SMLM) methods. Here, we have improved the averaging method developed for the analysis of SMLM images of sarcomere structures based on a machine learning object detection algorithm. The ordered structure of sarcomeres allows us to determine the location of the proteins more accurately by superimposing SMLM images of identically assembled proteins. However, the area segmentation process required for averaging can be extremely time-consuming and tedious. In this work, we have automated this process. The developed algorithm not only finds the regions of interest, but also classifies the localizations and identifies the true positive ones. For training, we used simulations to generate large amounts of labelled data. After tuning the neural network’s internal parameters, it could find the localizations associated with the structures we were looking for with high accuracy. We validated our results by comparing them with previous manual evaluations. It has also been proven that the simulations can generate data of sufficient quality for training. Our method is suitable for the identification of other types of structures in SMLM data.https://doi.org/10.1038/s41598-023-28539-7
spellingShingle Dániel Varga
Szilárd Szikora
Tibor Novák
Gergely Pap
Gábor Lékó
József Mihály
Miklós Erdélyi
Machine learning framework to segment sarcomeric structures in SMLM data
Scientific Reports
title Machine learning framework to segment sarcomeric structures in SMLM data
title_full Machine learning framework to segment sarcomeric structures in SMLM data
title_fullStr Machine learning framework to segment sarcomeric structures in SMLM data
title_full_unstemmed Machine learning framework to segment sarcomeric structures in SMLM data
title_short Machine learning framework to segment sarcomeric structures in SMLM data
title_sort machine learning framework to segment sarcomeric structures in smlm data
url https://doi.org/10.1038/s41598-023-28539-7
work_keys_str_mv AT danielvarga machinelearningframeworktosegmentsarcomericstructuresinsmlmdata
AT szilardszikora machinelearningframeworktosegmentsarcomericstructuresinsmlmdata
AT tibornovak machinelearningframeworktosegmentsarcomericstructuresinsmlmdata
AT gergelypap machinelearningframeworktosegmentsarcomericstructuresinsmlmdata
AT gaborleko machinelearningframeworktosegmentsarcomericstructuresinsmlmdata
AT jozsefmihaly machinelearningframeworktosegmentsarcomericstructuresinsmlmdata
AT mikloserdelyi machinelearningframeworktosegmentsarcomericstructuresinsmlmdata