Image‐based real‐time feedback control of magnetic digital microfluidics by artificial intelligence‐empowered rapid object detector for automated in vitro diagnostics
Abstract In vitro diagnostics (IVD) plays a critical role in healthcare and public health management. Magnetic digital microfluidics (MDM) perform IVD assays by manipulating droplets on an open substrate with magnetic particles. Automated IVD based on MDM could reduce the risk of accidental exposure...
Main Authors: | , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2023-07-01
|
Series: | Bioengineering & Translational Medicine |
Subjects: | |
Online Access: | https://doi.org/10.1002/btm2.10428 |
_version_ | 1797777258295853056 |
---|---|
author | Yuxuan Tang Fei Duan Aiwu Zhou Pojchanun Kanitthamniyom Shaobo Luo Xuyang Hu Xudong Jiang Shawn Vasoo Xiaosheng Zhang Yi Zhang |
author_facet | Yuxuan Tang Fei Duan Aiwu Zhou Pojchanun Kanitthamniyom Shaobo Luo Xuyang Hu Xudong Jiang Shawn Vasoo Xiaosheng Zhang Yi Zhang |
author_sort | Yuxuan Tang |
collection | DOAJ |
description | Abstract In vitro diagnostics (IVD) plays a critical role in healthcare and public health management. Magnetic digital microfluidics (MDM) perform IVD assays by manipulating droplets on an open substrate with magnetic particles. Automated IVD based on MDM could reduce the risk of accidental exposure to contagious pathogens among healthcare workers. However, it remains challenging to create a fully automated IVD platform based on the MDM technology because of a lack of effective feedback control system to ensure the successful execution of various droplet operations required for IVD. In this work, an artificial intelligence (AI)‐empowered MDM platform with image‐based real‐time feedback control is presented. The AI is trained to recognize droplets and magnetic particles, measure their size, and determine their location and relationship in real time; it shows the ability to rectify failed droplet operations based on the feedback information, a function that is unattainable by conventional MDM platforms, thereby ensuring that the entire IVD process is not interrupted due to the failure of liquid handling. We demonstrate fundamental droplet operations, which include droplet transport, particle extraction, droplet merging and droplet mixing, on the MDM platform and show how the AI rectify failed droplet operations by acting upon the feedback information. Protein quantification and antibiotic resistance detection are performed on this AI‐empowered MDM platform, and the results obtained agree well with the benchmarks. We envision that this AI‐based feedback approach will be widely adopted not only by MDM but also by other types of digital microfluidic platforms to offer precise and error‐free droplet operations for a wide range of automated IVD applications. |
first_indexed | 2024-03-12T23:01:34Z |
format | Article |
id | doaj.art-3b1eaf529cb9499292bd880be96bd03c |
institution | Directory Open Access Journal |
issn | 2380-6761 |
language | English |
last_indexed | 2024-03-12T23:01:34Z |
publishDate | 2023-07-01 |
publisher | Wiley |
record_format | Article |
series | Bioengineering & Translational Medicine |
spelling | doaj.art-3b1eaf529cb9499292bd880be96bd03c2023-07-19T09:59:03ZengWileyBioengineering & Translational Medicine2380-67612023-07-0184n/an/a10.1002/btm2.10428Image‐based real‐time feedback control of magnetic digital microfluidics by artificial intelligence‐empowered rapid object detector for automated in vitro diagnosticsYuxuan Tang0Fei Duan1Aiwu Zhou2Pojchanun Kanitthamniyom3Shaobo Luo4Xuyang Hu5Xudong Jiang6Shawn Vasoo7Xiaosheng Zhang8Yi Zhang9School of Mechanical and Aerospace Engineering Nanyang Technological University Singapore SingaporeSchool of Mechanical and Aerospace Engineering Nanyang Technological University Singapore SingaporeSingapore Center for 3D Printing, School of Mechanical and Aerospace Engineering Nanyang Technological University Singapore SingaporeSchool of Mechanical and Aerospace Engineering Nanyang Technological University Singapore SingaporeSchool of Microelectronics Southern University of Science and Technology Shenzhen ChinaChina‐Singapore International Joint Research Institute Guangzhou ChinaSchool of Electronic and Electrical Engineering Nanyang Technological University Singapore SingaporeNational Center for Infectious Disease Tan Tock Seng Hospital Singapore SingaporeSchool of Electronic Science and Engineering University of Electronic Science and Technology of China Chengdu ChinaSchool of Electronic Science and Engineering University of Electronic Science and Technology of China Chengdu ChinaAbstract In vitro diagnostics (IVD) plays a critical role in healthcare and public health management. Magnetic digital microfluidics (MDM) perform IVD assays by manipulating droplets on an open substrate with magnetic particles. Automated IVD based on MDM could reduce the risk of accidental exposure to contagious pathogens among healthcare workers. However, it remains challenging to create a fully automated IVD platform based on the MDM technology because of a lack of effective feedback control system to ensure the successful execution of various droplet operations required for IVD. In this work, an artificial intelligence (AI)‐empowered MDM platform with image‐based real‐time feedback control is presented. The AI is trained to recognize droplets and magnetic particles, measure their size, and determine their location and relationship in real time; it shows the ability to rectify failed droplet operations based on the feedback information, a function that is unattainable by conventional MDM platforms, thereby ensuring that the entire IVD process is not interrupted due to the failure of liquid handling. We demonstrate fundamental droplet operations, which include droplet transport, particle extraction, droplet merging and droplet mixing, on the MDM platform and show how the AI rectify failed droplet operations by acting upon the feedback information. Protein quantification and antibiotic resistance detection are performed on this AI‐empowered MDM platform, and the results obtained agree well with the benchmarks. We envision that this AI‐based feedback approach will be widely adopted not only by MDM but also by other types of digital microfluidic platforms to offer precise and error‐free droplet operations for a wide range of automated IVD applications.https://doi.org/10.1002/btm2.10428artificial intelligenceIn vitro diagnosticsmagnetic digital microfluidics |
spellingShingle | Yuxuan Tang Fei Duan Aiwu Zhou Pojchanun Kanitthamniyom Shaobo Luo Xuyang Hu Xudong Jiang Shawn Vasoo Xiaosheng Zhang Yi Zhang Image‐based real‐time feedback control of magnetic digital microfluidics by artificial intelligence‐empowered rapid object detector for automated in vitro diagnostics Bioengineering & Translational Medicine artificial intelligence In vitro diagnostics magnetic digital microfluidics |
title | Image‐based real‐time feedback control of magnetic digital microfluidics by artificial intelligence‐empowered rapid object detector for automated in vitro diagnostics |
title_full | Image‐based real‐time feedback control of magnetic digital microfluidics by artificial intelligence‐empowered rapid object detector for automated in vitro diagnostics |
title_fullStr | Image‐based real‐time feedback control of magnetic digital microfluidics by artificial intelligence‐empowered rapid object detector for automated in vitro diagnostics |
title_full_unstemmed | Image‐based real‐time feedback control of magnetic digital microfluidics by artificial intelligence‐empowered rapid object detector for automated in vitro diagnostics |
title_short | Image‐based real‐time feedback control of magnetic digital microfluidics by artificial intelligence‐empowered rapid object detector for automated in vitro diagnostics |
title_sort | image based real time feedback control of magnetic digital microfluidics by artificial intelligence empowered rapid object detector for automated in vitro diagnostics |
topic | artificial intelligence In vitro diagnostics magnetic digital microfluidics |
url | https://doi.org/10.1002/btm2.10428 |
work_keys_str_mv | AT yuxuantang imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics AT feiduan imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics AT aiwuzhou imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics AT pojchanunkanitthamniyom imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics AT shaoboluo imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics AT xuyanghu imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics AT xudongjiang imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics AT shawnvasoo imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics AT xiaoshengzhang imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics AT yizhang imagebasedrealtimefeedbackcontrolofmagneticdigitalmicrofluidicsbyartificialintelligenceempoweredrapidobjectdetectorforautomatedinvitrodiagnostics |