Learning Guided Electron Microscopy with Active Acquisition
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12265).
| Main Authors: | , , , , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | English |
| Published: |
Springer International Publishing
2021
|
| Online Access: | https://hdl.handle.net/1721.1/130096 |
| _version_ | 1826191445303754752 |
|---|---|
| author | Mi, Lu Wang, Hao Meirovitch, Yaron Schalek, Richard Turaga, Srinivas C. Lichtman, Jeff W. Samuel, Aravinthan D. T. Shavit, Nir N. |
| author2 | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
| author_facet | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Mi, Lu Wang, Hao Meirovitch, Yaron Schalek, Richard Turaga, Srinivas C. Lichtman, Jeff W. Samuel, Aravinthan D. T. Shavit, Nir N. |
| author_sort | Mi, Lu |
| collection | MIT |
| description | Part of the Lecture Notes in Computer Science book series (LNCS, volume 12265). |
| first_indexed | 2024-09-23T08:55:58Z |
| format | Article |
| id | mit-1721.1/130096 |
| institution | Massachusetts Institute of Technology |
| language | English |
| last_indexed | 2024-09-23T08:55:58Z |
| publishDate | 2021 |
| publisher | Springer International Publishing |
| record_format | dspace |
| spelling | mit-1721.1/1300962022-09-26T09:19:03Z Learning Guided Electron Microscopy with Active Acquisition Mi, Lu Wang, Hao Meirovitch, Yaron Schalek, Richard Turaga, Srinivas C. Lichtman, Jeff W. Samuel, Aravinthan D. T. Shavit, Nir N. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Part of the Lecture Notes in Computer Science book series (LNCS, volume 12265). Single-beam scanning electron microscopes (SEM) are widely used to acquire massive datasets for biomedical study, material analysis, and fabrication inspection. Datasets are typically acquired with uniform acquisition: applying the electron beam with the same power and duration to all image pixels, even if there is great variety in the pixels’ importance for eventual use. Many SEMs are now able to move the beam to any pixel in the field of view without delay, enabling them, in principle, to invest their time budget more effectively with non-uniform imaging. In this paper, we show how to use deep learning to accelerate and optimize single-beam SEM acquisition of images. Our algorithm rapidly collects an information-lossy image (e.g. low resolution) and then applies a novel learning method to identify a small subset of pixels to be collected at higher resolution based on a trade-off between the saliency and spatial diversity. We demonstrate the efficacy of this novel technique for active acquisition by speeding up the task of collecting connectomic datasets for neurobiology by up to an order of magnitude. Code is available at https://github.com/lumi9587/learning-guided-SEM. National Science Foundation (Grants IS-1607189, CCF-1563880, IOS-1452593 and NSF-1806818) 2021-03-08T18:25:40Z 2021-03-08T18:25:40Z 2020-09 2021-02-04T16:14:08Z Article http://purl.org/eprint/type/ConferencePaper 9783030597214 9783030597221 0302-9743 1611-3349 https://hdl.handle.net/1721.1/130096 Mi, Lu et al. "Learning Guided Electron Microscopy with Active Acquisition." MICCAI: International Conference on Medical Image Computing and Computer-Assisted Intervention, Lecture Notes in Computer Science, 12265, Springer, 2020, 77-87. © 2020 Springer Nature en http://dx.doi.org/10.1007/978-3-030-59722-1_8 Lecture Notes in Computer Science Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Springer International Publishing arXiv |
| spellingShingle | Mi, Lu Wang, Hao Meirovitch, Yaron Schalek, Richard Turaga, Srinivas C. Lichtman, Jeff W. Samuel, Aravinthan D. T. Shavit, Nir N. Learning Guided Electron Microscopy with Active Acquisition |
| title | Learning Guided Electron Microscopy with Active Acquisition |
| title_full | Learning Guided Electron Microscopy with Active Acquisition |
| title_fullStr | Learning Guided Electron Microscopy with Active Acquisition |
| title_full_unstemmed | Learning Guided Electron Microscopy with Active Acquisition |
| title_short | Learning Guided Electron Microscopy with Active Acquisition |
| title_sort | learning guided electron microscopy with active acquisition |
| url | https://hdl.handle.net/1721.1/130096 |
| work_keys_str_mv | AT milu learningguidedelectronmicroscopywithactiveacquisition AT wanghao learningguidedelectronmicroscopywithactiveacquisition AT meirovitchyaron learningguidedelectronmicroscopywithactiveacquisition AT schalekrichard learningguidedelectronmicroscopywithactiveacquisition AT turagasrinivasc learningguidedelectronmicroscopywithactiveacquisition AT lichtmanjeffw learningguidedelectronmicroscopywithactiveacquisition AT samuelaravinthandt learningguidedelectronmicroscopywithactiveacquisition AT shavitnirn learningguidedelectronmicroscopywithactiveacquisition |