Reconstructing neurons from serial section electron microscopy images
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Main Author: | |
---|---|
Other Authors: | |
Format: | Thesis |
Language: | eng |
Published: |
Massachusetts Institute of Technology
2021
|
Subjects: | |
Online Access: | https://hdl.handle.net/1721.1/133076 |
_version_ | 1826194234508574720 |
---|---|
author | Lee, Kisuk, Ph. D. Massachusetts Institute of Technology. |
author2 | Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences. |
author_facet | Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences. Lee, Kisuk, Ph. D. Massachusetts Institute of Technology. |
author_sort | Lee, Kisuk, Ph. D. Massachusetts Institute of Technology. |
collection | MIT |
description | This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. |
first_indexed | 2024-09-23T09:52:59Z |
format | Thesis |
id | mit-1721.1/133076 |
institution | Massachusetts Institute of Technology |
language | eng |
last_indexed | 2024-09-23T09:52:59Z |
publishDate | 2021 |
publisher | Massachusetts Institute of Technology |
record_format | dspace |
spelling | mit-1721.1/1330762021-10-23T03:27:56Z Reconstructing neurons from serial section electron microscopy images Lee, Kisuk, Ph. D. Massachusetts Institute of Technology. Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences. Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Brain and Cognitive Sciences. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Thesis: Ph. D. in Computation, Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences, June, 2019 Cataloged from student-submitted PDF version of thesis. Includes bibliographical references (pages 155-167). Neuronal connectivity can be reconstructed from a 3D electron microscopy (EM) image of a brain volume. A challenging and important subproblem is the segmentation of the image into neurons. For the past decade, convolutional networks have been used for 3D reconstruction of neurons from EM brain images. In this thesis, we develop a set of deep learning algorithms based on convolutional nets for automated reconstruction of neurons, with particular focus on highly anisotropic images of brain tissue acquired by serial section EM (ssEM). In the first part of the thesis, we propose a recursively trained hybrid 2D-3D convolutional net architecture, and demonstrate the feasibility of exploiting 3D context to further improve boundary detection accuracy despite the high anisotropy of ssEM images. In the following parts, we propose two techniques for training convolutional nets that can substantially improve boundary detection accuracy. First, we introduce novel forms of training data augmentation based on simulation of known types of image defects such as misalignments, missing sections, and out-of-focus sections. Second, we add the auxiliary task of predicting affinities between nonneighboring voxels, reflecting the structured nature of neuronal boundary detection. We demonstrate the effectiveness of the proposed techniques on large-scale ssEM images acquired from the mouse primary visual cortex. Lastly, we take a radical departure from simple boundary detection by exploring an alternative approach to object-centered representation, that is, learning dense voxel embeddings via deep metric learning. Convolutional nets are trained to generate dense voxel embeddings by assigning similar vectors to voxels within the same objects and well-separated vectors to voxels from different objects. Our proposed method achieves state-of-the-art accuracy with substantial improvements on very thin objects. by Kisuk Lee. Ph. D. in Computation Ph.D.inComputation Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences 2021-10-22T20:27:20Z 2021-10-22T20:27:20Z 2019 2019 Thesis https://hdl.handle.net/1721.1/133076 1264708701 eng MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided. http://dspace.mit.edu/handle/1721.1/7582 167 pages application/pdf Massachusetts Institute of Technology |
spellingShingle | Brain and Cognitive Sciences. Lee, Kisuk, Ph. D. Massachusetts Institute of Technology. Reconstructing neurons from serial section electron microscopy images |
title | Reconstructing neurons from serial section electron microscopy images |
title_full | Reconstructing neurons from serial section electron microscopy images |
title_fullStr | Reconstructing neurons from serial section electron microscopy images |
title_full_unstemmed | Reconstructing neurons from serial section electron microscopy images |
title_short | Reconstructing neurons from serial section electron microscopy images |
title_sort | reconstructing neurons from serial section electron microscopy images |
topic | Brain and Cognitive Sciences. |
url | https://hdl.handle.net/1721.1/133076 |
work_keys_str_mv | AT leekisukphdmassachusettsinstituteoftechnology reconstructingneuronsfromserialsectionelectronmicroscopyimages |