NeST: nested hierarchical structure identification in spatial transcriptomic data

Abstract Spatial gene expression in tissue is characterized by regions in which particular genes are enriched or depleted. Frequently, these regions contain nested inside them subregions with distinct expression patterns. Segmentation methods in spatial transcriptomic (ST) data extract disjoint regi...

Full description

Bibliographic Details
Main Authors: Benjamin L. Walker, Qing Nie
Format: Article
Language:English
Published: Nature Portfolio 2023-10-01
Series:Nature Communications
Online Access:https://doi.org/10.1038/s41467-023-42343-x
_version_ 1827709600979222528
author Benjamin L. Walker
Qing Nie
author_facet Benjamin L. Walker
Qing Nie
author_sort Benjamin L. Walker
collection DOAJ
description Abstract Spatial gene expression in tissue is characterized by regions in which particular genes are enriched or depleted. Frequently, these regions contain nested inside them subregions with distinct expression patterns. Segmentation methods in spatial transcriptomic (ST) data extract disjoint regions maximizing similarity over the greatest number of genes, typically on a particular spatial scale, thus lacking the ability to find region-within-region structure. We present NeST, which extracts spatial structure through coexpression hotspots—regions exhibiting localized spatial coexpression of some set of genes. Coexpression hotspots identify structure on any spatial scale, over any possible subset of genes, and are highly explainable. NeST also performs spatial analysis of cell-cell interactions via ligand-receptor, identifying active areas de novo without restriction of cell type or other groupings, in both two and three dimensions. Through application on ST datasets of varying type and resolution, we demonstrate the ability of NeST to reveal a new level of biological structure.
first_indexed 2024-03-10T17:24:14Z
format Article
id doaj.art-446a0081ee504cd497d853c2758b0e4e
institution Directory Open Access Journal
issn 2041-1723
language English
last_indexed 2024-03-10T17:24:14Z
publishDate 2023-10-01
publisher Nature Portfolio
record_format Article
series Nature Communications
spelling doaj.art-446a0081ee504cd497d853c2758b0e4e2023-11-20T10:12:57ZengNature PortfolioNature Communications2041-17232023-10-0114111710.1038/s41467-023-42343-xNeST: nested hierarchical structure identification in spatial transcriptomic dataBenjamin L. Walker0Qing Nie1The NSF-Simons Center for Multiscale Cell Fate Research, University of California IrvineThe NSF-Simons Center for Multiscale Cell Fate Research, University of California IrvineAbstract Spatial gene expression in tissue is characterized by regions in which particular genes are enriched or depleted. Frequently, these regions contain nested inside them subregions with distinct expression patterns. Segmentation methods in spatial transcriptomic (ST) data extract disjoint regions maximizing similarity over the greatest number of genes, typically on a particular spatial scale, thus lacking the ability to find region-within-region structure. We present NeST, which extracts spatial structure through coexpression hotspots—regions exhibiting localized spatial coexpression of some set of genes. Coexpression hotspots identify structure on any spatial scale, over any possible subset of genes, and are highly explainable. NeST also performs spatial analysis of cell-cell interactions via ligand-receptor, identifying active areas de novo without restriction of cell type or other groupings, in both two and three dimensions. Through application on ST datasets of varying type and resolution, we demonstrate the ability of NeST to reveal a new level of biological structure.https://doi.org/10.1038/s41467-023-42343-x
spellingShingle Benjamin L. Walker
Qing Nie
NeST: nested hierarchical structure identification in spatial transcriptomic data
Nature Communications
title NeST: nested hierarchical structure identification in spatial transcriptomic data
title_full NeST: nested hierarchical structure identification in spatial transcriptomic data
title_fullStr NeST: nested hierarchical structure identification in spatial transcriptomic data
title_full_unstemmed NeST: nested hierarchical structure identification in spatial transcriptomic data
title_short NeST: nested hierarchical structure identification in spatial transcriptomic data
title_sort nest nested hierarchical structure identification in spatial transcriptomic data
url https://doi.org/10.1038/s41467-023-42343-x
work_keys_str_mv AT benjaminlwalker nestnestedhierarchicalstructureidentificationinspatialtranscriptomicdata
AT qingnie nestnestedhierarchicalstructureidentificationinspatialtranscriptomicdata