TorchSparse++: Efficient Training and Inference Framework for Sparse Convolution on GPUs

TorchSparse++: Efficient Training and Inference Framework for Sparse Convolution on GPUs

Sparse convolution plays a pivotal role in emerging workloads, including point cloud processing in AR/VR, autonomous driving, and graph understanding in recommendation systems. Since the computation pattern is sparse and irregular, specialized high-performance kernels are required. Existing GPU libr...

Full description

Bibliographic Details
Main Authors:	Tang, Haotian, Yang, Shang, Liu, Zhijian, Hong, Ke, Yu, Zhongming, Li, Xiuyu, Dai, Guohao, Wang, Yu, Han, Song
Format:	Article
Language:	English
Published:	ACM\|56th Annual IEEE/ACM International Symposium on Microarchitecture 2024
Online Access:	https://hdl.handle.net/1721.1/153260

Similar Items

OpSparse: A Highly Optimized Framework for Sparse General Matrix Multiplication on GPUs
by: Zhaoyang Du, et al.
Published: (2022-01-01)

SparseRT: Accelerating Unstructured Sparsity on GPUs for Deep Learning Inference
by: Wang, Ziheng
Published: (2022)

Communication Optimization of Iterative Sparse Matrix-Vector Multiply on GPUs and FPGAs
by: Rafique, Abid, et al.
Published: (2015)

Leveraging Memory Copy Overlap for Efficient Sparse Matrix-Vector Multiplication on GPUs
by: Guangsen Zeng, et al.
Published: (2023-08-01)

Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution
by: Tang, Haotian, et al.
Published: (2022)

Performance Analysis of Sparse Matrix-Vector Multiplication (SpMV) on Graphics Processing Units (GPUs)
by: Sarah AlAhmadi, et al.
Published: (2020-10-01)

Tardigrade: A Hardware Accelerator for Sparse Matrix Multiplication and Sparse Convolution
by: Attaluri, Nithya
Published: (2023)

Sparse convolutional array for DOA estimation
by: Zikai Wang, et al.
Published: (2022-10-01)

SECOND: Sparsely Embedded Convolutional Detection
by: Yan Yan, et al.
Published: (2018-10-01)

Photoacoustic microscopy with sparse data by convolutional neural networks
by: Jiasheng Zhou, et al.
Published: (2021-06-01)

A sparse iteration space transformation framework for sparse tensor algebra
by: Senanayake, Ryan, et al.
Published: (2021)

Inference for High-Dimensional Sparse Econometric Models
by: Belloni, Alexandre, et al.
Published: (2019)

A Comparative Study of Block Incomplete Sparse Approximate Inverses Preconditioning on Tesla K20 and V100 GPUs
by: Wenpeng Ma, et al.
Published: (2021-06-01)

Sparse-PE: A Performance-Efficient Processing Engine Core for Sparse Convolutional Neural Networks
by: Mahmood Azhar Qureshi, et al.
Published: (2021-01-01)

Fast Bayesian inference of Sparse Networks with automatic sparsity determination
by: Yu, Hang, et al.
Published: (2021)

Pansharpening Based on Convolution Sparse Representation and NSCT
by: Yuting LIU, et al.
Published: (2022-07-01)

Grand Canonical Ensembles of Sparse Networks and Bayesian Inference
by: Ginestra Bianconi
Published: (2022-04-01)

Inferring Sparse Preference Lists from Partial Information
by: Farias, Vivek, et al.
Published: (2021)

Sparse and compositionally robust inference of microbial ecological networks.
by: Zachary D Kurtz, et al.
Published: (2015-05-01)

Image Denoising by Deep Convolution Based on Sparse Representation
by: Shengqin Bian, et al.
Published: (2023-05-01)

Convolutional Sparse Coding for Static and Dynamic Images Analysis
by: B. A. Knyazev, et al.
Published: (2014-01-01)

Two-Branch Convolutional Sparse Representation for Stereo Matching
by: Chunbo Cheng, et al.
Published: (2021-01-01)

Representation Learning via Cauchy Convolutional Sparse Coding
by: Perla Mayo, et al.
Published: (2021-01-01)

Sparse Recovery Using Sparse Matrices
by: Gilbert, Anna, et al.
Published: (2012)

Sparse recovery using sparse matrices
by: Berinde, Radu, et al.
Published: (2008)

Sparse Recovery Using Sparse Matrices
by: Gilbert, Anna, et al.
Published: (2021)

Sparse Pixel Training of Convolutional Neural Networks for Land Cover Classification
by: Noureldin Laban, et al.
Published: (2021-01-01)

Dynamic sparse no training: training-free fine-tuning for sparse llms
by: Tanner, J
Published: (2024)

RSNN: A Software/Hardware Co-Optimized Framework for Sparse Convolutional Neural Networks on FPGAs
by: Weijie You, et al.
Published: (2021-01-01)

Sparse Subspace Clustering for Stream Data
by: Ken Chen, et al.
Published: (2021-01-01)

Sampling and inference for beta neutral-to-the-left models of sparse networks
by: Bloem-Reddy, B, et al.
Published: (2018)

Performance characterization and optimization of pruning patterns for sparse DNN inference
by: Yunjie Liu, et al.
Published: (2022-10-01)

Stochastic Variational Inference for Bayesian Sparse Gaussian Process Regression
by: Hoang, Trong Nghia, et al.
Published: (2021)

Stochastic Variational Inference for Bayesian Sparse Gaussian Process Regression
by: Hoang, Trong Nghia, et al.
Published: (2021)

Analyzing the instructions vulnerability of dense convolutional network on GPUS
by: Khalid, Adam, et al.
Published: (2021)

Rolling Bearing Performance Degradation Assessment Based on Convolutional Sparse Combination Learning
by: Wenyi Huang, et al.
Published: (2019-01-01)

Sparse PCA from sparse linear regression
by: Bresler, Guy, et al.
Published: (2021)

Sparse PCA from sparse linear regression
by: Bresler, Guy, et al.
Published: (2022)

Joint bayesian convolutional sparse coding for image super-resolution.
by: Qi Ge, et al.
Published: (2018-01-01)

Performance Evaluation of INT8 Quantized Inference on Mobile GPUs
by: Sumin Kim, et al.
Published: (2021-01-01)