An investigation of sparse tensor formats for tensor libraries

Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016.

Bibliographic Details
Main Author: Tew, Parker Allen
Other Authors: Saman Amarasinghe.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2018
Subjects:
Online Access:http://hdl.handle.net/1721.1/113496
_version_ 1826196264373452800
author Tew, Parker Allen
author2 Saman Amarasinghe.
author_facet Saman Amarasinghe.
Tew, Parker Allen
author_sort Tew, Parker Allen
collection MIT
description Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016.
first_indexed 2024-09-23T10:23:49Z
format Thesis
id mit-1721.1/113496
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T10:23:49Z
publishDate 2018
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1134962019-04-11T06:54:06Z An investigation of sparse tensor formats for tensor libraries Tew, Parker Allen Saman Amarasinghe. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016. Cataloged from PDF version of thesis. Includes bibliographical references (pages 52-53). Tensors provide a generalized structure to store arbitrary indexable data, which is applicable in fields such as chemometrics, physics simulations, signal processing and lies at the heart of machine learning. Many naturally occurring tensors are considered sparse as they contain mostly zero values. As with sparse matrices, various techniques can be employed to more efficiently store and compute on these sparse tensors. This work explores several sparse tensor formats while ultimately evaluating two implementations; one based on explicitly storing coordinates and one that compresses these coordinates. The two formats, Coordinate and CSF2, were evaluated by comparing their execution time of tensor-matrix products and the MTTKRP operation on several datasets. We find that the Coordinate format is superior for uniformly distributed sparse tensors or when used in computation that emits a sparse tensor via a mode dependent operation. In all other considered cases for large sparse tensors, the storage savings of the compressed format provide the best results. by Parker Allen Tew. M. Eng. 2018-02-08T16:26:28Z 2018-02-08T16:26:28Z 2016 2016 Thesis http://hdl.handle.net/1721.1/113496 1020068839 eng MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission. http://dspace.mit.edu/handle/1721.1/7582 53 pages application/pdf Massachusetts Institute of Technology
spellingShingle Electrical Engineering and Computer Science.
Tew, Parker Allen
An investigation of sparse tensor formats for tensor libraries
title An investigation of sparse tensor formats for tensor libraries
title_full An investigation of sparse tensor formats for tensor libraries
title_fullStr An investigation of sparse tensor formats for tensor libraries
title_full_unstemmed An investigation of sparse tensor formats for tensor libraries
title_short An investigation of sparse tensor formats for tensor libraries
title_sort investigation of sparse tensor formats for tensor libraries
topic Electrical Engineering and Computer Science.
url http://hdl.handle.net/1721.1/113496
work_keys_str_mv AT tewparkerallen aninvestigationofsparsetensorformatsfortensorlibraries
AT tewparkerallen investigationofsparsetensorformatsfortensorlibraries