A probabilistic graphical model based data compression architecture for Gaussian sources

Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016.

Bibliographic Details
Main Author: Lai, Wai Lok, M. Eng. Massachusetts Institute of Technology
Other Authors: Gregory W. Wornell.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2018
Subjects:
Online Access:http://hdl.handle.net/1721.1/117322
_version_ 1811090404888543232
author Lai, Wai Lok, M. Eng. Massachusetts Institute of Technology
author2 Gregory W. Wornell.
author_facet Gregory W. Wornell.
Lai, Wai Lok, M. Eng. Massachusetts Institute of Technology
author_sort Lai, Wai Lok, M. Eng. Massachusetts Institute of Technology
collection MIT
description Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016.
first_indexed 2024-09-23T14:45:06Z
format Thesis
id mit-1721.1/117322
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T14:45:06Z
publishDate 2018
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1173222019-04-11T13:32:20Z A probabilistic graphical model based data compression architecture for Gaussian sources Lai, Wai Lok, M. Eng. Massachusetts Institute of Technology Gregory W. Wornell. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016. Cataloged from PDF version of thesis. Includes bibliographical references (pages 107-108). Data is compressible because of inherent redundancies in the data, mathematically expressed as correlation structures. A data compression algorithm uses the knowledge of these structures to map the original data to a different encoding. The two aspects of data compression, source modeling, ie. using knowledge about the source, and coding, ie. assigning an output sequence of symbols to each output, are not inherently related, but most existing algorithms mix the two and treat the two as one. This work builds on recent research on model-code separation compression architectures to extend this concept into the domain of lossy compression of continuous sources, in particular, Gaussian sources. To our knowledge, this is the first attempt with using with sparse linear coding and discrete-continuous hybrid graphical model decoding for compressing continuous sources. With the flexibility afforded by the modularity of the architecture, we show that the proposed system is free from many inadequacies of existing algorithms, at the same time achieving competitive compression rates. Moreover, the modularity allows for many architectural extensions, with capabilities unimaginable for existing algorithms, including refining of source model after compression, robustness to data corruption, seamless interface with source model parameter learning, and joint homomorphic encryption-compression. This work, meant to be an exploration in a new direction in data compression, is at the intersection of Electrical Engineering and Computer Science, tying together the disciplines of information theory, digital communication, data compression, machine learning, and cryptography. by Wai Lok Lai. M. Eng. 2018-08-08T19:49:23Z 2018-08-08T19:49:23Z 2016 2016 Thesis http://hdl.handle.net/1721.1/117322 1046448953 eng MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission. http://dspace.mit.edu/handle/1721.1/7582 108 pages application/pdf Massachusetts Institute of Technology
spellingShingle Electrical Engineering and Computer Science.
Lai, Wai Lok, M. Eng. Massachusetts Institute of Technology
A probabilistic graphical model based data compression architecture for Gaussian sources
title A probabilistic graphical model based data compression architecture for Gaussian sources
title_full A probabilistic graphical model based data compression architecture for Gaussian sources
title_fullStr A probabilistic graphical model based data compression architecture for Gaussian sources
title_full_unstemmed A probabilistic graphical model based data compression architecture for Gaussian sources
title_short A probabilistic graphical model based data compression architecture for Gaussian sources
title_sort probabilistic graphical model based data compression architecture for gaussian sources
topic Electrical Engineering and Computer Science.
url http://hdl.handle.net/1721.1/117322
work_keys_str_mv AT laiwailokmengmassachusettsinstituteoftechnology aprobabilisticgraphicalmodelbaseddatacompressionarchitectureforgaussiansources
AT laiwailokmengmassachusettsinstituteoftechnology probabilisticgraphicalmodelbaseddatacompressionarchitectureforgaussiansources