A simple class of efficient compression schemes supporting local access and editing

In this paper, we study the problem of compressing a collection of sequences of variable length that allows us to efficiently add, read, or edit an arbitrary sequence without decompressing the whole data. This problem has important applications in data servers, file-editing systems, and bioinformati...

Full description

Bibliographic Details
Main Authors: Zhou, Hongchao, Wang, Da, Wornell, Gregory W.
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers (IEEE) 2014
Online Access:http://hdl.handle.net/1721.1/91135
https://orcid.org/0000-0001-9166-4758
_version_ 1811079265407467520
author Zhou, Hongchao
Wang, Da
Wornell, Gregory W.
author2 Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
author_facet Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Zhou, Hongchao
Wang, Da
Wornell, Gregory W.
author_sort Zhou, Hongchao
collection MIT
description In this paper, we study the problem of compressing a collection of sequences of variable length that allows us to efficiently add, read, or edit an arbitrary sequence without decompressing the whole data. This problem has important applications in data servers, file-editing systems, and bioinformatics. We propose a novel and practical compression scheme, which shows that, by paying a small price in storage space (3% extra storage space in our examples), we can retrieve or edit a sequence (a few hundred bits) by accessing compressed bits close to the entropy of the sequence.
first_indexed 2024-09-23T11:12:08Z
format Article
id mit-1721.1/91135
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T11:12:08Z
publishDate 2014
publisher Institute of Electrical and Electronics Engineers (IEEE)
record_format dspace
spelling mit-1721.1/911352022-10-01T02:00:22Z A simple class of efficient compression schemes supporting local access and editing Zhou, Hongchao Wang, Da Wornell, Gregory W. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology. Research Laboratory of Electronics Zhou, Hongchao Wang, Da Wornell, Gregory W. In this paper, we study the problem of compressing a collection of sequences of variable length that allows us to efficiently add, read, or edit an arbitrary sequence without decompressing the whole data. This problem has important applications in data servers, file-editing systems, and bioinformatics. We propose a novel and practical compression scheme, which shows that, by paying a small price in storage space (3% extra storage space in our examples), we can retrieve or edit a sequence (a few hundred bits) by accessing compressed bits close to the entropy of the sequence. United States. Air Force Office of Scientific Research (Grant FA9550-11-1-0183) National Science Foundation (U.S.) (Grant CCF-1017772) 2014-10-21T18:08:21Z 2014-10-21T18:08:21Z 2014-06 Article http://purl.org/eprint/type/ConferencePaper 978-1-4799-5186-4 http://hdl.handle.net/1721.1/91135 Zhou, Hongchao, Da Wang, and Gregory Wornell. “A Simple Class of Efficient Compression Schemes Supporting Local Access and Editing.” 2014 IEEE International Symposium on Information Theory (June 2014). https://orcid.org/0000-0001-9166-4758 en_US http://dx.doi.org/10.1109/ISIT.2014.6875282 Proceedings of the 2014 IEEE International Symposium on Information Theory Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) MIT web domain
spellingShingle Zhou, Hongchao
Wang, Da
Wornell, Gregory W.
A simple class of efficient compression schemes supporting local access and editing
title A simple class of efficient compression schemes supporting local access and editing
title_full A simple class of efficient compression schemes supporting local access and editing
title_fullStr A simple class of efficient compression schemes supporting local access and editing
title_full_unstemmed A simple class of efficient compression schemes supporting local access and editing
title_short A simple class of efficient compression schemes supporting local access and editing
title_sort simple class of efficient compression schemes supporting local access and editing
url http://hdl.handle.net/1721.1/91135
https://orcid.org/0000-0001-9166-4758
work_keys_str_mv AT zhouhongchao asimpleclassofefficientcompressionschemessupportinglocalaccessandediting
AT wangda asimpleclassofefficientcompressionschemessupportinglocalaccessandediting
AT wornellgregoryw asimpleclassofefficientcompressionschemessupportinglocalaccessandediting
AT zhouhongchao simpleclassofefficientcompressionschemessupportinglocalaccessandediting
AT wangda simpleclassofefficientcompressionschemessupportinglocalaccessandediting
AT wornellgregoryw simpleclassofefficientcompressionschemessupportinglocalaccessandediting