Manipulating lossless video in the compressed domain

A compressed-domain transformation is one that operates directly on the compressed format, rather than requiring conversion to an uncompressed format prior to processing. Performing operations in the compressed domain offers large speedups, as it reduces the volume of data processed and avoids the o...

Full description

Bibliographic Details
Main Authors: Thies, William, Hall, Steven, Amarasinghe, Saman P.
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:en_US
Published: Association for Computing Machinery 2011
Online Access:http://hdl.handle.net/1721.1/63126
https://orcid.org/0000-0002-7231-7643
_version_ 1826198822595854336
author Thies, William
Hall, Steven
Amarasinghe, Saman P.
author2 Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
author_facet Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Thies, William
Hall, Steven
Amarasinghe, Saman P.
author_sort Thies, William
collection MIT
description A compressed-domain transformation is one that operates directly on the compressed format, rather than requiring conversion to an uncompressed format prior to processing. Performing operations in the compressed domain offers large speedups, as it reduces the volume of data processed and avoids the overhead of re-compression. While previous researchers have focused on compressed-domain techniques for lossy data formats, there are few techniques that apply to lossless formats. In this paper, we present a general technique for transforming lossless data as compressed with the sliding-window Lempel Ziv algorithm (LZ77). We focus on applications in video editing, where our technique supports color adjustment, video compositing, and other operations directly on the Apple Animation format (a variant of LZ77). We implemented a subset of our technique as an automatic program transformation. Using the StreamIt language, users write a program to operate on uncompressed data, and our compiler transforms the program to operate on compressed data. Experiments show that the technique offers speedups roughly proportional to the compression factor. For our benchmark suite of 12 videos in Apple Animation format, speedups range from 1.1x to 471x, with a median of 15x.
first_indexed 2024-09-23T11:10:33Z
format Article
id mit-1721.1/63126
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T11:10:33Z
publishDate 2011
publisher Association for Computing Machinery
record_format dspace
spelling mit-1721.1/631262022-09-27T17:37:55Z Manipulating lossless video in the compressed domain Thies, William Hall, Steven Amarasinghe, Saman P. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Amarasinghe, Saman P. Hall, Steven Amarasinghe, Saman P. A compressed-domain transformation is one that operates directly on the compressed format, rather than requiring conversion to an uncompressed format prior to processing. Performing operations in the compressed domain offers large speedups, as it reduces the volume of data processed and avoids the overhead of re-compression. While previous researchers have focused on compressed-domain techniques for lossy data formats, there are few techniques that apply to lossless formats. In this paper, we present a general technique for transforming lossless data as compressed with the sliding-window Lempel Ziv algorithm (LZ77). We focus on applications in video editing, where our technique supports color adjustment, video compositing, and other operations directly on the Apple Animation format (a variant of LZ77). We implemented a subset of our technique as an automatic program transformation. Using the StreamIt language, users write a program to operate on uncompressed data, and our compiler transforms the program to operate on compressed data. Experiments show that the technique offers speedups roughly proportional to the compression factor. For our benchmark suite of 12 videos in Apple Animation format, speedups range from 1.1x to 471x, with a median of 15x. National Science Foundation (U.S.) (Grant No. CNS-0305453) National Science Foundation (U.S.) (Grant No. ACI-0325297) Gigascale Systems Research Center 2011-05-26T14:59:29Z 2011-05-26T14:59:29Z 2009-10 2009-10 Article http://purl.org/eprint/type/ConferencePaper 978-1-60558-608-3 http://hdl.handle.net/1721.1/63126 Thies, William, Steven Hall, and Saman Amarasinghe. “Manipulating Lossless Video in the Compressed Domain.” Proceedings of the 17th ACM International Conference on Multimedia. Beijing, China: ACM, 2009. 331-340. https://orcid.org/0000-0002-7231-7643 en_US http://dx.doi.org/10.1145/1631272.1631319 Proceedings of the 17th ACM international conference on Multimedia Creative Commons Attribution-Noncommercial-Share Alike 3.0 http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf Association for Computing Machinery MIT web domain
spellingShingle Thies, William
Hall, Steven
Amarasinghe, Saman P.
Manipulating lossless video in the compressed domain
title Manipulating lossless video in the compressed domain
title_full Manipulating lossless video in the compressed domain
title_fullStr Manipulating lossless video in the compressed domain
title_full_unstemmed Manipulating lossless video in the compressed domain
title_short Manipulating lossless video in the compressed domain
title_sort manipulating lossless video in the compressed domain
url http://hdl.handle.net/1721.1/63126
https://orcid.org/0000-0002-7231-7643
work_keys_str_mv AT thieswilliam manipulatinglosslessvideointhecompresseddomain
AT hallsteven manipulatinglosslessvideointhecompresseddomain
AT amarasinghesamanp manipulatinglosslessvideointhecompresseddomain