Lazy Management for Frequency Table on Hardware-Based Stream Lossless Data Compression
The demand for communicating large amounts of data in real-time has raised new challenges with implementing high-speed communication paths for high definition video and sensory data. It requires the implementation of high speed data paths based on hardware. Implementation difficulties have to be add...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2016-10-01
|
| Series: | Information |
| Subjects: | |
| Online Access: | http://www.mdpi.com/2078-2489/7/4/63 |
| _version_ | 1819172894222057472 |
|---|---|
| author | Koichi Marumo Shinichi Yamagiwa Ryuta Morita Hiroshi Sakamoto |
| author_facet | Koichi Marumo Shinichi Yamagiwa Ryuta Morita Hiroshi Sakamoto |
| author_sort | Koichi Marumo |
| collection | DOAJ |
| description | The demand for communicating large amounts of data in real-time has raised new challenges with implementing high-speed communication paths for high definition video and sensory data. It requires the implementation of high speed data paths based on hardware. Implementation difficulties have to be addressed by applying new techniques based on data-oriented algorithms. This paper focuses on a solution for this problem by applying a lossless data compression mechanism on the communication data path. The new lossless data compression mechanism, called LCA-DLT, provides dynamic histogram management for symbol lookup tables used in the compression and the decompression operations. When the histogram memory is fully used, the management algorithm needs to find the least used entries and invalidate these entries. The invalidation operations cause the blocking of the compression and the decompression data stream. This paper proposes novel techniques to eliminate blocking by introducing a dynamic invalidation mechanism, which allows achievement of a high throughput data compression. |
| first_indexed | 2024-12-22T20:14:26Z |
| format | Article |
| id | doaj.art-d18d8592fe4c48d59ca82cc6c9719bbc |
| institution | Directory Open Access Journal |
| issn | 2078-2489 |
| language | English |
| last_indexed | 2024-12-22T20:14:26Z |
| publishDate | 2016-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Information |
| spelling | doaj.art-d18d8592fe4c48d59ca82cc6c9719bbc2022-12-21T18:13:59ZengMDPI AGInformation2078-24892016-10-01746310.3390/info7040063info7040063Lazy Management for Frequency Table on Hardware-Based Stream Lossless Data CompressionKoichi Marumo0Shinichi Yamagiwa1Ryuta Morita2Hiroshi Sakamoto3Department of Computer Science, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573, JapanFaculty of Engineering, Information and Systems, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573, JapanDepartment of Computer Science, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573, JapanGraduate School of Computer Science and Systems Engineering, Kyushu Institute of Technology, 680-4 Kawazu Iizuka-shi, Fukuoka 820-8502, JapanThe demand for communicating large amounts of data in real-time has raised new challenges with implementing high-speed communication paths for high definition video and sensory data. It requires the implementation of high speed data paths based on hardware. Implementation difficulties have to be addressed by applying new techniques based on data-oriented algorithms. This paper focuses on a solution for this problem by applying a lossless data compression mechanism on the communication data path. The new lossless data compression mechanism, called LCA-DLT, provides dynamic histogram management for symbol lookup tables used in the compression and the decompression operations. When the histogram memory is fully used, the management algorithm needs to find the least used entries and invalidate these entries. The invalidation operations cause the blocking of the compression and the decompression data stream. This paper proposes novel techniques to eliminate blocking by introducing a dynamic invalidation mechanism, which allows achievement of a high throughput data compression.http://www.mdpi.com/2078-2489/7/4/63lossless data compressiondynamic histogram managementlazy compression |
| spellingShingle | Koichi Marumo Shinichi Yamagiwa Ryuta Morita Hiroshi Sakamoto Lazy Management for Frequency Table on Hardware-Based Stream Lossless Data Compression Information lossless data compression dynamic histogram management lazy compression |
| title | Lazy Management for Frequency Table on Hardware-Based Stream Lossless Data Compression |
| title_full | Lazy Management for Frequency Table on Hardware-Based Stream Lossless Data Compression |
| title_fullStr | Lazy Management for Frequency Table on Hardware-Based Stream Lossless Data Compression |
| title_full_unstemmed | Lazy Management for Frequency Table on Hardware-Based Stream Lossless Data Compression |
| title_short | Lazy Management for Frequency Table on Hardware-Based Stream Lossless Data Compression |
| title_sort | lazy management for frequency table on hardware based stream lossless data compression |
| topic | lossless data compression dynamic histogram management lazy compression |
| url | http://www.mdpi.com/2078-2489/7/4/63 |
| work_keys_str_mv | AT koichimarumo lazymanagementforfrequencytableonhardwarebasedstreamlosslessdatacompression AT shinichiyamagiwa lazymanagementforfrequencytableonhardwarebasedstreamlosslessdatacompression AT ryutamorita lazymanagementforfrequencytableonhardwarebasedstreamlosslessdatacompression AT hiroshisakamoto lazymanagementforfrequencytableonhardwarebasedstreamlosslessdatacompression |