An Integrated Solution to Improve Performance of In-Memory Data Caching With an Efficient Item Retrieving Mechanism and a Near-Memory Accelerator
This paper proposes both software and hardware mechanisms based on the near-memory processing (NMP) accelerator to improve the linked list traversal of the in-memory caching. From a software perspective, we propose a simple but an effective mechanism called ITEM JUMP to reduce the number of traversa...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10173496/ |
| _version_ | 1797746136638816256 |
|---|---|
| author | Minkwan Kee Chiwon Han Gi-Ho Park |
| author_facet | Minkwan Kee Chiwon Han Gi-Ho Park |
| author_sort | Minkwan Kee |
| collection | DOAJ |
| description | This paper proposes both software and hardware mechanisms based on the near-memory processing (NMP) accelerator to improve the linked list traversal of the in-memory caching. From a software perspective, we propose a simple but an effective mechanism called ITEM JUMP to reduce the number of traversal on list iteration, and additionally, LSB-first parallel linked list traversal unit, which is an NMP-based hardware accelerator is proposed to improve parallel comparison performance of items. The evaluation result shows LSB-first parallel linked list traversal unit can achieve about 34 times better performance in item comparisons than the case where there is no hardware accelerator, and ITEM JUMP can reduce the number of items retrieved by up to 42%. The proposed NMP-based hardware accelerator also reduces the memory access overhead by 61%–83% compared to a simple parallel linked list traversal unit that simply loads and compares data as fast as possible. |
| first_indexed | 2024-03-12T15:32:41Z |
| format | Article |
| id | doaj.art-a973790e77264e1f903b733a4c9a3a3b |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-12T15:32:41Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-a973790e77264e1f903b733a4c9a3a3b2023-08-09T23:00:26ZengIEEEIEEE Access2169-35362023-01-0111787267873610.1109/ACCESS.2023.329258210173496An Integrated Solution to Improve Performance of In-Memory Data Caching With an Efficient Item Retrieving Mechanism and a Near-Memory AcceleratorMinkwan Kee0https://orcid.org/0000-0003-4506-1061Chiwon Han1Gi-Ho Park2https://orcid.org/0000-0001-7998-4302Computer Science and Engineering, Sejong University, Gwangjin-gu, Seoul, Republic of KoreaComputer Science and Engineering, Sejong University, Gwangjin-gu, Seoul, Republic of KoreaComputer Science and Engineering, Sejong University, Gwangjin-gu, Seoul, Republic of KoreaThis paper proposes both software and hardware mechanisms based on the near-memory processing (NMP) accelerator to improve the linked list traversal of the in-memory caching. From a software perspective, we propose a simple but an effective mechanism called ITEM JUMP to reduce the number of traversal on list iteration, and additionally, LSB-first parallel linked list traversal unit, which is an NMP-based hardware accelerator is proposed to improve parallel comparison performance of items. The evaluation result shows LSB-first parallel linked list traversal unit can achieve about 34 times better performance in item comparisons than the case where there is no hardware accelerator, and ITEM JUMP can reduce the number of items retrieved by up to 42%. The proposed NMP-based hardware accelerator also reduces the memory access overhead by 61%–83% compared to a simple parallel linked list traversal unit that simply loads and compares data as fast as possible.https://ieeexplore.ieee.org/document/10173496/Database systemaccelerator architecturesmemory architecturein-memory databaselinked list traversal accelerationnear memory processing |
| spellingShingle | Minkwan Kee Chiwon Han Gi-Ho Park An Integrated Solution to Improve Performance of In-Memory Data Caching With an Efficient Item Retrieving Mechanism and a Near-Memory Accelerator IEEE Access Database system accelerator architectures memory architecture in-memory database linked list traversal acceleration near memory processing |
| title | An Integrated Solution to Improve Performance of In-Memory Data Caching With an Efficient Item Retrieving Mechanism and a Near-Memory Accelerator |
| title_full | An Integrated Solution to Improve Performance of In-Memory Data Caching With an Efficient Item Retrieving Mechanism and a Near-Memory Accelerator |
| title_fullStr | An Integrated Solution to Improve Performance of In-Memory Data Caching With an Efficient Item Retrieving Mechanism and a Near-Memory Accelerator |
| title_full_unstemmed | An Integrated Solution to Improve Performance of In-Memory Data Caching With an Efficient Item Retrieving Mechanism and a Near-Memory Accelerator |
| title_short | An Integrated Solution to Improve Performance of In-Memory Data Caching With an Efficient Item Retrieving Mechanism and a Near-Memory Accelerator |
| title_sort | integrated solution to improve performance of in memory data caching with an efficient item retrieving mechanism and a near memory accelerator |
| topic | Database system accelerator architectures memory architecture in-memory database linked list traversal acceleration near memory processing |
| url | https://ieeexplore.ieee.org/document/10173496/ |
| work_keys_str_mv | AT minkwankee anintegratedsolutiontoimproveperformanceofinmemorydatacachingwithanefficientitemretrievingmechanismandanearmemoryaccelerator AT chiwonhan anintegratedsolutiontoimproveperformanceofinmemorydatacachingwithanefficientitemretrievingmechanismandanearmemoryaccelerator AT gihopark anintegratedsolutiontoimproveperformanceofinmemorydatacachingwithanefficientitemretrievingmechanismandanearmemoryaccelerator AT minkwankee integratedsolutiontoimproveperformanceofinmemorydatacachingwithanefficientitemretrievingmechanismandanearmemoryaccelerator AT chiwonhan integratedsolutiontoimproveperformanceofinmemorydatacachingwithanefficientitemretrievingmechanismandanearmemoryaccelerator AT gihopark integratedsolutiontoimproveperformanceofinmemorydatacachingwithanefficientitemretrievingmechanismandanearmemoryaccelerator |