EFFICIENTLY PROCESSING DATA IN TABLE WITH BILLIONS OF RECORDS
Over time, systems connected to databases slow down. This is usually due to the increase in the amount of data stored in individual tables, counted even in the billions of records. Nevertheless, there are methods for making the speed of the system independent of the number of records in the databas...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Lublin University of Technology
2022-12-01
|
| Series: | Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska |
| Subjects: | |
| Online Access: | https://ph.pollub.pl/index.php/iapgos/article/view/3058 |
| _version_ | 1797974529064042496 |
|---|---|
| author | Piotr Bednarczuk Adam Borsuk |
| author_facet | Piotr Bednarczuk Adam Borsuk |
| author_sort | Piotr Bednarczuk |
| collection | DOAJ |
| description |
Over time, systems connected to databases slow down. This is usually due to the increase in the amount of data stored in individual tables, counted even in the billions of records. Nevertheless, there are methods for making the speed of the system independent of the number of records in the database. One of these ways is table partitioning. When used correctly, the solution can ensure efficient operation of very large databases even after several years. However, not everything is predictable because of some undesirable phenomena become apparent only with a very large amount of data. The article presents a study of the execution time of the same queries with increasing number of records in a table. These studies reveal and present the timing and circumstances of the anomaly for a certain number of records.
|
| first_indexed | 2024-04-11T04:20:08Z |
| format | Article |
| id | doaj.art-fce982c750f4474eb2b82804f391ef15 |
| institution | Directory Open Access Journal |
| issn | 2083-0157 2391-6761 |
| language | English |
| last_indexed | 2024-04-11T04:20:08Z |
| publishDate | 2022-12-01 |
| publisher | Lublin University of Technology |
| record_format | Article |
| series | Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska |
| spelling | doaj.art-fce982c750f4474eb2b82804f391ef152022-12-30T22:21:40ZengLublin University of TechnologyInformatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska2083-01572391-67612022-12-0112410.35784/iapgos.3058EFFICIENTLY PROCESSING DATA IN TABLE WITH BILLIONS OF RECORDSPiotr Bednarczuk0Adam Borsuk1University of Economics and Innovation in Lublin, Institute of Computer ScienceUniversity of Economics and Innovation in Lublin, Institute of Computer Science Over time, systems connected to databases slow down. This is usually due to the increase in the amount of data stored in individual tables, counted even in the billions of records. Nevertheless, there are methods for making the speed of the system independent of the number of records in the database. One of these ways is table partitioning. When used correctly, the solution can ensure efficient operation of very large databases even after several years. However, not everything is predictable because of some undesirable phenomena become apparent only with a very large amount of data. The article presents a study of the execution time of the same queries with increasing number of records in a table. These studies reveal and present the timing and circumstances of the anomaly for a certain number of records. https://ph.pollub.pl/index.php/iapgos/article/view/3058systems agingpartitioningefficiently data processingbillions of records |
| spellingShingle | Piotr Bednarczuk Adam Borsuk EFFICIENTLY PROCESSING DATA IN TABLE WITH BILLIONS OF RECORDS Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska systems aging partitioning efficiently data processing billions of records |
| title | EFFICIENTLY PROCESSING DATA IN TABLE WITH BILLIONS OF RECORDS |
| title_full | EFFICIENTLY PROCESSING DATA IN TABLE WITH BILLIONS OF RECORDS |
| title_fullStr | EFFICIENTLY PROCESSING DATA IN TABLE WITH BILLIONS OF RECORDS |
| title_full_unstemmed | EFFICIENTLY PROCESSING DATA IN TABLE WITH BILLIONS OF RECORDS |
| title_short | EFFICIENTLY PROCESSING DATA IN TABLE WITH BILLIONS OF RECORDS |
| title_sort | efficiently processing data in table with billions of records |
| topic | systems aging partitioning efficiently data processing billions of records |
| url | https://ph.pollub.pl/index.php/iapgos/article/view/3058 |
| work_keys_str_mv | AT piotrbednarczuk efficientlyprocessingdataintablewithbillionsofrecords AT adamborsuk efficientlyprocessingdataintablewithbillionsofrecords |