Research and Implementation of Document-Relational Data Query Execution Tech-nology
With the arrival of the era of big data, Internet applications have produced abundant data types. Integ-rating storage, query and organization of data with various structures is a research hotspot of large data management system. The relational database and NoSQL document database are performed unif...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press
2020-08-01
|
| Series: | Jisuanji kexue yu tansuo |
| Subjects: | |
| Online Access: | http://fcst.ceaj.org/CN/abstract/abstract2327.shtml |
| _version_ | 1818649750981836800 |
|---|---|
| author | MA Zhicheng, YUAN Haifeng, GU Yang, LIU Yaru, ZHANG Xiao |
| author_facet | MA Zhicheng, YUAN Haifeng, GU Yang, LIU Yaru, ZHANG Xiao |
| author_sort | MA Zhicheng, YUAN Haifeng, GU Yang, LIU Yaru, ZHANG Xiao |
| collection | DOAJ |
| description | With the arrival of the era of big data, Internet applications have produced abundant data types. Integ-rating storage, query and organization of data with various structures is a research hotspot of large data management system. The relational database and NoSQL document database are performed unified management. Two different database engines supporting structured and semi-structured data are integrated into the large data management system. The query engine ENTIA is implemented to perform query processing. Based on the global view, a unified query interface is provided to users. The end user does not need to care about the type and structure of the data, and the physical storage location. It only needs to send a request to ENTIA according to the business requirements. A large number of preliminary experiments are carried out to optimize the query based on heuristic rules. The single query is rewritten into multiple query sub-tasks that can be executed in parallel. The calculation is pushed to the appropriate database engine, which makes full use of the computing resources of the system and greatly improves the query performance of the system. Represented by two peer-to-peer engines of relational database PostgreSQL and document database MongoDB, ENTIA’s query ability for multiple data types and query optimization are realized. ENTIA can correctly execute mixed queries through functional coincidence experiments. The effectiveness of the optimization method is proven by a number of performance comparison experiments. |
| first_indexed | 2024-12-17T01:39:18Z |
| format | Article |
| id | doaj.art-22793e140f2a45cdb01ffa00f4339a1a |
| institution | Directory Open Access Journal |
| issn | 1673-9418 |
| language | zho |
| last_indexed | 2024-12-17T01:39:18Z |
| publishDate | 2020-08-01 |
| publisher | Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press |
| record_format | Article |
| series | Jisuanji kexue yu tansuo |
| spelling | doaj.art-22793e140f2a45cdb01ffa00f4339a1a2022-12-21T22:08:21ZzhoJournal of Computer Engineering and Applications Beijing Co., Ltd., Science PressJisuanji kexue yu tansuo1673-94182020-08-011481315132610.3778/j.issn.1673-9418.1908023Research and Implementation of Document-Relational Data Query Execution Tech-nologyMA Zhicheng, YUAN Haifeng, GU Yang, LIU Yaru, ZHANG Xiao01. State Grid Gansu Electric Power Research Institute, Lanzhou 730070, China 2. Key Laboratory of Data Engineering and Knowledge Engineering (Renmin University of China), Ministry of Education, Beijing 100872, China 3. School of Information, Renmin University of China, Beijing 100872, ChinaWith the arrival of the era of big data, Internet applications have produced abundant data types. Integ-rating storage, query and organization of data with various structures is a research hotspot of large data management system. The relational database and NoSQL document database are performed unified management. Two different database engines supporting structured and semi-structured data are integrated into the large data management system. The query engine ENTIA is implemented to perform query processing. Based on the global view, a unified query interface is provided to users. The end user does not need to care about the type and structure of the data, and the physical storage location. It only needs to send a request to ENTIA according to the business requirements. A large number of preliminary experiments are carried out to optimize the query based on heuristic rules. The single query is rewritten into multiple query sub-tasks that can be executed in parallel. The calculation is pushed to the appropriate database engine, which makes full use of the computing resources of the system and greatly improves the query performance of the system. Represented by two peer-to-peer engines of relational database PostgreSQL and document database MongoDB, ENTIA’s query ability for multiple data types and query optimization are realized. ENTIA can correctly execute mixed queries through functional coincidence experiments. The effectiveness of the optimization method is proven by a number of performance comparison experiments.http://fcst.ceaj.org/CN/abstract/abstract2327.shtmlrelation databasedocument databasehybrid queryquery optimization |
| spellingShingle | MA Zhicheng, YUAN Haifeng, GU Yang, LIU Yaru, ZHANG Xiao Research and Implementation of Document-Relational Data Query Execution Tech-nology Jisuanji kexue yu tansuo relation database document database hybrid query query optimization |
| title | Research and Implementation of Document-Relational Data Query Execution Tech-nology |
| title_full | Research and Implementation of Document-Relational Data Query Execution Tech-nology |
| title_fullStr | Research and Implementation of Document-Relational Data Query Execution Tech-nology |
| title_full_unstemmed | Research and Implementation of Document-Relational Data Query Execution Tech-nology |
| title_short | Research and Implementation of Document-Relational Data Query Execution Tech-nology |
| title_sort | research and implementation of document relational data query execution tech nology |
| topic | relation database document database hybrid query query optimization |
| url | http://fcst.ceaj.org/CN/abstract/abstract2327.shtml |
| work_keys_str_mv | AT mazhichengyuanhaifengguyangliuyaruzhangxiao researchandimplementationofdocumentrelationaldataqueryexecutiontechnology |