Julia implementation of the Dynamic Distributed Dimensional Data Model
Julia is a new language for writing data analysis programs that are easy to implement and run at high performance. Similarly, the Dynamic Distributed Dimensional Data Model (D4M) aims to clarify data analysis operations while retaining strong performance. D4M accomplishes these goals through a compo...
| Main Authors: | , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Published: |
Institute of Electrical and Electronics Engineers (IEEE)
2018
|
| Online Access: | http://hdl.handle.net/1721.1/115967 https://orcid.org/0000-0001-8083-7289 https://orcid.org/0000-0001-7676-3133 |
| _version_ | 1826208718665023488 |
|---|---|
| author | Chen, Alexander Y. Edelman, Alan Kepner, Jeremy Gadepally, Vijay N. Hutchison, Dylan D. |
| author2 | Lincoln Laboratory |
| author_facet | Lincoln Laboratory Chen, Alexander Y. Edelman, Alan Kepner, Jeremy Gadepally, Vijay N. Hutchison, Dylan D. |
| author_sort | Chen, Alexander Y. |
| collection | MIT |
| description | Julia is a new language for writing data analysis programs that are easy to implement and run at high performance. Similarly, the Dynamic Distributed Dimensional Data Model (D4M) aims to clarify data analysis operations while retaining strong performance. D4M accomplishes these goals through a composable, unified data model on associative arrays. In this work, we present an implementation of D4M in Julia and describe how it enables and facilitates data analysis. Several experiments showcase scalable performance in our new Julia version as compared to the original Matlab implementation. |
| first_indexed | 2024-09-23T14:10:22Z |
| format | Article |
| id | mit-1721.1/115967 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T14:10:22Z |
| publishDate | 2018 |
| publisher | Institute of Electrical and Electronics Engineers (IEEE) |
| record_format | dspace |
| spelling | mit-1721.1/1159672022-10-01T19:37:14Z Julia implementation of the Dynamic Distributed Dimensional Data Model Chen, Alexander Y. Edelman, Alan Kepner, Jeremy Gadepally, Vijay N. Hutchison, Dylan D. Lincoln Laboratory Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology. Department of Mathematics Massachusetts Institute of Technology. Department of Mechanical Engineering Chen, Alexander Y. Edelman, Alan Kepner, Jeremy Gadepally, Vijay N. Hutchison, Dylan D. Julia is a new language for writing data analysis programs that are easy to implement and run at high performance. Similarly, the Dynamic Distributed Dimensional Data Model (D4M) aims to clarify data analysis operations while retaining strong performance. D4M accomplishes these goals through a composable, unified data model on associative arrays. In this work, we present an implementation of D4M in Julia and describe how it enables and facilitates data analysis. Several experiments showcase scalable performance in our new Julia version as compared to the original Matlab implementation. 2018-05-30T15:25:17Z 2018-05-30T15:25:17Z 2016-12 2018-05-18T19:18:21Z Article http://purl.org/eprint/type/ConferencePaper 978-1-5090-3525-0 http://hdl.handle.net/1721.1/115967 Chen, Alexander, Alan Edelman, Jeremy Kepner, Vijay Gadepally, and Dylan Hutchison. “Julia Implementation of the Dynamic Distributed Dimensional Data Model.” 2016 IEEE High Performance Extreme Computing Conference (HPEC) (September 2016). https://orcid.org/0000-0001-8083-7289 https://orcid.org/0000-0001-7676-3133 http://dx.doi.org/10.1109/HPEC.2016.7761626 2016 IEEE High Performance Extreme Computing Conference (HPEC) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) arXiv |
| spellingShingle | Chen, Alexander Y. Edelman, Alan Kepner, Jeremy Gadepally, Vijay N. Hutchison, Dylan D. Julia implementation of the Dynamic Distributed Dimensional Data Model |
| title | Julia implementation of the Dynamic Distributed Dimensional Data Model |
| title_full | Julia implementation of the Dynamic Distributed Dimensional Data Model |
| title_fullStr | Julia implementation of the Dynamic Distributed Dimensional Data Model |
| title_full_unstemmed | Julia implementation of the Dynamic Distributed Dimensional Data Model |
| title_short | Julia implementation of the Dynamic Distributed Dimensional Data Model |
| title_sort | julia implementation of the dynamic distributed dimensional data model |
| url | http://hdl.handle.net/1721.1/115967 https://orcid.org/0000-0001-8083-7289 https://orcid.org/0000-0001-7676-3133 |
| work_keys_str_mv | AT chenalexandery juliaimplementationofthedynamicdistributeddimensionaldatamodel AT edelmanalan juliaimplementationofthedynamicdistributeddimensionaldatamodel AT kepnerjeremy juliaimplementationofthedynamicdistributeddimensionaldatamodel AT gadepallyvijayn juliaimplementationofthedynamicdistributeddimensionaldatamodel AT hutchisondyland juliaimplementationofthedynamicdistributeddimensionaldatamodel |