Weld : fast data-parallel computation on modern hardware
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2017
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/106382 |
| _version_ | 1811089121125335040 |
|---|---|
| author | Thomas, James J., M. Eng Massachusetts Institute of Technology |
| author2 | Matei A. Zaharia. |
| author_facet | Matei A. Zaharia. Thomas, James J., M. Eng Massachusetts Institute of Technology |
| author_sort | Thomas, James J., M. Eng Massachusetts Institute of Technology |
| collection | MIT |
| description | Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016. |
| first_indexed | 2024-09-23T14:14:01Z |
| format | Thesis |
| id | mit-1721.1/106382 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T14:14:01Z |
| publishDate | 2017 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1063822019-04-10T22:26:45Z Weld : fast data-parallel computation on modern hardware Thomas, James J., M. Eng Massachusetts Institute of Technology Matei A. Zaharia. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Cataloged from student-submitted PDF version of thesis. Includes bibliographical references (pages 43-46). Modern hardware is difficult to use efficiently, requiring complex optimizations like vectorization, loop blocking and load balancing to get good performance. As a result, many widely used data processing systems fall well short of peak hardware performance. We have developed Weld, an intermediate language and runtime that can run data-parallel computations efficiently on modern hardware. The core of Weld is a novel intermediate language (IL) that is expressive enough to capture common data-parallel applications (e.g., SQL, graph analytics and machine learning) while being easy to parallelize on modern hardware, through the use of a simple "parallel builder" abstraction and nested parallel loops. Weld supports complex optimizations like vectorization and loop blocking, as well as a multicore CPU backend. Finally,Weld's runtime can to optimize across library functions used in the same program, enabling further speedups that are not possible with today's disjoint libraries. In this thesis, we describe the Weld IL and then turn to the multicore CPU backend, providing a theoretical analysis suggesting that it has low overheads and showing that microbenchmarks and real-word applications like TensorFlow have excellent multicore performance when ported to run on Weld. by James J. Thomas. M. Eng. 2017-01-12T18:18:32Z 2017-01-12T18:18:32Z 2016 2016 Thesis http://hdl.handle.net/1721.1/106382 967658880 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 46 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Thomas, James J., M. Eng Massachusetts Institute of Technology Weld : fast data-parallel computation on modern hardware |
| title | Weld : fast data-parallel computation on modern hardware |
| title_full | Weld : fast data-parallel computation on modern hardware |
| title_fullStr | Weld : fast data-parallel computation on modern hardware |
| title_full_unstemmed | Weld : fast data-parallel computation on modern hardware |
| title_short | Weld : fast data-parallel computation on modern hardware |
| title_sort | weld fast data parallel computation on modern hardware |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/106382 |
| work_keys_str_mv | AT thomasjamesjmengmassachusettsinstituteoftechnology weldfastdataparallelcomputationonmodernhardware |