Remote data access and analysis using SciDB
Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2012.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2013
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/77076 |
| _version_ | 1826214538924523520 |
|---|---|
| author | Anderson, Alan M., M. Eng. Massachusetts Institute of Technology |
| author2 | Lewis Girod and Sam Madden. |
| author_facet | Lewis Girod and Sam Madden. Anderson, Alan M., M. Eng. Massachusetts Institute of Technology |
| author_sort | Anderson, Alan M., M. Eng. Massachusetts Institute of Technology |
| collection | MIT |
| description | Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2012. |
| first_indexed | 2024-09-23T16:07:02Z |
| format | Thesis |
| id | mit-1721.1/77076 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T16:07:02Z |
| publishDate | 2013 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/770762019-04-10T09:10:55Z Remote data access and analysis using SciDB Remote high resolution data access and calculation using SciDB Anderson, Alan M., M. Eng. Massachusetts Institute of Technology Lewis Girod and Sam Madden. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2012. Cataloged from PDF version of thesis. Includes bibliographical references (p. 63). SciDB is an innovative data analysis system that provides fast querying and manipulation of large amounts of time-series, scientific data. This thesis describes the design of a framework that provides a user interface to SciDB that facilitates interactive processing of large datasets and supports long-running batch jobs on a remote server or cluster. Using this interface, python user scripts access SciDB data, process it, and write new result arrays. The framework addresses problems such as garbage collection, data access permissions and maintenance of provenance. We present a case study in which we apply this framework to data from the WaterWiSe project, and analyze the runtime performance of the system. by Alan M. Anderson. M.Eng. 2013-02-14T19:16:31Z 2013-02-14T19:16:31Z 2012 2012 Thesis http://hdl.handle.net/1721.1/77076 825559039 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 63 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Anderson, Alan M., M. Eng. Massachusetts Institute of Technology Remote data access and analysis using SciDB |
| title | Remote data access and analysis using SciDB |
| title_full | Remote data access and analysis using SciDB |
| title_fullStr | Remote data access and analysis using SciDB |
| title_full_unstemmed | Remote data access and analysis using SciDB |
| title_short | Remote data access and analysis using SciDB |
| title_sort | remote data access and analysis using scidb |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/77076 |
| work_keys_str_mv | AT andersonalanmmengmassachusettsinstituteoftechnology remotedataaccessandanalysisusingscidb AT andersonalanmmengmassachusettsinstituteoftechnology remotehighresolutiondataaccessandcalculationusingscidb |