Designing multicore scalable filesystems with durability and crash consistency
Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2017
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/111864 |
| _version_ | 1811074673665900544 |
|---|---|
| author | Bhat, Srivatsa S. (Srivatsa Sitaram) |
| author2 | M. Frans Kaashoek and Nickolai Zeldovich. |
| author_facet | M. Frans Kaashoek and Nickolai Zeldovich. Bhat, Srivatsa S. (Srivatsa Sitaram) |
| author_sort | Bhat, Srivatsa S. (Srivatsa Sitaram) |
| collection | MIT |
| description | Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017. |
| first_indexed | 2024-09-23T09:53:33Z |
| format | Thesis |
| id | mit-1721.1/111864 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T09:53:33Z |
| publishDate | 2017 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1118642019-04-12T22:33:45Z Designing multicore scalable filesystems with durability and crash consistency Bhat, Srivatsa S. (Srivatsa Sitaram) M. Frans Kaashoek and Nickolai Zeldovich. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Cataloged from student-submitted PDF version of thesis. Includes bibliographical references (pages 61-64). It is challenging to simultaneously achieve multicore scalability and high disk throughput in a file system. For example, data structures that are on separate cache lines in memory (e.g., directory entries) are grouped together in a transaction log when the file system writes them to disk. This grouping results in cache line conflicts, thereby limiting scalability. McoreFS is a novel file system design that decouples the in-memory file system from the on-disk file system using per-core operation logs. This design facilitates the use of highly concurrent data structures for the in-memory representation, which allows commutative operations to proceed without conflicts and hence scale perfectly. McoreFS logs operations in a per-core log so that it can delay propagating updates to the disk representation until an fsync. The fsync call merges the per-core logs and applies the operations to disk. McoreFS uses several techniques to perform the merge correctly while achieving good performance: timestamped linearization points to order updates without introducing cache line conflicts, absorption of logged operations, and dependency tracking across operations. Experiments with a prototype of McoreFS show that its implementation is conflict-free for 99% of test cases involving commutative operations generated by Commuter, scales well on an 80-core machine, and provides disk performance that matches or exceeds that of Linux ext4. by Srivatsa S. Bhat. S.M. 2017-10-18T14:42:45Z 2017-10-18T14:42:45Z 2017 2017 Thesis http://hdl.handle.net/1721.1/111864 1005230211 eng MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission. http://dspace.mit.edu/handle/1721.1/7582 64 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Bhat, Srivatsa S. (Srivatsa Sitaram) Designing multicore scalable filesystems with durability and crash consistency |
| title | Designing multicore scalable filesystems with durability and crash consistency |
| title_full | Designing multicore scalable filesystems with durability and crash consistency |
| title_fullStr | Designing multicore scalable filesystems with durability and crash consistency |
| title_full_unstemmed | Designing multicore scalable filesystems with durability and crash consistency |
| title_short | Designing multicore scalable filesystems with durability and crash consistency |
| title_sort | designing multicore scalable filesystems with durability and crash consistency |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/111864 |
| work_keys_str_mv | AT bhatsrivatsassrivatsasitaram designingmulticorescalablefilesystemswithdurabilityandcrashconsistency |