Flexible, Wide-Area Storage for Distributed Systems with WheelFS
WheelFS is a wide-area distributed storage system intended to help multi-site applications share data and gain fault tolerance. WheelFS takes the form of a distributed file system with a familiar POSIX interface. Its design allows applications to adjust the tradeoff between prompt visibility of upda...
| Main Authors: | , , , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
USENIX Association
2011
|
| Online Access: | http://hdl.handle.net/1721.1/60679 https://orcid.org/0000-0001-7098-586X https://orcid.org/0000-0003-2700-9286 |
| _version_ | 1826200926987223040 |
|---|---|
| author | Stribling, Jeremy Sovran, Yair Zhang, Irene Pretzer, Xavid F. Li, Jinyang Kaashoek, M. Frans Morris, Robert Tappan |
| author2 | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory |
| author_facet | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Stribling, Jeremy Sovran, Yair Zhang, Irene Pretzer, Xavid F. Li, Jinyang Kaashoek, M. Frans Morris, Robert Tappan |
| author_sort | Stribling, Jeremy |
| collection | MIT |
| description | WheelFS is a wide-area distributed storage system intended to help multi-site applications share data and gain fault tolerance. WheelFS takes the form of a distributed file system with a familiar POSIX interface. Its design allows applications to adjust the tradeoff between prompt visibility of updates from other sites and the ability for sites to operate independently despite failures and long delays. WheelFS allows these adjustments via semantic cues, which provide application control over consistency, failure handling, and file and replica placement.
WheelFS is implemented as a user-level file system and is deployed on PlanetLab and Emulab. Three applications (a distributed Web cache, an email service and large file distribution) demonstrate that WheelFS's file system interface simplifies construction of distributed applications by allowing reuse of existing software. These applications would perform poorly with the strict semantics implied by a traditional file system interface, but by providing cues to WheelFS they are able to achieve good performance. Measurements show that applications built on WheelFS deliver comparable performance to services such as CoralCDN and BitTorrent that use specialized wide-area storage systems. |
| first_indexed | 2024-09-23T11:43:54Z |
| format | Article |
| id | mit-1721.1/60679 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T11:43:54Z |
| publishDate | 2011 |
| publisher | USENIX Association |
| record_format | dspace |
| spelling | mit-1721.1/606792022-10-01T05:34:34Z Flexible, Wide-Area Storage for Distributed Systems with WheelFS Stribling, Jeremy Sovran, Yair Zhang, Irene Pretzer, Xavid F. Li, Jinyang Kaashoek, M. Frans Morris, Robert Tappan Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Kaashoek, M. Frans Stribling, Jeremy Zhang, Irene Pretzer, Xavid F. Kaashoek, M. Frans Morris, Robert Tappan WheelFS is a wide-area distributed storage system intended to help multi-site applications share data and gain fault tolerance. WheelFS takes the form of a distributed file system with a familiar POSIX interface. Its design allows applications to adjust the tradeoff between prompt visibility of updates from other sites and the ability for sites to operate independently despite failures and long delays. WheelFS allows these adjustments via semantic cues, which provide application control over consistency, failure handling, and file and replica placement. WheelFS is implemented as a user-level file system and is deployed on PlanetLab and Emulab. Three applications (a distributed Web cache, an email service and large file distribution) demonstrate that WheelFS's file system interface simplifies construction of distributed applications by allowing reuse of existing software. These applications would perform poorly with the strict semantics implied by a traditional file system interface, but by providing cues to WheelFS they are able to achieve good performance. Measurements show that applications built on WheelFS deliver comparable performance to services such as CoralCDN and BitTorrent that use specialized wide-area storage systems. National Science Foundation (U.S.) (Grant No. CNS-0720644) Microsoft Research Asia Tsinghua University (Beijing, China) 2011-01-20T14:59:18Z 2011-01-20T14:59:18Z 2009-04 2009-04 Article http://purl.org/eprint/type/ConferencePaper http://hdl.handle.net/1721.1/60679 Stribling, Jeremy et al. "Flexible, Wide-Area Storage for Distributed Systems with WheelFS." 6th USENIX Symposium on Networked Systems Design and Implementation. April 22-24, 2009: Boston, Massachusetts. https://orcid.org/0000-0001-7098-586X https://orcid.org/0000-0003-2700-9286 en_US http://www.usenix.org/events/nsdi09/tech/ NSDI ’09: 6th USENIX Symposium on Networked Systems Design and Implementation Attribution-Noncommercial-Share Alike 3.0 Unported http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf USENIX Association MIT web domain |
| spellingShingle | Stribling, Jeremy Sovran, Yair Zhang, Irene Pretzer, Xavid F. Li, Jinyang Kaashoek, M. Frans Morris, Robert Tappan Flexible, Wide-Area Storage for Distributed Systems with WheelFS |
| title | Flexible, Wide-Area Storage for Distributed Systems with WheelFS |
| title_full | Flexible, Wide-Area Storage for Distributed Systems with WheelFS |
| title_fullStr | Flexible, Wide-Area Storage for Distributed Systems with WheelFS |
| title_full_unstemmed | Flexible, Wide-Area Storage for Distributed Systems with WheelFS |
| title_short | Flexible, Wide-Area Storage for Distributed Systems with WheelFS |
| title_sort | flexible wide area storage for distributed systems with wheelfs |
| url | http://hdl.handle.net/1721.1/60679 https://orcid.org/0000-0001-7098-586X https://orcid.org/0000-0003-2700-9286 |
| work_keys_str_mv | AT striblingjeremy flexiblewideareastoragefordistributedsystemswithwheelfs AT sovranyair flexiblewideareastoragefordistributedsystemswithwheelfs AT zhangirene flexiblewideareastoragefordistributedsystemswithwheelfs AT pretzerxavidf flexiblewideareastoragefordistributedsystemswithwheelfs AT lijinyang flexiblewideareastoragefordistributedsystemswithwheelfs AT kaashoekmfrans flexiblewideareastoragefordistributedsystemswithwheelfs AT morrisroberttappan flexiblewideareastoragefordistributedsystemswithwheelfs |