Automating website profiling for a deep web search engine
Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2009.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2010
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/53187 |
| _version_ | 1826207264037404672 |
|---|---|
| author | Yuan, Jeffrey W. (Jeffrey Weijie) |
| author2 | Michael Stonebraker. |
| author_facet | Michael Stonebraker. Yuan, Jeffrey W. (Jeffrey Weijie) |
| author_sort | Yuan, Jeffrey W. (Jeffrey Weijie) |
| collection | MIT |
| description | Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2009. |
| first_indexed | 2024-09-23T13:46:36Z |
| format | Thesis |
| id | mit-1721.1/53187 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T13:46:36Z |
| publishDate | 2010 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/531872019-04-12T09:46:26Z Automating website profiling for a deep web search engine Yuan, Jeffrey W. (Jeffrey Weijie) Michael Stonebraker. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2009. Cataloged from PDF version of thesis. Includes bibliographical references (p. 53-55). The deep web consists of information on the internet that resides in databases or is dynamically generated. It is believed that the deep web represents a large percentage of the total contents on the web, but is currently not indexed by traditional search engines. The Morpheus project is designed to solve this problem by making information in the deep web searchable. This requires a large repository of content sources to be built up, where each source is represented in Morpheus by a profile or wrapper. This research proposes an approach to automating the creation of wrappers by relying on the average internet user to identify relevant sites. A wrapper generation system was created based on this approach. It comprises two components: the clickstream recorder saves characteristic data for websites identified by users, and the wrapper constructor converts these data into wrappers for the Morpheus system. After completing the implementation of this system, user tests were conducted, which verified that the system is effective and has good usability. by Jeffrey W. Yuan. M.Eng. 2010-03-25T15:12:10Z 2010-03-25T15:12:10Z 2009 2009 Thesis http://hdl.handle.net/1721.1/53187 525231644 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 55 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Yuan, Jeffrey W. (Jeffrey Weijie) Automating website profiling for a deep web search engine |
| title | Automating website profiling for a deep web search engine |
| title_full | Automating website profiling for a deep web search engine |
| title_fullStr | Automating website profiling for a deep web search engine |
| title_full_unstemmed | Automating website profiling for a deep web search engine |
| title_short | Automating website profiling for a deep web search engine |
| title_sort | automating website profiling for a deep web search engine |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/53187 |
| work_keys_str_mv | AT yuanjeffreywjeffreyweijie automatingwebsiteprofilingforadeepwebsearchengine |