IDeixis : image-based deixis for recognizing locations
Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2004.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2005
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/18057 |
| _version_ | 1811085400746229760 |
|---|---|
| author | Yeh, Pei-Hsiu, 1978- |
| author2 | Trevor Darrell. |
| author_facet | Trevor Darrell. Yeh, Pei-Hsiu, 1978- |
| author_sort | Yeh, Pei-Hsiu, 1978- |
| collection | MIT |
| description | Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2004. |
| first_indexed | 2024-09-23T13:08:59Z |
| format | Thesis |
| id | mit-1721.1/18057 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T13:08:59Z |
| publishDate | 2005 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/180572019-04-11T02:49:29Z IDeixis : image-based deixis for recognizing locations Yeh, Pei-Hsiu, 1978- Trevor Darrell. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2004. Includes bibliographical references (p. 31-32). In this thesis, we describe an approach to recognizing location from camera-equipped mobile devices using image-based web search. This is an image-based deixis capable of pointing at a distant location away from the user's current location. We demonstrate our approach on an application allowing users to browse web pages matching the image of a nearby location. Common image search metrics can match images captured with a camera-equipped mobile device to images found on the World Wide Web. The users can recognize the location if those pages contain information about this location (e.g. name, facts, stories ... etc). Since the amount of information displayable on the device is limited, automatic keyword extraction methods can be applied to help efficiently identify relevant pieces of location information. Searching the entire web can be computationally overwhelming, so we devise a hybrid image-and-keyword searching technique. First, image-search is performed over images and links to their source web pages in a database that indexes only a small fraction of the web. Then, relevant keywords on these web pages are automatically identified and submitted to an existing text-based search engine (e.g. Google) that indexes a much larger portion of the web. Finally, the resulting image set is filtered to retain images close to the original query in terms of visual similarity. It is thus possible to efficiently search hundreds of millions of images that are not only textually related but also visually relevant. by Pei-Hsiu Yeh. S.M. 2005-06-02T19:48:12Z 2005-06-02T19:48:12Z 2004 2004 Thesis http://hdl.handle.net/1721.1/18057 57400697 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 32 p. 2259326 bytes 2260524 bytes application/pdf application/pdf application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Yeh, Pei-Hsiu, 1978- IDeixis : image-based deixis for recognizing locations |
| title | IDeixis : image-based deixis for recognizing locations |
| title_full | IDeixis : image-based deixis for recognizing locations |
| title_fullStr | IDeixis : image-based deixis for recognizing locations |
| title_full_unstemmed | IDeixis : image-based deixis for recognizing locations |
| title_short | IDeixis : image-based deixis for recognizing locations |
| title_sort | ideixis image based deixis for recognizing locations |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/18057 |
| work_keys_str_mv | AT yehpeihsiu1978 ideixisimagebaseddeixisforrecognizinglocations |