Viewing Experience Model of First-Person Videos
First-Person Videos (FPVs) are recorded using wearable cameras to share the recorder’s First-Person Experience (FPE). Ideally, the FPE is conveyed by the viewing experience of the FPV. However, raw FPVs are usually too shaky to watch, which ruins the viewing experience. To solve this probl...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2018-08-01
|
| Series: | Journal of Imaging |
| Subjects: | |
| Online Access: | http://www.mdpi.com/2313-433X/4/9/106 |
| _version_ | 1819207345662590976 |
|---|---|
| author | Biao Ma Amy R. Reibman |
| author_facet | Biao Ma Amy R. Reibman |
| author_sort | Biao Ma |
| collection | DOAJ |
| description | First-Person Videos (FPVs) are recorded using wearable cameras to share the recorder’s First-Person Experience (FPE). Ideally, the FPE is conveyed by the viewing experience of the FPV. However, raw FPVs are usually too shaky to watch, which ruins the viewing experience. To solve this problem, we improve the viewing experience of FPVs by modeling it as two parts: video stability and First-Person Motion Information (FPMI). Existing video stabilization techniques can improve the video stability but damage the FPMI. We propose a Viewing Experience (VE) score, which measures both the stability and the FPMI of a FPV by exploring the mechanism of human perception. This enables us to further develop a system that can stabilize FPVs while preserving their FPMI so that the viewing experience of FPVs is improved. Objective tests show that our measurement is robust under different kinds of noise, and our system has competitive performance relative to current stabilization techniques. Subjective tests show that (1) both our stability and FPMI measurements can correctly compare the corresponding attributes of an FPV across different versions of the same content, and (2) our video processing system can effectively improve the viewing experience of FPVs. |
| first_indexed | 2024-12-23T05:22:01Z |
| format | Article |
| id | doaj.art-16a8e5537eea4b0b83f0fc5fa4e90b93 |
| institution | Directory Open Access Journal |
| issn | 2313-433X |
| language | English |
| last_indexed | 2024-12-23T05:22:01Z |
| publishDate | 2018-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Imaging |
| spelling | doaj.art-16a8e5537eea4b0b83f0fc5fa4e90b932022-12-21T17:58:40ZengMDPI AGJournal of Imaging2313-433X2018-08-014910610.3390/jimaging4090106jimaging4090106Viewing Experience Model of First-Person VideosBiao Ma0Amy R. Reibman1School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USASchool of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USAFirst-Person Videos (FPVs) are recorded using wearable cameras to share the recorder’s First-Person Experience (FPE). Ideally, the FPE is conveyed by the viewing experience of the FPV. However, raw FPVs are usually too shaky to watch, which ruins the viewing experience. To solve this problem, we improve the viewing experience of FPVs by modeling it as two parts: video stability and First-Person Motion Information (FPMI). Existing video stabilization techniques can improve the video stability but damage the FPMI. We propose a Viewing Experience (VE) score, which measures both the stability and the FPMI of a FPV by exploring the mechanism of human perception. This enables us to further develop a system that can stabilize FPVs while preserving their FPMI so that the viewing experience of FPVs is improved. Objective tests show that our measurement is robust under different kinds of noise, and our system has competitive performance relative to current stabilization techniques. Subjective tests show that (1) both our stability and FPMI measurements can correctly compare the corresponding attributes of an FPV across different versions of the same content, and (2) our video processing system can effectively improve the viewing experience of FPVs.http://www.mdpi.com/2313-433X/4/9/106First-Person Videosviewing experiencevideo stabilization |
| spellingShingle | Biao Ma Amy R. Reibman Viewing Experience Model of First-Person Videos Journal of Imaging First-Person Videos viewing experience video stabilization |
| title | Viewing Experience Model of First-Person Videos |
| title_full | Viewing Experience Model of First-Person Videos |
| title_fullStr | Viewing Experience Model of First-Person Videos |
| title_full_unstemmed | Viewing Experience Model of First-Person Videos |
| title_short | Viewing Experience Model of First-Person Videos |
| title_sort | viewing experience model of first person videos |
| topic | First-Person Videos viewing experience video stabilization |
| url | http://www.mdpi.com/2313-433X/4/9/106 |
| work_keys_str_mv | AT biaoma viewingexperiencemodeloffirstpersonvideos AT amyrreibman viewingexperiencemodeloffirstpersonvideos |