MAP3D: An explorative approach for automatic mapping of real-world eye-tracking data on a virtual 3D model

Mobile eye tracking helps to investigate real-world settings, in which participants can move freely. This enhances the studies’ ecological validity but poses challenges for the analysis. Often, the 3D stimulus is reduced to a 2D image (reference view) and the fixations are manually mapped to this 2...

Full description

Bibliographic Details
Main Authors: Isabell Stein, Helen Jossberger, Hans Gruber
Format: Article
Language:English
Published: Bern Open Publishing 2023-05-01
Series:Journal of Eye Movement Research
Subjects:
Online Access:https://bop.unibe.ch/JEMR/article/view/5589
_version_ 1797815471416803328
author Isabell Stein
Helen Jossberger
Hans Gruber
author_facet Isabell Stein
Helen Jossberger
Hans Gruber
author_sort Isabell Stein
collection DOAJ
description Mobile eye tracking helps to investigate real-world settings, in which participants can move freely. This enhances the studies’ ecological validity but poses challenges for the analysis. Often, the 3D stimulus is reduced to a 2D image (reference view) and the fixations are manually mapped to this 2D image. This leads to a loss of information about the three-dimensionality of the stimulus. Using several reference images, from different perspectives, poses new problems, in particular concerning the mapping of fixations in the transition areas between two reference views. A newly developed approach (MAP3D) is presented that enables generating a 3D model and automatic mapping of fixations to this virtual 3D model of the stimulus. This avoids problems with the reduction to a 2D reference image and with transitions between images. The x, y and z coordinates of the fixations are available as a point cloud and as .csv output. First exploratory application and evaluation tests are promising: MAP3D offers innovative ways of post-hoc mapping fixation data on 3D stimuli with open-source software and thus provides cost-efficient new avenues for research.
first_indexed 2024-03-13T08:23:14Z
format Article
id doaj.art-e81559d753c9407485b836bf725a621e
institution Directory Open Access Journal
issn 1995-8692
language English
last_indexed 2024-03-13T08:23:14Z
publishDate 2023-05-01
publisher Bern Open Publishing
record_format Article
series Journal of Eye Movement Research
spelling doaj.art-e81559d753c9407485b836bf725a621e2023-05-31T06:04:24ZengBern Open PublishingJournal of Eye Movement Research1995-86922023-05-0115310.16910/jemr.15.3.8MAP3D: An explorative approach for automatic mapping of real-world eye-tracking data on a virtual 3D modelIsabell Stein0Helen Jossberger1Hans Gruber2University of RegensburgUniversity of RegensburgUniversity of Regensburg Mobile eye tracking helps to investigate real-world settings, in which participants can move freely. This enhances the studies’ ecological validity but poses challenges for the analysis. Often, the 3D stimulus is reduced to a 2D image (reference view) and the fixations are manually mapped to this 2D image. This leads to a loss of information about the three-dimensionality of the stimulus. Using several reference images, from different perspectives, poses new problems, in particular concerning the mapping of fixations in the transition areas between two reference views. A newly developed approach (MAP3D) is presented that enables generating a 3D model and automatic mapping of fixations to this virtual 3D model of the stimulus. This avoids problems with the reduction to a 2D reference image and with transitions between images. The x, y and z coordinates of the fixations are available as a point cloud and as .csv output. First exploratory application and evaluation tests are promising: MAP3D offers innovative ways of post-hoc mapping fixation data on 3D stimuli with open-source software and thus provides cost-efficient new avenues for research. https://bop.unibe.ch/JEMR/article/view/55893D stimuliautomatic fixation mappingeye movementeye trackingphotogrammetryvirtual 3D model
spellingShingle Isabell Stein
Helen Jossberger
Hans Gruber
MAP3D: An explorative approach for automatic mapping of real-world eye-tracking data on a virtual 3D model
Journal of Eye Movement Research
3D stimuli
automatic fixation mapping
eye movement
eye tracking
photogrammetry
virtual 3D model
title MAP3D: An explorative approach for automatic mapping of real-world eye-tracking data on a virtual 3D model
title_full MAP3D: An explorative approach for automatic mapping of real-world eye-tracking data on a virtual 3D model
title_fullStr MAP3D: An explorative approach for automatic mapping of real-world eye-tracking data on a virtual 3D model
title_full_unstemmed MAP3D: An explorative approach for automatic mapping of real-world eye-tracking data on a virtual 3D model
title_short MAP3D: An explorative approach for automatic mapping of real-world eye-tracking data on a virtual 3D model
title_sort map3d an explorative approach for automatic mapping of real world eye tracking data on a virtual 3d model
topic 3D stimuli
automatic fixation mapping
eye movement
eye tracking
photogrammetry
virtual 3D model
url https://bop.unibe.ch/JEMR/article/view/5589
work_keys_str_mv AT isabellstein map3danexplorativeapproachforautomaticmappingofrealworldeyetrackingdataonavirtual3dmodel
AT helenjossberger map3danexplorativeapproachforautomaticmappingofrealworldeyetrackingdataonavirtual3dmodel
AT hansgruber map3danexplorativeapproachforautomaticmappingofrealworldeyetrackingdataonavirtual3dmodel