Context effects on object recognition in real-world environments: A study protocol [version 3; peer review: 1 approved, 2 approved with reservations]

Background: The environments that we live in impact on our ability to recognise objects, with recognition being facilitated when objects appear in expected locations (congruent) compared to unexpected locations (incongruent). However, these findings are based on experiments where the object is isola...

Full description

Bibliographic Details
Main Authors: Benjamin Alsbury-Nealy, Victoria I. Nicholls, Alex Clarke, Alexandra Krugliak
Format: Article
Language:English
Published: Wellcome 2023-07-01
Series:Wellcome Open Research
Subjects:
Online Access:https://wellcomeopenresearch.org/articles/7-165/v3
_version_ 1797780133152555008
author Benjamin Alsbury-Nealy
Victoria I. Nicholls
Alex Clarke
Alexandra Krugliak
author_facet Benjamin Alsbury-Nealy
Victoria I. Nicholls
Alex Clarke
Alexandra Krugliak
author_sort Benjamin Alsbury-Nealy
collection DOAJ
description Background: The environments that we live in impact on our ability to recognise objects, with recognition being facilitated when objects appear in expected locations (congruent) compared to unexpected locations (incongruent). However, these findings are based on experiments where the object is isolated from its environment. Moreover, it is not clear which components of the recognition process are impacted by the environment. In this experiment, we seek to examine the impact real world environments have on object recognition. Specifically, we will use mobile electroencephalography (mEEG) and augmented reality (AR) to investigate how the visual and semantic processing aspects of object recognition are changed by the environment. Methods: We will use AR to place congruent and incongruent virtual objects around indoor and outdoor environments. During the experiment a total of 34 participants will walk around the environments and find these objects while we record their eye movements and neural signals. We will perform two primary analyses. First, we will analyse the event-related potential (ERP) data using paired samples t-tests in the N300/400 time windows in an attempt to replicate congruency effects on the N300/400. Second, we will use representational similarity analysis (RSA) and computational models of vision and semantics to determine how visual and semantic processes are changed by congruency. Conclusions: Based on previous literature, we hypothesise that scene-object congruence would facilitate object recognition. For ERPs, we predict a congruency effect in the N300/N400, and for RSA we predict that higher level visual and semantic information will be represented earlier for congruent scenes than incongruent scenes. By collecting mEEG data while participants are exploring a real-world environment, we will be able to determine the impact of a natural context on object recognition, and the different processing stages of object recognition.
first_indexed 2024-03-12T23:40:11Z
format Article
id doaj.art-e7324ff4874c4c72b1623e75d29e8516
institution Directory Open Access Journal
issn 2398-502X
language English
last_indexed 2024-03-12T23:40:11Z
publishDate 2023-07-01
publisher Wellcome
record_format Article
series Wellcome Open Research
spelling doaj.art-e7324ff4874c4c72b1623e75d29e85162023-07-15T01:00:01ZengWellcomeWellcome Open Research2398-502X2023-07-01721833Context effects on object recognition in real-world environments: A study protocol [version 3; peer review: 1 approved, 2 approved with reservations]Benjamin Alsbury-Nealy0Victoria I. Nicholls1https://orcid.org/0000-0002-2612-3071Alex Clarke2https://orcid.org/0000-0001-7768-5229Alexandra Krugliak3https://orcid.org/0000-0002-5031-3801Department of Psychology, University of Toronto, Toronto, M5S 3G3, CanadaDepartment of Psychology, University of Cambridge, Cambridge, CB2 3EB, UKDepartment of Psychology, University of Cambridge, Cambridge, CB2 3EB, UKDepartment of Psychology, University of Cambridge, Cambridge, CB2 3EB, UKBackground: The environments that we live in impact on our ability to recognise objects, with recognition being facilitated when objects appear in expected locations (congruent) compared to unexpected locations (incongruent). However, these findings are based on experiments where the object is isolated from its environment. Moreover, it is not clear which components of the recognition process are impacted by the environment. In this experiment, we seek to examine the impact real world environments have on object recognition. Specifically, we will use mobile electroencephalography (mEEG) and augmented reality (AR) to investigate how the visual and semantic processing aspects of object recognition are changed by the environment. Methods: We will use AR to place congruent and incongruent virtual objects around indoor and outdoor environments. During the experiment a total of 34 participants will walk around the environments and find these objects while we record their eye movements and neural signals. We will perform two primary analyses. First, we will analyse the event-related potential (ERP) data using paired samples t-tests in the N300/400 time windows in an attempt to replicate congruency effects on the N300/400. Second, we will use representational similarity analysis (RSA) and computational models of vision and semantics to determine how visual and semantic processes are changed by congruency. Conclusions: Based on previous literature, we hypothesise that scene-object congruence would facilitate object recognition. For ERPs, we predict a congruency effect in the N300/N400, and for RSA we predict that higher level visual and semantic information will be represented earlier for congruent scenes than incongruent scenes. By collecting mEEG data while participants are exploring a real-world environment, we will be able to determine the impact of a natural context on object recognition, and the different processing stages of object recognition.https://wellcomeopenresearch.org/articles/7-165/v3Object recognition context mobile EEG augmented reality real-world neuroscienceeng
spellingShingle Benjamin Alsbury-Nealy
Victoria I. Nicholls
Alex Clarke
Alexandra Krugliak
Context effects on object recognition in real-world environments: A study protocol [version 3; peer review: 1 approved, 2 approved with reservations]
Wellcome Open Research
Object recognition
context
mobile EEG
augmented reality
real-world neuroscience
eng
title Context effects on object recognition in real-world environments: A study protocol [version 3; peer review: 1 approved, 2 approved with reservations]
title_full Context effects on object recognition in real-world environments: A study protocol [version 3; peer review: 1 approved, 2 approved with reservations]
title_fullStr Context effects on object recognition in real-world environments: A study protocol [version 3; peer review: 1 approved, 2 approved with reservations]
title_full_unstemmed Context effects on object recognition in real-world environments: A study protocol [version 3; peer review: 1 approved, 2 approved with reservations]
title_short Context effects on object recognition in real-world environments: A study protocol [version 3; peer review: 1 approved, 2 approved with reservations]
title_sort context effects on object recognition in real world environments a study protocol version 3 peer review 1 approved 2 approved with reservations
topic Object recognition
context
mobile EEG
augmented reality
real-world neuroscience
eng
url https://wellcomeopenresearch.org/articles/7-165/v3
work_keys_str_mv AT benjaminalsburynealy contexteffectsonobjectrecognitioninrealworldenvironmentsastudyprotocolversion3peerreview1approved2approvedwithreservations
AT victoriainicholls contexteffectsonobjectrecognitioninrealworldenvironmentsastudyprotocolversion3peerreview1approved2approvedwithreservations
AT alexclarke contexteffectsonobjectrecognitioninrealworldenvironmentsastudyprotocolversion3peerreview1approved2approvedwithreservations
AT alexandrakrugliak contexteffectsonobjectrecognitioninrealworldenvironmentsastudyprotocolversion3peerreview1approved2approvedwithreservations