Invariant object recognition in the visual system with novel views of 3D objects.

To form view-invariant representations of objects, neurons in the inferior temporal cortex may associate together different views of an object, which tend to occur close together in time under natural viewing conditions. This can be achieved in neuronal network models of this process by using an ass...

Full description

Bibliographic Details
Main Authors: Stringer, S, Rolls, E
Format: Journal article
Language:English
Published: 2002
_version_ 1826299878630752256
author Stringer, S
Rolls, E
author_facet Stringer, S
Rolls, E
author_sort Stringer, S
collection OXFORD
description To form view-invariant representations of objects, neurons in the inferior temporal cortex may associate together different views of an object, which tend to occur close together in time under natural viewing conditions. This can be achieved in neuronal network models of this process by using an associative learning rule with a short-term temporal memory trace. It is postulated that within a view, neurons learn representations that enable them to generalize within variations of that view. When three-dimensional (3D) objects are rotated within small angles (up to, e.g., 30 degrees), their surface features undergo geometric distortion due to the change of perspective. In this article, we show how trace learning could solve the problem of in-depth rotation-invariant object recognition by developing representations of the transforms that features undergo when they are on the surfaces of 3D objects. Moreover, we show that having learned how features on 3D objects transform geometrically as the object is rotated in depth, the network can correctly recognize novel 3D variations within a generic view of an object composed of a new combination of previously learned features. These results are demonstrated in simulations of a hierarchical network model (VisNet) of the visual system that show that it can develop representations useful for the recognition of 3D objects by forming perspective-invariant representations to allow generalization within a generic view.
first_indexed 2024-03-07T05:08:40Z
format Journal article
id oxford-uuid:dacd8263-a681-459d-a520-8edcbd96f09e
institution University of Oxford
language English
last_indexed 2024-03-07T05:08:40Z
publishDate 2002
record_format dspace
spelling oxford-uuid:dacd8263-a681-459d-a520-8edcbd96f09e2022-03-27T09:05:49ZInvariant object recognition in the visual system with novel views of 3D objects.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:dacd8263-a681-459d-a520-8edcbd96f09eEnglishSymplectic Elements at Oxford2002Stringer, SRolls, ETo form view-invariant representations of objects, neurons in the inferior temporal cortex may associate together different views of an object, which tend to occur close together in time under natural viewing conditions. This can be achieved in neuronal network models of this process by using an associative learning rule with a short-term temporal memory trace. It is postulated that within a view, neurons learn representations that enable them to generalize within variations of that view. When three-dimensional (3D) objects are rotated within small angles (up to, e.g., 30 degrees), their surface features undergo geometric distortion due to the change of perspective. In this article, we show how trace learning could solve the problem of in-depth rotation-invariant object recognition by developing representations of the transforms that features undergo when they are on the surfaces of 3D objects. Moreover, we show that having learned how features on 3D objects transform geometrically as the object is rotated in depth, the network can correctly recognize novel 3D variations within a generic view of an object composed of a new combination of previously learned features. These results are demonstrated in simulations of a hierarchical network model (VisNet) of the visual system that show that it can develop representations useful for the recognition of 3D objects by forming perspective-invariant representations to allow generalization within a generic view.
spellingShingle Stringer, S
Rolls, E
Invariant object recognition in the visual system with novel views of 3D objects.
title Invariant object recognition in the visual system with novel views of 3D objects.
title_full Invariant object recognition in the visual system with novel views of 3D objects.
title_fullStr Invariant object recognition in the visual system with novel views of 3D objects.
title_full_unstemmed Invariant object recognition in the visual system with novel views of 3D objects.
title_short Invariant object recognition in the visual system with novel views of 3D objects.
title_sort invariant object recognition in the visual system with novel views of 3d objects
work_keys_str_mv AT stringers invariantobjectrecognitioninthevisualsystemwithnovelviewsof3dobjects
AT rollse invariantobjectrecognitioninthevisualsystemwithnovelviewsof3dobjects