Ambiguity modeling in latent spaces

We are interested in the situation where we have two or more representations of an underlying phenomenon. In particular we are interested in the scenario where the representation are complementary. This implies that a single individual representation is not sufficient to fully discriminate a specifi...

Full description

Bibliographic Details
Main Authors: Ek, CH, Rihan, J, Torr, PHS, Rogez, G, Lawrence, ND
Format: Conference item
Language:English
Published: Springer Nature 2008
_version_ 1817931330999025664
author Ek, CH
Rihan, J
Torr, PHS
Rogez, G
Lawrence, ND
author_facet Ek, CH
Rihan, J
Torr, PHS
Rogez, G
Lawrence, ND
author_sort Ek, CH
collection OXFORD
description We are interested in the situation where we have two or more representations of an underlying phenomenon. In particular we are interested in the scenario where the representation are complementary. This implies that a single individual representation is not sufficient to fully discriminate a specific instance of the underlying phenomenon, it also means that each representation is an ambiguous representation of the other complementary spaces. In this paper we present a latent variable model capable of consolidating multiple complementary representations. Our method extends canonical correlation analysis by introducing additional latent spaces that are specific to the different representations, thereby explaining the full variance of the observations. These additional spaces, explaining representation specific variance, separately model the variance in a representation ambiguous to the other. We develop a spectral algorithm for fast computation of the embeddings and a probabilistic model (based on Gaussian processes) for validation and inference. The proposed model has several potential application areas, we demonstrate its use for multi-modal regression on a benchmark human pose estimation data set.
first_indexed 2024-12-09T03:20:19Z
format Conference item
id oxford-uuid:6fb1ffc0-e7c1-4c5c-89fd-0b4c2f3cd320
institution University of Oxford
language English
last_indexed 2024-12-09T03:20:19Z
publishDate 2008
publisher Springer Nature
record_format dspace
spelling oxford-uuid:6fb1ffc0-e7c1-4c5c-89fd-0b4c2f3cd3202024-11-05T14:10:14ZAmbiguity modeling in latent spacesConference itemhttp://purl.org/coar/resource_type/c_5794uuid:6fb1ffc0-e7c1-4c5c-89fd-0b4c2f3cd320EnglishSymplectic ElementsSpringer Nature2008Ek, CHRihan, JTorr, PHSRogez, GLawrence, NDWe are interested in the situation where we have two or more representations of an underlying phenomenon. In particular we are interested in the scenario where the representation are complementary. This implies that a single individual representation is not sufficient to fully discriminate a specific instance of the underlying phenomenon, it also means that each representation is an ambiguous representation of the other complementary spaces. In this paper we present a latent variable model capable of consolidating multiple complementary representations. Our method extends canonical correlation analysis by introducing additional latent spaces that are specific to the different representations, thereby explaining the full variance of the observations. These additional spaces, explaining representation specific variance, separately model the variance in a representation ambiguous to the other. We develop a spectral algorithm for fast computation of the embeddings and a probabilistic model (based on Gaussian processes) for validation and inference. The proposed model has several potential application areas, we demonstrate its use for multi-modal regression on a benchmark human pose estimation data set.
spellingShingle Ek, CH
Rihan, J
Torr, PHS
Rogez, G
Lawrence, ND
Ambiguity modeling in latent spaces
title Ambiguity modeling in latent spaces
title_full Ambiguity modeling in latent spaces
title_fullStr Ambiguity modeling in latent spaces
title_full_unstemmed Ambiguity modeling in latent spaces
title_short Ambiguity modeling in latent spaces
title_sort ambiguity modeling in latent spaces
work_keys_str_mv AT ekch ambiguitymodelinginlatentspaces
AT rihanj ambiguitymodelinginlatentspaces
AT torrphs ambiguitymodelinginlatentspaces
AT rogezg ambiguitymodelinginlatentspaces
AT lawrencend ambiguitymodelinginlatentspaces