Verbs in action: improving verb understanding in video-language models

Understanding verbs is crucial to modelling how people and objects interact with each other and the environment through space and time. Recently, state-of-the-art video-language models based on CLIP have been shown to have limited verb understanding and to rely extensively on nouns, restricting thei...

ver descrição completa

Detalhes bibliográficos
Principais autores: Momeni, L, Caron, M, Nagrani, A, Zisserman, A, Schmid, C
Formato: Conference item
Idioma:English
Publicado em: IEEE 2024