CRAB: cross-environment agent benchmark for multimodal language model agents

The development of autonomous agents increasingly relies on Multimodal Language Models (MLMs) to perform tasks described in natural language with GUI environments, such as websites, desktop computers, or mobile phones. Existing benchmarks for MLM agents in interactive environments are limited by the...

Descripció completa

Dades bibliogràfiques
Autors principals: Xu, T, Chen, L, Wu, DJ, Chen, Y, Zhang, Z, Yao, X, Xie, Z, Liu, S, Qian, B, Yang, A, Jin, Z, Deng, J, Torr, P, Ghanem, B, Li, G
Format: Conference item
Idioma:English
Publicat: Association for the Advancement of Artificial Intellgence 2024