Lifelong benchmarks: efficient model evaluation in an era of rapid progress

Standardized benchmarks drive progress in machine learning. However, with repeated testing, the risk of overfitting grows as algorithms overexploit benchmark idiosyncrasies. In our work, we seek to mitigate this challenge by compiling ever-expanding large-scale benchmarks called Lifelong Benchmarks....

Full description

Bibliographic Details
Main Authors: Prabhu, A, Udandarao, V, Torr, PHS, Bethge, M, Bibi, A, Albanie, S
Format: Conference item
Language:English
Published: OpenReview 2024