Lifelong benchmarks: efficient model evaluation in an era of rapid progress
Standardized benchmarks drive progress in machine learning. However, with repeated testing, the risk of overfitting grows as algorithms overexploit benchmark idiosyncrasies. In our work, we seek to mitigate this challenge by compiling ever-expanding large-scale benchmarks called Lifelong Benchmarks....
Main Authors: | , , , , , |
---|---|
Format: | Conference item |
Language: | English |
Published: |
OpenReview
2024
|