Mapping global dynamics of benchmark creation and saturation in artificial intelligence
Recent studies raised concerns over the state of AI benchmarking, reporting issues such as benchmark overfitting, benchmark saturation and increasing centralization of benchmark dataset creation. To facilitate monitoring of the health of the AI benchmarking ecosystem, the authors introduce methodolo...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2022-11-01
|
| Series: | Nature Communications |
| Online Access: | https://doi.org/10.1038/s41467-022-34591-0 |