News
2026.01.07 We are excited to release Version 2 of the RelBench!
RelBench v2 includes:
- Introducing Autocomplete tasks: New task paradigm to predict existing columns in the database.
- 4 new databases: SALT, RateBeer, arXiv, and MIMIC-IV.
- 40 new predictive tasks, including 28 Autocomplete tasks across new and existing databases.
- CTU integration: 70+ relational datasets from the CTU repository via ReDeLEx.
- Direct SQL database connectivity via ReDeLEx.
- 4DBInfer integration: 7 relational datasets from the 4DBInfer repository in RelBench format.
- Bug fixes and performance improvements:
- Optionally include (time-censored) labels as features in the database. (#327)
- Support NDCG metric for link prediction. (#276)
- Optimize SentenceTransformer encoding with Torch for 10-20% faster processing than default NumPy encoding. (#261)
- Enable configuring RelBench cache directory via environment variable. (#336)
- ... and more (see commit history for details)
2024.09.26 RelBench is accepted to the NeurIPS Datasets and Benchmarks track!
2024.07.30 We are excited to release the RelBench!