News


2026.01.07 We are excited to release Version 2 of the RelBench!

RelBench v2 includes:

  • Introducing Autocomplete tasks: New task paradigm to predict existing columns in the database.
  • 4 new databases: SALT, RateBeer, arXiv, and MIMIC-IV.
  • 40 new predictive tasks, including 28 Autocomplete tasks across new and existing databases.
  • CTU integration: 70+ relational datasets from the CTU repository via ReDeLEx.
  • Direct SQL database connectivity via ReDeLEx.
  • 4DBInfer integration: 7 relational datasets from the 4DBInfer repository in RelBench format.
  • Bug fixes and performance improvements:
    • Optionally include (time-censored) labels as features in the database. (#327)
    • Support NDCG metric for link prediction. (#276)
    • Optimize SentenceTransformer encoding with Torch for 10-20% faster processing than default NumPy encoding. (#261)
    • Enable configuring RelBench cache directory via environment variable. (#336)
    • ... and more (see commit history for details)

2024.09.26 RelBench is accepted to the NeurIPS Datasets and Benchmarks track!


2024.07.30 We are excited to release the RelBench!