Publications

Research on tabular and relational learning.

2026
Preprint 2026

RT-J: Large-Scale Pretraining of Relational Transformers for Context-Efficient Predictions

An 85M-parameter relational foundation model pretrained on THE JOIN, the largest open relational corpus, that makes accurate predictions from a few hundred in-context examples or fewer, surpassing baselines that use around 25 times more labels.

ICML 2026 · arXiv:2602.04029

PluRel: Synthetic Data unlocks Scaling Laws for Relational Foundation Models

A framework for synthesizing multi-table relational databases. The resulting synthetic data yields power-law scaling during pretraining and improves performance on real-world RelBench tasks.

ICLR 2026 · arXiv:2510.06377

Relational Transformer: Toward Zero-Shot Foundation Models for Relational Data

An architecture that transfers across relational databases without fine-tuning. A 22M-parameter model attains 93% of fully-supervised AUROC in a single forward pass, exceeding a 27B-parameter language model.

ICLR 2026 · arXiv:2505.10960

Relational Graph Transformer

A graph transformer architecture designed for the structure of relational entity graphs.

ICLR 2026 DATA-FM Workshop · arXiv:2602.12606

RelBench v2: A Large-Scale Benchmark and Repository for Relational Data

A large-scale benchmark and repository for relational data, providing standardized datasets and tasks for evaluation.

2025
KDD 2025 · arXiv:2506.16654

Relational Deep Learning: Challenges, Foundations and Next-Generation Architectures

A comprehensive review of relational deep learning, surveying its challenges, foundations, and next-generation architectures.

ACL 2025 · arXiv:2506.05725

Large Language Models are Good Relational Learners

Rel-LLM, an architecture that pairs a graph neural network encoder with a large language model through retrieval-augmented generation, bringing the reasoning of LLMs to relational databases.

ICML 2025 · arXiv:2502.06784

RelGNN: Composite Message Passing for Relational Deep Learning

A composite message-passing scheme for relational deep learning that addresses many-to-many relationships, achieving state-of-the-art results on RelBench with improvements of up to 25%.

2024
NeurIPS 2024 · arXiv:2407.20060

RelBench: A Benchmark for Deep Learning on Relational Databases

A benchmark for deep learning on relational databases, comprising seven databases and thirty predictive tasks across diverse domains.

ICML 2024 · PMLR

Position: Relational Deep Learning, Graph Representation Learning on Relational Databases

A position paper introducing relational deep learning, which represents relational databases as graphs to enable end-to-end learning without manual feature engineering.