[profjure]

TabPFN is an amazing innovation. But there are some crucial differences in model capabilities that make it hard for a fair comparison.

TabPFN can only operate on a single small table. But real-world datasets are actually multi-table and to make accurate prediction you need to capture signal from multiple tables (for example, customers, products, purchases).

So, the comparison to TabPFN would be unfair as it would only use data from a single table and that would lead to bad performance of TabPFN.

[0rthogonal]

If these tables are connected via foreign keys, wouldn't it be possible to do a join, and then use TabPFN?