[michaelgiba]

Interesting idea. Although I wouldn't consider `but restrict the data set to publications from <= year 1600` "easy".

If you did have access to a high-quality pretraining dataset and you could explore training up to 1600, then up to 1610, 1620, ... 1700 and look at how the presence of calculus was learned over that period. Running some tests with the intermediate models to capture the effect