[anxrn]

Yes, this paper [1] introduced the term.

https://scholar.google.com/citations?view_op=view_citation&h...

[runnerup]

Weird. The term “Generative pretraining” seems to also exist in this 2016 proceeding from 2 years prior: https://ui.adsabs.harvard.edu/abs/2016arXiv160202644D/abstra...

Google Trends shows it first got searched for in measurable quantity back in 2008.

[reaperman]

Here's "generative pretaining" in an IEEE publication from 2012. https://www.cs.toronto.edu/~hinton/absps/DNN-2012-proof.pdf

Geoffrey Hinton wrote it. I wonder if he'll have anything to say about OpenAI trademarking the term 11 years after he wrote this. Here's an earlier publication from January, 2012 talking about Hinton's 2011 "Generative pretraining" work: https://www.microsoft.com/en-us/research/publication/three-c...