I don't think anything about high-performance GPT models is standard, since they are only a couple years old and only a handful of organizations have developed them
The technique in question has little to do with GPT itself; it involves using ML to generate more training data in an automated fashion, creating a generative training loop, which as another commenter mentioned, is also the basis behind general adversarial networks.
soulofmischief|3 years ago