[soumyadeb]

Does Microsoft (under the OpenAI agreement) have access to the model code etc or just the output? If not, they would have to rebuild it.

Not sure if its obvious that people would leave OpenAI in troves to join Microsoft just to be with Sam.

[haldujai]

I doubt it would be hard for Microsoft to rebuild, Microsoft Research has made many excellent contributions to transformers for many years now, DeepSpeed is a notable example.

I don’t think they’ve had the will/need to have done this but they most likely already have the talent.