[toxicFork]

Allegedly, GPT4 itself is an ensemble of models anyway, right?

[A-Train]

The architecture is something like an ensemble but there is also this control network which chooses 2 experts to generate text.