[faraaz98]

I've been calling for this approach for a while. It's kinda similar to how the human brain has areas that are good at specific tasks

[usef-]

It's already used a lot — the paper I believe is from 1991, and GPT4 among many others is MoE