[elliot07]

What's the gold standard paid offering that does this?

[danihh]

Not a paid solution, but great for testing models yourself: AWS bedrock.

Wonky documentation (definitely released too early), but imo the best model agnostic diy solution out there.