[HenryNdubuaku]

You don’t have to bundle the weights as an asset, you can do over-the-air updates, new weights are simply downloaded.

[elpakal]

Neat, but not really addressing my point. My point is that you still need to roll out changes and LLM ApIs just work.