AnyLanguageModel: One API for Local and Remote LLMs on Apple Platforms

[_mattt]

Author / creator here. I built this because integrating LLMs into Swift apps meant juggling completely different APIs for MLX, llama.cpp, CoreML, Ollama, and cloud providers. AnyLanguageModel gives you a single interface modeled on Apple's Foundation Models framework.

GitHub repo here: https://github.com/mattt/AnyLanguageModel

Happy to answer questions about the implementation or trade-offs we made.