top | item 44462433

(no title)

m13rar | 8 months ago

From a quick gander. WASM is not to talk to the servers. WASM can be utilized to run AI Agents to talk to local LLMs from a sandboxed environment through the browser.

For example in the next few years if Operating System companies and PC producers make small local models stock standards to improve the operating system functions and other services. This local LLM engine layer can be used by browser applications too and that being done through WASM without having to write Javascript and using WASM sandboxed layer to safely expose the this system LLM Engine Layer.

discuss

order

TekMol|8 months ago

No matter if the LLM is on the same machine or elsewhere, why would you need WASM to talk to it and not just JS?