[jsharf]

Theoretically, one could compile whisper.cpp to run in the browser using emscripten, maybe made faster with webgl...

I think this would be quite a heavy page load time for a website, but if the model file gets cached, and the user has a decent CPU/GPU, it... could work?

[leobg]

That is a cool idea! And I just realized the Whisper.cpp guy has already built something like this. Whisper WASM. [1]

Unfortunately, on my iPhone this runs so slow that I might just as well send my mic recordings to a typist. And mobile is important here. Being able to quickly pull this up on your phone really is part of the fun.

[1] https://whisper.ggerganov.com/