top | item 36060435 Show HN: a desktop app to discover, download, and run offline LLMs 10 points| ybu | 2 years ago |lmstudio.ai | reply 7 comments order hn newest [+] [-] unknown|2 years ago|reply [deleted] [+] [-] pearlsteinj|2 years ago|reply Wow, this makes running LLMs locally significantly more approachable. Very cool! [+] [-] leeholim|2 years ago|reply Agreed! [+] [-] asselinpaul|2 years ago|reply This is great! CPU only for now or can it leverage GPU for sped up inference? [+] [-] ybu|2 years ago|reply Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build [+] [-] dtagames|2 years ago|reply Looks very useful! Can't wait to try the Windows version. Thanks! [+] [-] ybu|2 years ago|reply Follow up: Windows release is out. [+] [-] ybu|2 years ago|reply hopefully soon!
[+] [-] pearlsteinj|2 years ago|reply Wow, this makes running LLMs locally significantly more approachable. Very cool! [+] [-] leeholim|2 years ago|reply Agreed!
[+] [-] asselinpaul|2 years ago|reply This is great! CPU only for now or can it leverage GPU for sped up inference? [+] [-] ybu|2 years ago|reply Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build
[+] [-] ybu|2 years ago|reply Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build
[+] [-] dtagames|2 years ago|reply Looks very useful! Can't wait to try the Windows version. Thanks! [+] [-] ybu|2 years ago|reply Follow up: Windows release is out. [+] [-] ybu|2 years ago|reply hopefully soon!
[+] [-] unknown|2 years ago|reply
[deleted]
[+] [-] pearlsteinj|2 years ago|reply
[+] [-] leeholim|2 years ago|reply
[+] [-] asselinpaul|2 years ago|reply
[+] [-] ybu|2 years ago|reply
[+] [-] dtagames|2 years ago|reply
[+] [-] ybu|2 years ago|reply
[+] [-] ybu|2 years ago|reply