top | item 46131583

(no title)

sanjayjc | 2 months ago

Genuine question: given LLMs' inexorable commoditization of software, how soon before NVDA's CUDA moat is breached too? Is CUDA somehow fundamentally different from other kinds of software or firmware?

discuss

order

tomrod|2 months ago

Current Gen LLMs are not breaching the moat yet.

fzzzy|2 months ago

Yeah they are. llama.cpp has had good performance on cpu, amd, and apple metal for at least a year now.