top | item 46250979 (no title) Weryj | 2 months ago Just keep going! 2TB of swap disk for 0.0000001 t/sec discuss order hn newest kergonath|2 months ago Hang on, starting benchmarks on my Raspberry Pi. euroderf|2 months ago By the year 2035, toasters will run LLMs. pickle-wizard|2 months ago On a lark a friend setup Ollama on a 8GB Raspberry Pi with one of the smaller models. It worked by it was very slow. IIRC it did 1 token/second.
kergonath|2 months ago Hang on, starting benchmarks on my Raspberry Pi. euroderf|2 months ago By the year 2035, toasters will run LLMs. pickle-wizard|2 months ago On a lark a friend setup Ollama on a 8GB Raspberry Pi with one of the smaller models. It worked by it was very slow. IIRC it did 1 token/second.
pickle-wizard|2 months ago On a lark a friend setup Ollama on a 8GB Raspberry Pi with one of the smaller models. It worked by it was very slow. IIRC it did 1 token/second.
kergonath|2 months ago
euroderf|2 months ago
pickle-wizard|2 months ago