[aniijbod]

Let the AI efficiency olympics begin!

On a laptop, on a desktop, on a phone?

Train for 5 minutes, an hour, a day, a week?

On a boat? With a goat?

[yojo]

> With a goat?

I think you meant Llama.

The rhymes are admittedly more limited, unless you have a Boston accent.

[cameronoliver]

"On a boat? With a goat?" is a quote from Green Eggs and Ham, an early-reader children's book by Dr Seuss, published in 1960.

[jdjdndndn]

I do not like been eggs and ham. I do not like them Sam I am.

Dr Seuss ftw

[hinkley]

Vernor Vinge has a story line where humans build their own portable chess computers and utilize them as assistants in human chess matches.

I still think this would be kinda cool. I could see a tournament providing the power source in addition to the chess clock. Then gamesmanship where you play moves you hope are expensive for the opponent but not for your own AI.

[Nevermark]

On a maxxxed out Mac Studio M3 Ultra 512GB.

That boat will float your goat!

[evanmoran]

This literally is fast enough to really whip the llamas.. well, you know.

And for the younger folk, this mp3 player was the precursor to Spotify:

https://youtu.be/HaF-nRS_CWM?si=d7WHzkV7CFHJ2hGg

[lifestyleguru]

Honestly AI is a trick to make us buy new expensive computers. I'm writing this from over 10 years old one and the computers offered in a leaflet from nearby electronic store aren't much better.

[542354234235]

Anyone who remembers the 90s and 2000s, where your computer hardware was out of date within months, might disagree. If you want to do bleeding edge things like running 70b+ LLMs locally or doing training, you need bleeding edge hardware. No different than if you want to play the newest AAA games. There are plenty of games you can play with old hardware, and plenty of small LLMs. When you can use ChatGPT or a bunch of other services, it isn’t a trick that some people want to host their own or do training, but you need a system that can do that.

[aniijbod]

Oh no! I thought that was Windows 11

[voidUpdate]

I mean, gaming is the big pusher of new hardware these days, and web is basically the reason you can use a 90s computer in the modern day. I happily survived on roughly 10 year old components all the way through university because I wasn't playing AAA games

[visarga]

goats have too many parameters, they are like GPT-4

[hinkley]

GO4-T

[rPlayer6554]

I’d pay for GoatLM