Software expands to fill the available resources. If you want more efficient software, build it on less powerful hardware. AI training runs are no exception!
Can't agree more. Especially as I wait to download 1.3gb file to update some Windows driver like Realtek audio or LED display, and you realise a whole effing Debian operating system with Xfce & apps can fit in a lot less.
I just shoved the whole .webvtt file in the header of a audio Response from the server so that I don't have to implement another API just for subtitles [1][2]
> Software expands to fill the available resources.
To make an analogy, that is why I think even with AI work expands to fill available resources (human+AI). I don't think jobless rate will be high, instead we will see demand expansion.
Not to the volume needed to compete with the training infrastructure setups of Anthropic or OpenAI or other leading players
No ban is perfect, there is always some loopholes or illegal exports this is to be expected, but if it prevents large scale transaction then it it is achieved its goal.
The question is rather do they we need a lot of gpus to train or training with older gen gpus is not competitive is a different problem.
Kai-Fu Lee describes the culture so well in AI Superpowers. The roots are well before GPU restriction. Absolute cut throat competition.
Imagine Sam Altman throwing a chair out a window in a meeting lol.
The message of AI Superpowers is that China will lag the US at first but once things stabilize this will happen because China has a lot more engineers and a lot more data.
Anyone who hasn't read AI Superpowers should really make it a point to read it in 2025. It is an incredible book.
I don't know, I've been hearing the story that China is about to upend the US as the leading global superpower ever since I was a kid. There's always a new vogue and novel twist put on the rationale and how it's gonna happen, but so far it's like fusion, always a few years away.
The thing is Bejing undercuts this completly by allowing local governments to perform rampant shakedown of investors and ceos through disappearances for bogus charges, even in other provinces.
Makes sense. When you restrict hardware, you have to spend all your energy on optimizing software that everyone else ignores
Imagine if they were forced to use IE7 as the only browser. The frontend frameworks would be blazing fast and we would never have bloatware like React or Angular or npm
modeless|1 year ago
kopirgan|1 year ago
mkagenius|1 year ago
1. While building https://gitpodcast.com
2. Code snip: https://github.com/BandarLabs/gitpodcast/blob/main/backend/a...
visarga|1 year ago
To make an analogy, that is why I think even with AI work expands to fill available resources (human+AI). I don't think jobless rate will be high, instead we will see demand expansion.
1vuio0pswjnm7|1 year ago
They write software that usurps other people's computing resources, e.g., CPU, storage and an internet connection that they do not pay for.
It's one reason I use NetBSD, custom barebones Linux. I write and compile software on single core old computers and cheap eMMC laptops.
aduffy|1 year ago
Cumpiler69|1 year ago
zitterbewegung|1 year ago
manquer|1 year ago
No ban is perfect, there is always some loopholes or illegal exports this is to be expected, but if it prevents large scale transaction then it it is achieved its goal.
The question is rather do they we need a lot of gpus to train or training with older gen gpus is not competitive is a different problem.
arresin|1 year ago
throawayonthe|1 year ago
[deleted]
moralestapia|1 year ago
That had nothing to do with the creation of this model.
wodderam|1 year ago
Imagine Sam Altman throwing a chair out a window in a meeting lol.
The message of AI Superpowers is that China will lag the US at first but once things stabilize this will happen because China has a lot more engineers and a lot more data.
Anyone who hasn't read AI Superpowers should really make it a point to read it in 2025. It is an incredible book.
Etheryte|1 year ago
daedrdev|1 year ago
unknown|1 year ago
[deleted]
modeless|1 year ago
lopatin|1 year ago
jurli|1 year ago
Imagine if they were forced to use IE7 as the only browser. The frontend frameworks would be blazing fast and we would never have bloatware like React or Angular or npm