The wait equation is totally irrelevant here. Where the wait equation has relevance is the fact that a generation ship, once launched, is likely unable to reconfigure itself to take advantage of new technologies invented while it is underway. This is key to why there is an incentive to wait, and there is no parallel in the idea of investing in AI. Someone who chooses to invest in AI does get access to tech that develops in the mean time. Indeed it is that investment which generates the the technology.
Alastair Reynolds covered this theme extensively in Chasm City, including technology advancements being transmitted to generation ships en route from the home system and the consequences of that. Super interesting reading!
> Where the wait equation has relevance is the fact that a generation ship, once launched, is likely unable to reconfigure itself to take advantage of new technologies invented while it is underway.
Given my experience with complex technology (software), I think it's rather likely that a generation ship will reconfigure while traveling.
Maybe we will build a ship that's just enough to bring them to a place with lots of resources. Then, it will be rebuild with those resources for the final journey. Or even new ships might be build out of existing ones to adapt for varying conditions.
This completely misses the concept that the technology doesn’t just create itself without investment. SOMEONE has to invest for that progress to be made. It’s why I always hated the application of this to tech.
> SOMEONE has to invest for that progress to be made.
History often has cases where the surrounding context/infrastructure/market/culture just wasn't suitable for an invention to take off--so it fails--and then somebody 5-100 years later tries something almost the same thing and it becomes a wild success and they get all the credit for it.
For example, look at the AT&T Picturephone from ~1964. [0] Even if someone from today time-traveled with the benefit of ~60 years of economic and technological hindsight... do you think a strategy of "just keep investing--somebody has to" would been enough to make the video-phone a widespread and profitable thing in any reasonable timeframe?
I'm pretty sure you'd go quite bankrupt first, just trying to stay solvent while making hundreds of other enabling-inventions and cost-savings in a wide range of fields while completely replacing global infrastructure.
Investment is not the sole input into creating technology, time matters to. The tranfsormer paper probably didn't take much investment to create, but without it, any attempts at creating LLMs would have been futile no matter the billions poured in.
Moreover, technology is created as spillover effect from investments in other areas (That aren't speculative). CUDA is only possible because Nvidia was supported by gaming revenue for a decade. Without CUDA, there is no alexnet, and no deep learning boom will happen if we are still on CPUs or google's proprietary TPUs.
Yeah information is different since once you find something out its often trivial to replicate and deploy it. The cost is coming up with the knowledge in the first place.
There's a fun application of this argument to the bit in the Hitch Hiker's Guide to the Galaxy books, where a civilization runs a 7.5m-year-long computer program to calculate the answer to the question of life, the universe and everything.
Someone pointed out that they would have been better off waiting for about 40 years of Moore's law to happen, then building a computer and running the same calculation in about 2 years.
I think with AI it's a bit of a different question then space travel. The flip side you have a limited time to add value before the activity is no longer valuable due to AI.
In general once a machine can do something (and AI is a machine) it quickly becomes no longer a highly valuable activity.
For example, being a portrait painter around the time cameras were invented.
So if there's a project that you think AI will do for you, just keep in mind that by the time AI gets there the effective value of that activity will have greatly diminished and you are unlikely to get out of it what you would if you do it today.
If you wait, you may find you've been reduced from highly trained master of fine art to just another guy who says "say cheese" and pushes a button.
The value of problems is not fixed.
The space version is an interesting comparison though, because while the value of space exploration would increase with speed of travel (due to being able to make use of resources across greater distances), the value of any technological accomplishment decreases as they become easier.
What I find interesting about this are the things the specific example leaves out. Many engineers consider code reviews a real drag, but they aren't just busywork or wasted time or compliance checkboxes. Done well, they are a learning tool, a teaching opportunity, and a form of communication between engineers working in different areas of the code at different skill levels and knowledge levels. All of those things have value and add to team productivity in the long term. The "cost" in terms of hours spent doing code reviews is not wasted. But if you turn that job over to AI (even if you could), you lose almost all the benefits, adding a drag on your future productivity as knowledge gaps grow and communication declines.
On the other hand, if you're doing code review poorly, and it's just a waste of everyone's time, then you're far better off just dropping them altogether than spending money on an AI system to do poor code reviews for you.
There is a neglected aspect here, which is internal expertise. By choosing to build, even if ultimately you end up choosing another tool from a vendor, your team picked up many important skills to be able to evaluate costs, architecture and performance. They also might be able to better customise the tool to your application. This expertise might end up saving money in the end.
I think this analogy is best suited for training models. Even if you had access to OpenAIs datasets right now, I don't think it would make sense for you to train them, except if you are a 500B+ company. Training costs will likely go down with time though, so at some point this might change.
Someone needs to start building the Linux of spaceships now if we're ever going to have one. In terms of AI, the difference is that advances in AI can self adapt new advances. So the question is, at what point do you invest in AI given we haven't reached that stage yet - because by then you'll have waited too long. So, in reality, any time is the best time to invest in AI as long as it's before that line.
Most AI investment is going to be applying off the shelf stuff to a new industry, so you might as well get started now to get the customers then when your wholesaler (OpenAI, AWS etc.) stocks the latest product you can wrap it up in a nice bow and sell it to your customers.
AI investment in SOTA though I have no idea how you time that but I am guessing early is better.
I sometimes think of a bigger version of this question. Would it be better if rennaisance and scientific revolution had come way later than it did. Maybe humans would have been more evolved and ready for the changes and can make better decisions. Progress is inevitable, but the rapidity of change might be our downfall.
adastra22|2 years ago
davedx|2 years ago
mo_42|2 years ago
Given my experience with complex technology (software), I think it's rather likely that a generation ship will reconfigure while traveling.
Maybe we will build a ship that's just enough to bring them to a place with lots of resources. Then, it will be rebuild with those resources for the final journey. Or even new ships might be build out of existing ones to adapt for varying conditions.
Similar to biological life on earth.
tsunamifury|2 years ago
Terr_|2 years ago
History often has cases where the surrounding context/infrastructure/market/culture just wasn't suitable for an invention to take off--so it fails--and then somebody 5-100 years later tries something almost the same thing and it becomes a wild success and they get all the credit for it.
For example, look at the AT&T Picturephone from ~1964. [0] Even if someone from today time-traveled with the benefit of ~60 years of economic and technological hindsight... do you think a strategy of "just keep investing--somebody has to" would been enough to make the video-phone a widespread and profitable thing in any reasonable timeframe?
I'm pretty sure you'd go quite bankrupt first, just trying to stay solvent while making hundreds of other enabling-inventions and cost-savings in a wide range of fields while completely replacing global infrastructure.
[0] https://www.youtube.com/watch?v=BQMnlKMFD8M
anonylizard|2 years ago
Moreover, technology is created as spillover effect from investments in other areas (That aren't speculative). CUDA is only possible because Nvidia was supported by gaming revenue for a decade. Without CUDA, there is no alexnet, and no deep learning boom will happen if we are still on CPUs or google's proprietary TPUs.
justanotherjoe|2 years ago
dustingetz|2 years ago
plegresl|2 years ago
gumby|2 years ago
Also makes you think.
mjw_byrne|2 years ago
Someone pointed out that they would have been better off waiting for about 40 years of Moore's law to happen, then building a computer and running the same calculation in about 2 years.
pacificmaelstrm|2 years ago
In general once a machine can do something (and AI is a machine) it quickly becomes no longer a highly valuable activity.
For example, being a portrait painter around the time cameras were invented.
So if there's a project that you think AI will do for you, just keep in mind that by the time AI gets there the effective value of that activity will have greatly diminished and you are unlikely to get out of it what you would if you do it today.
If you wait, you may find you've been reduced from highly trained master of fine art to just another guy who says "say cheese" and pushes a button.
The value of problems is not fixed.
The space version is an interesting comparison though, because while the value of space exploration would increase with speed of travel (due to being able to make use of resources across greater distances), the value of any technological accomplishment decreases as they become easier.
skywhopper|2 years ago
On the other hand, if you're doing code review poorly, and it's just a waste of everyone's time, then you're far better off just dropping them altogether than spending money on an AI system to do poor code reviews for you.
epups|2 years ago
I think this analogy is best suited for training models. Even if you had access to OpenAIs datasets right now, I don't think it would make sense for you to train them, except if you are a 500B+ company. Training costs will likely go down with time though, so at some point this might change.
RyanAdamas|2 years ago
quickthrower2|2 years ago
AI investment in SOTA though I have no idea how you time that but I am guessing early is better.
justanotherjoe|2 years ago
ArnoVW|2 years ago
personjerry|2 years ago
Well duh, but first find all those coefficients and then come back and we'll talk yeah?
Brotkrumen|2 years ago
I have so many problems with this line
madrox|2 years ago