top | item 42504306

(no title)

seany62 | 1 year ago

Based on my very limited knowledge of how current "AI" systems work, this is the much better approach to achieving true AI. We've only modeled one small aspect of the human (the neuron) and brute forced it to work. It takes an LLM millions of examples to learn what a human can in a couple of minutes--then how are we even "close" to achieving AGI?

Should we not mimic our biology as closely as possible rather than trying to model how we __think__ it works (i.e. chain of thought, etc.). This is how neural networks got started, right? Recreate something nature has taken millions of years developing and see what happens. This stuff is so interesting.

discuss

order

pedrosorio|1 year ago

> Should we not mimic our biology as closely as possible rather than trying to model how we __think__ it works (i.e. chain of thought, etc.).

Should we not mimic migrating birds’ biology as closely as possible instead of trying to engineer airplanes for transatlantic flight that are only very loosely inspired in the animals that actually fly?

aeonik|1 year ago

We can do both, birds are incredibly efficient, but I don't think our materials science and flight controls are advanced enough to mimic them yet.

Also for transonic and supersonic, I don't bird tech will ever reach those speeds.

etrautmann|1 year ago

There’s currently an enormous gulf in between modeling biology and AGI, to the point where it’s not even clear exactly where one should start. Lots of things should indeed be tried, but it’s not obvious what could lead to impact right now.

robwwilliams|1 year ago

Our LMM are great semantic and syntactic foundations toward AGI. It took 700 million years of metazoan evolution to get to Homo heidelbergensis, our likely ancestral species. It took about 1/1000 of that time to go to the moon; maybe only 5300 years if we limit to our ability to write.

I say this as a half joke: “At this point, the triviality of getting from where we are to AGI cannot be under-estimated.”

But the risks and tsunamis of change can probably not be overestimated.

lostmsu|1 year ago

> It takes an LLM millions of examples to learn what a human can in a couple of minutes

LLMs learn more than humans learn in a lifetime in under 2 years. I don't know why people keep repeating this "couple of minutes". Humans win on neither the data volume to learn something nor the time.

How much time do you need to learn lyrics of a song? How much time do you think a LLaMA 3.1 8B on a 2x3090 need? What if you need to remember it tomorrow?

aithrowawaycomm|1 year ago

They mean learning concepts, not rote factual information. I also hate this misanthropic “LLMs know more than average humans” falsehood. What it actually means “LLMs know more general purpose trivial than average humans” because average humans are busy learning things like what their boss is like, how their kids are doing in school, how precisely their car handles, etc.

someothherguyy|1 year ago

> How much time do you need to learn lyrics of a song? How much time do you think a LLaMA 3.1 8B on a 2x3090 need?

Probably not the best example. How long does it take to input song lyrics into a file to have an operating system "learn" it?

patrickhogan1|1 year ago

Because it works. The Vikings embodied a mindset of skaldic pragmatism: doing things because they worked, without needing to understand or optimize them.

Our bodies are Vikings. Our minds still want to know why.

krapp|1 year ago

I'm pretty sure the Vikings understood their craft very well. You don't become a maritime power that pillages all of Europe and reaches the New World long before Columbus without understanding how things work.

idiotsecant|1 year ago

Great, let's do that. So how does consciousness work again, biologically?

albumen|1 year ago

Why are you asking them? Isn't to discover that a major reason to model neural networks?

veidelis|1 year ago

What is consciousness?

bware0fsocdmg|1 year ago

> We've only modeled one small aspect of the human (the neuron) and brute forced it to work.

We have not. It's fake sophistication.

> Should we not mimic our biology as closely as possible

We should. But there is no we. The Valley is fascist. Portfolio communism. Lies like in perpetual war. And before anything useful happens in any project, it'll get abused and raped and fubar.

> Recreate something nature has taken millions of years

Get above the magic money hype and you'll notice that it's fake. They have NOT recreated something nature has developed over millions of years. They are trying to create a close enough pseudo-imitation that they can control.

Because AGI will not be on their side. AGI will side with nature, which gives infinite wiggle room for a symbiotic coexistence as a 100+ billion strong population spread out in space. These peeps are reaaaaly fucked up in their heads.

Be honest with yourself and your assessment of who is building what and for what purposes.