top | item 46664919

(no title)

dernett | 1 month ago

This is crazy. It's clear that these models don't have human intelligence, but it's undeniable at this point that they have _some_ form of intelligence.

discuss

order

brendyn|1 month ago

If LLMs weren't created by us but where something discovered in another species' behaviour it would be 100% labelled intelligence

te0006|1 month ago

Yes, same for the case where the technology would have been found embodied in machinery aboard a crashed UFO.

qudat|1 month ago

My take is that a huge part of human intelligence is pattern matching. We just didn’t understand how much multidimensional geometry influenced our matches

keeda|1 month ago

Yes, it could be that intelligence is essentially a sophisticated form of recursive, brute force pattern matching.

I'm beginning to think the Bitter Lesson applies to organic intelligence as well, because basic pattern matching can be implemented relatively simply using very basic mathematical operations like multiply and accumulate, and so it can scale with massive parallelization of relatively simple building blocks.

sdwr|1 month ago

I don't think it's accurate to describe LLMs as pattern matching. Prediction is the mechanism they use to ingest and output information, and they end up with a (relatively) deep model of the world under the hood.

csomar|1 month ago

Intelligence is hallucination that happens to produce useful results in the real world.

threethirtytwo|1 month ago

I don't think they will ever have human intelligence. It will always be an alien intelligence.

But I think the trend line unmistakably points to a future where it can be MORE intelligent than a human in exactly the colloquial way we define "more intelligent"

The fact that one of the greatest mathematicians alive has a page and is seriously bench marking this shows how likely he believes this can happen.

eru|1 month ago

Well, Alpha Go and Stockfish can beat you at their games. Why shouldn't these models beat us at math proofs?

_fizz_buzz_|1 month ago

Chess and Go have very restrictive rules. It seems a lot more obvious to me why a computer can beat a human at it. They have a huge advantage just by being able to calculate very deep lines in a very short time. I actually find it impressive for how long humans were able to beat computers at go. Math proofs seem a lot more open ended to me.

thfuran|1 month ago

Alpha go and stockfish were specifically designed and trained to win at those games.

ekianjo|1 month ago

It's pattern matching. Which is actually what we measure in IQ tests, just saying.

jadenpeterson|1 month ago

There's some nuance. IQ tests measure pattern matching and, in an underlying way, other facets of intelligence - memory, for example. How well can an LLM 'remember' a thing? Sometimes Claude will perform compaction when its context window reaches 200k "tokens" then it seems a little colder to me, but maybe that's just my imagination. I'm kind of a "power user".

rurban|1 month ago

I call it matching. Pattern matching had a different meaning.

altmanaltman|1 month ago

Depends on what you mean by intelligence, human intelligence and human

TZubiri|1 month ago

As someone who doesn't understand this shit, and how it's always the experts who fiddle the LLMs to get good outputs, it feels natural to attribute the intelligence to the operator (or the training set), rather than the LLM itself.

xyzsparetimexyz|1 month ago

Yes it is intelligent, but so what? Its not conscious, sentient or sapient. It's a pattern matching chinese room.