top | item 45764253

(no title)

luisml77 | 4 months ago

I am prepared and want to discuss seriously every one of my view points. The initial comment was just the abstract. I am extremely confident in my world view about Deep Learning and cognitive ability. And the reason for that is because I generally try to avoid doing what you just did, that is, reading what other people think regarding this subject. I instead choose to ground my views in real world experiments and information I have gathered and experienced. This primarily consists of an enormous amount of experimentation with Deep Learning models, both inference and training. My views come mostly from that. I don't recite Andrej Karpathy or Ilya Sutskever. I don't even care about their opinions for the most part. I experiment with the models to such an extreme degree that I understand very well how they behave and their limitations. And I believe if you are going to create a breakthrough, this is the only way to do so.

> an LLM or any other computational neural net is no different from a program like that

I don't think so. A program doesn't exhibit highly complex abstract thought in a very high-dimensional space.

> It’s executing deterministic instructions, like a machine, because it is a machine

Its true that LLMs are deterministic. But do you really think that the magic behind the brain is only due to temperature and randomness? Do you really think that non-deterministic behavior is the magic ingredient that makes up what we are referring to as consciousness? I could inject noise into an LLM at every parameter dynamically during inference. The output would come out just fine. After all, LLMs are high dimensional and can handle a little noise. Would it really be more conscious after that? You can find experiments where people remove entire layers of the LLM and it still works fine. A little noise would be even less harmful than that.

You see, when I'm arguing, I'm not citing what some other person said. I at most will cite experiments from other people and their results. When I am contradicting your arguments, I present you a reality you can go and try in the real world and verify. You can go verify yourself LLMs exhibit complex high-dimensional thought. You can verify yourself that if you inject noise dynamically through inference on every parameter, you still get coherent output from the LLM.

So, if you are willing to continue this discussion, I ask of you that you present some sort of "probing" of the real world and the respective "reaction" of the same real world as arguments. That is what finding the truth means.

And lastly. I am presenting a Theory. This means I believe that my points form a foundation that makes my theory stronger than yours. It means I have better evidence that backs it up. It doesn't mean I have proved what consciousness is. Instead, it primarily means I can make more accurate predictions using my theory on real world scenarios involving artificial and biological neural networks. And my personal experience shows me that is true.

discuss

order

No comments yet.