WingNews logo WingNews
top | item 46575875

(no title)

stuartjohnson12 | 1 month ago

https://www.lesswrong.com/posts/rarcxjGp47dcHftCP/your-llm-a...

Hi author, this isn't personal, but I think your AI may be deceiving you into thinking you've made a breakthrough.

discuss

order

usefulposter|1 month ago

Fascinating. Searching https://hn.algolia.com for "zenodo" and "academia.edu" (past year) reveals hundreds of similar "breakthroughs".

The commons (open access repositories, HN, Reddit, ...) is being swamped.

stuartjohnson12|1 month ago

Since OpenAI patched the LLM spiritual awakening attractor state, physics and computer science is what sycophantic AI is pushing people towards now. My theory is that those things tend to be especially optimised for deceit because they involve modelling and many people can become confused between the difference between a model as the expression of a concept and a model as in the colloquial idea of "the way the universe works".

amarcheschi|1 month ago

it's all ai allucination, in a subreddit i once found a tailor asking for how to contact some professors because they found a breakthrough discovery on how knowledge is arranged inside neural networks (whatever that means)

daikikadowaki|1 month ago

[deleted]

stuartjohnson12|1 month ago

In the essay I linked, there are some instructions you can follow to test out the idea under "step 1". It's really important to follow them exactly and not to use the same ChatGPT instance as you're talking to about this idea so we can test with an independent party what is going on. I'd be curious what the output is.

durch|1 month ago

If you have a few minutes I invite you to check what we're doing over at Open Horizon Labs, its exactly the type of thinking we have around the current state of the world. Apologies I feel like I'm stalking you in the comments, but what you're saying absolutely resonates with what I've been thinking, and what I've been trying to build, and its refreshing to finally feel that I'm not insane.

https://github.com/open-horizon-labs/superego is probably the most useful tool we have, but I'm hoping that we can package it and bring it to the people, as it does make all these LLMs orders of magnitude more useful