top | item 46468780

(no title)

ninju | 1 month ago

The fact that we have anthropomorphized AI systems (not just Grok) is because of the way in which we interact with these system with natural language.

discuss

order

roywiggins|1 month ago

It's 50-80% because they are RLHFed into talking with "I". This was far less of an issue when it was just GPT-3 in a completion UI. But people find LLMs trained to produce text that looks like it's coming from a personality to be more compelling: ChatGPT is when the tech exploded into popularity.

LLMs that aren't chat tuned are just not as easy to anthropomorphize.

Terr_|1 month ago

My own minor attempt to hold back this tide involves urging everyone to imagine LLM exchanges a theater-play script document. The character's lines are not the author.

Just imagine how different all this would be if every prompt contained something to make the character(s) obviously fictional, ex: "You are Count Dracula, dread lord of the night, and a visitor has the following question..."

We hopefully wouldn't see mindless reports that "vampires are real now" or "Draculabot has developed coping mechanisms for the dark thirst, agrees to try tomato juice."

biophysboy|1 month ago

I really wish I could use custom products w/ RLHF turned off. I know that's not how it works, but the stupid marketing copy speak makes me use them less

guywithahat|1 month ago

That's sort of my thought too. Grok can't apologize, but it also can't do anything without being told. A hammer can't apologize, but it also doesn't know the difference between hitting a nail or a person. Perhaps we could design a hammer that does less harm to a human but if it comes at the cost of being a worse hammer I don't want it

WarOnPrivacy|1 month ago

> Grok can't apologize, but it also can't do anything without being told.

If you mean being told by the end user, this famously hasn't been the case. Dialing back the only restriction was enough for Grok to create nsfw material (w/o any request to create that).

     [Grok] didn’t hesitate to spit out fully uncensored topless
     videos of Taylor Swift the very first time I used it
     without me even specifically asking the bot to take her clothes off.