top | item 35048849

(no title)

donnowhy | 3 years ago

sounds to me like a wave with a positive and a negative part.

which IMO is what drives constructive/destructive interference in waves.

my take away is that any LLM that can behave "good" must also be able to behave "badly"; philosophically, because it's not possible to encode "good" without somehow "accidentally" but unavoidably also encoding "bad/evil".

This is well aligned with the rest of my understanding about the nature of reality including it's mathematically determined limitations (diagonals, infinities, paradoxes) and so on.

discuss

order

cs702|3 years ago

> my take away is that any LLM that can behave "good" must also be able to behave "badly"; philosophically, because it's not possible to encode "good" without somehow "accidentally" but unavoidably also encoding "bad/evil".

That's a really good non-technical summary of the OP's hypothesis. Thanks!