top | item 35655196

(no title)

pffft8888 | 2 years ago

They can do this in people, too, not just LLMs.

Imagine the mistakes that can be made by changing one fact but not reconfiguring the whole network.

Thhese guys remind me of when I used to change EXEs in hex editors then notice "unrelated" weird glitches.

discuss

order

mrtranscendence|2 years ago

That’s what I’d be afraid of, though I haven’t read the relevant literature so maybe this is addressed. Since there are way fewer parameters than encoded facts it seems like it would be difficult to change one fact without messing with others.