top | item 47195835 (no title) mpalmer | 1 day ago > No hardcoded behaviours, no reward functions. - they could evolve in any direction.If they can hack their reward functions won't this always converge on some kind of agentic opium den? discuss order hn newest urav|1 day ago that would be true if there was a reward function. compute_reward() exists in the code, but it returns 0.0.they're only living/evolving to survive, and fork (reproduce).can't wirehead natural selection if the brain does nothing useful, they'd die and their genome would die with them.
urav|1 day ago that would be true if there was a reward function. compute_reward() exists in the code, but it returns 0.0.they're only living/evolving to survive, and fork (reproduce).can't wirehead natural selection if the brain does nothing useful, they'd die and their genome would die with them.
urav|1 day ago
they're only living/evolving to survive, and fork (reproduce).
can't wirehead natural selection if the brain does nothing useful, they'd die and their genome would die with them.