[vharuck]

What if somebody asked the bot for ways to maximize the amount of a specific vitamin in their or a child's diet? The bot may give sycophantic advice that leads to poisoning.

Again, the butt stuff is an absurd example. But it works because (A) it catches our attention and stays in our memories, and (B) it's amazing the system failed on such an absurd example.