top | item 46622465

(no title)

jerryShaker | 1 month ago

AI companies just 'acknowledging' risks and suggesting users take unreasonable precautions is such crap

discuss

order

NitpickLawyer|1 month ago

> users take unreasonable precautions

It doesn't help that so far the communicators have used the wrong analogy. Most people writing on this topic use "injection" a la SQL injection to describe these things. I think a more apt comparison would be phishing attacks.

Imagine spawning a grandma to fix your files, and then read the e-mails and sort them by category. You might end up with a few payments to a nigerian prince, because he sounded so sweet.

uhfraid|1 month ago

Command/“prompt” injection is correct terminology and what they’re typically mapped to in the CVE

E.g. CVE-2026-22708

ronbenton|1 month ago

Telling uses to “watch out for prompt injections” is insane. Less than 1% of the population knows what that even means.

Not to mention these agents are commonly used to summarize things people haven’t read.

This is more than unreasonable, it’s negligent

intended|1 month ago

We will have tv shows with hackers “prompt injecting” before that number goes beyond 1%

rsynnott|1 month ago

It largely seems to amount to "to use this product safely, simply don't use it".

sodapopcan|1 month ago

I believe that's known as "The Steve Jobs Solution" but don't quote me on that. Regardless, just don't hold it that way.

AmbroseBierce|1 month ago

It's exactly like guns, we know they will be used in school shootings but that doesn't stop their selling in the slightest, the businesses just externalize all the risks claiming it's all up fault of the end users and that they mentioned all the risks, and that's somehow enough in any society build upon unfettered capitalism like the US.

delaminator|1 month ago

If you’re going to use “school shootings” as your “muh capitalism”, the counter argument is the millions of people who don’t do school shootings despite access to guns.

There are common factors between all of the school shooters from the last decade - pharmacology and ideology.