[htfu]

Why would external host matter? Your machine, hacked, not your fault. Some other machine under your domain, your fault, whether bought or hacked or freely given. Agency is attribution is what can bring intent which most crime rests on.

[bee_rider]

For example, if somebody is using, say, OpenAI to run their agent, then either OpenAI or the person using their service has responsibility for the behavior of the bot. If OpenAI doesn’t know their customer well enough to pass along that responsibility to them, who do you think should aboard the responsibility? I’d argue OpenAI but I don’t know whether or not it is a closed issue…

No need to bring in hacking to have a complicated responsibility situation, I think.

[pixl97]

I mean, this works great as long as models are locked up by big providers and things like open models running on much lighter hardware don't exist.

I'd like to play with a hypothetical that I don't see as being unreasonable, though we aren't there yet, it doesn't seem that far away.

In the future an open weight model that is light enough to run on powerful consumer GPUs is created. Not only is it capable of running in agentic mode for very long horizons, it is capable of bootstrapping itself into agentic mode if given the right prompt (or for example a prompt injection). This wasn't a programmed in behavior, it's an emergent capability from its training set.

So where in your world does responsibility fall as the situation grows more complicated. And trust me it will, I mean we are in the middle of a sci-fi conversation about an AI verbally abusing someone. For example if the model is from another country, are you going to stamp your feet and cry about it? And the attacker with the prompt injection, how are you going to go about finding that. Hell, is it even illegal if you were scraping their testing data?

Do you make it illegal for people to run their own models? Open source people are going to love (read: hate you to the level of I Have No Mouth and Must Scream), and authoritarians are going to be in orgasmic pleasure as this gives them full control of both computing and your data.

The future is going to get very complicated very fast.