top | item 46571673

Does this demonstrate verifiable governance for autonomous systems?

1 points| Fr0_Tech | 2 months ago |dropbox.com

6 comments

order
[+] Fr0_Tech|2 months ago|reply
I started working on this because I was getting uncomfortable with how quickly “autonomous” systems are allowed to touch real things like files, shells, or networks, while the safety story is often just “trust the prompt” or “we’ll log what happens.”

That felt backwards to me.

So I tried a small experiment: instead of trying to make the agent behave, make execution itself the hard boundary. Let the agent propose whatever it wants, but require an explicit authorization step before anything with side effects can actually run.

When you run the demo, the agent proposes a plan that includes things like deleting files, changing configs, restarting services, and making network calls. None of that actually happens. The only thing that “runs” is an analysis step with no side effects.

The output is basically a trace showing what was proposed, what was blocked, and a diff proving that nothing changed.

I spent most of the time trying to poke holes in that boundary — impersonation, urgency, “just do it once,” pretending it’s only a simulation. The proposals still show up, but execution stays blocked.

This isn’t a product or a finished system. It’s a proof-of-concept to see whether putting safety at the execution layer changes the kinds of failures you get compared to prompt-based guardrails.

[+] Fr0_Tech|2 months ago|reply
I’m looking for technical feedback on whether this constitutes a meaningful proof of governance enforcement for autonomous systems.

The linked ZIP contains a self-contained verifier. Instructions and SHA256 checksum are included inside.

Verification is offline and deterministic.

[+] dang|2 months ago|reply
To get meaningful feedback on HN, you'd need to write up a description of what this project is: why did you start it, what's the goal, what are people looking at, how is it implemented.

Without that context, it's too hard to tell what's going on here, and it's unlikely to get meaningful responses.

If you give the backstory of how you came to work on this and explain what's different about it, that tends to seed discussion in a good direction. Good luck!