Show HN: Opty – A Zig-based HDC that reduces token use by up to 90%

[bojo]

I kept seeing people all over social media talking about how they were making custom local-LLM systems to help reduce the token load injected into their context window.

On the side my recent project has me looking at Hyperdimensional Distributed Memory. I couldn't help but wonder if I could make an MCP server to improve token usage. Sure enough, using a combination of HDC + TOOL format, I was able to get opty's own self audit down by 93% in token usage.

Still experimenting with large codebases but feel pretty good about how this should drive overall token usage down.

Happy to hear any feedback.

[guld]

Interesting. Can anyone provide personal insights or benchmarks on how effective TOON compared to e.g., JSON or Markdown is (Codex, Claude, ...)?

[verdverm]

Ideas like this are bad ones. Words matter, you should put effort into them, minimization is not the primary optimization, don't let something like this MitM and change your hard work for the worse.

The reason people do custom is to craft very good instructions and tools, something a machine is not capable of