top | item 46786153

(no title)

VadimPR | 1 month ago

Is the app legitimate though? A few of these apps that deal with LLMs seem too good to be true and end up asking for suspiciously powerful API tokens in my experience (looking at Happy Coder).

discuss

order

runjake|1 month ago

It's legitimate, but its also extremely powerful and people tend to run it in very insecure ways or ways where their computer is wiped. Numerous examples and stories on X.

I used it for a bit, but it burned through tokens (even after the token fix) and it uses tokens for stuff that could be handled by if/then statements and APIs without burning a ton of tokens.

But it's a very neat and imperfect glimpse at the future.

Veen|1 month ago

They've recently added "lobster" which is an extension for deterministic workflows outside of the LLM, at least partially solving that problem. Also fixed a context caching bug that resulted in it using far more Anthropic tokens than it should have.

chrisjj|1 month ago

> It's legitimate

How do you know?

> it burned through tokens (even after the token fix) and it uses tokens for stuff that could be handled by if/then statements and APIs without burning a ton of tokens.

Sponsored by the token seller, perhaps?