top | item 46936606

(no title)

thenewwazoo | 21 days ago

Every time I see something about trying to control an LLM by sending instructions to the LLM, I wonder: have we really learned nothing of the pitfalls of in-band signaling since the days of phreaking?

discuss

order

quadrature|21 days ago

Sure but the exploit here isn’t prompt injection, it is an edge case in their billing that isn’t attributing agent calls correctly.

thenewwazoo|21 days ago

That's fair - I suppose the agent is making a call with a model parameter that isn't being attributed, as you say.

cpa|21 days ago

It reminds me of when I used to write lisp, where code is data. You can abuse reflection (and macros) to great effect, but you never feel safe.

See also: string interpolation and SQL injection, (unhygienic) C macros

direwolf20|21 days ago

Allowing phreaking was an intentional decision, because otherwise they could have carried half as many channels on each link.

Mountain_Skies|21 days ago

It'll be a sad day for Little Bobby Tables if in-band signaling ever goes out of fashion.