top | item 46846791

(no title)

msp26 | 28 days ago

> Special shout out to Google who to this date seem to not support tool call streaming which is extremely Google.

Google doesn't even provide a tokenizer to count tokens locally. The results of this stupidity can be seen directly in AI studio which makes an API call to count_tokens every time you type in the prompt box.

discuss

order

haxel|28 days ago

AI studio also has a bug that continuously counts the tokens, typing or not, with 100% CPU usage.

Sometimes I wonder who is drawing more power, my laptop or the TPU cluster on the other side.

Havoc|28 days ago

Same for clause code. It’s constantly sending token counting requests

localhost|28 days ago

tbf neither does anthropic