top | item 44224994

(no title)

WhyIsItAlwaysHN | 8 months ago

What I was saying is that you wouldn't use a raw LLM (so 506 tokens to get an answer). You would use it with web search so you can get the links.

The LLM has to read the websites to answer you so that significantly increases the token count, since it has to include them in its input.

discuss

order

No comments yet.