top | item 40293692

(no title)

EarthMephit | 1 year ago

Even in Australia is the LLM lag to a server noticable?

Generally an LLM seems to take about 3s or more to respond, and the network delay to the US is a couple of hundred milliseconds.

The network delay seems minimal compared to the actual delay of the LLM.

discuss

order

No comments yet.