[jorgemf]

cost is relative. how much would it cost for a human to read and give you an answer for 200k tokens? Probably much more than $3.

[vinay_ys]

You are not going to take the expensive human out of the loop where downside risk is high. You are likely to take the human out of the loop only in low risk low cost operations to begin with. For those use cases, these models are quite expensive.

[jakderrida]

Yeah, but the human tends not to get morally indignant because my question involves killing a process to save resources.