[jedbrooke]

the author mentions they’re using haiku for the model, but I wonder if the travel query -> place transform could be done with a tiny local model.

But that’s the bitter lesson I guess, unless there’s a reason to go fully local (extreme privacy concerns, offline use, etc) training a custom model just isn’t worth it over using some cloud api offering, even if it is orders of magnitude more compute that _somebody_ is paying for in the end