If you are worried about security or IP at all, it's preferable to run locally, or spin up your own box that you can query running one of these models.
I understand the reasons for not wanting to use a remote LLM. My question was about how useful local LLMs are. It might turn out that for some people remote LLMs are unacceptable for privacy reasons and local LLMs are unacceptable because they aren't good enough to be useful.
gjm11|1 year ago