[flatiron]

my concern with using chatgpt is PII. If I host the LLM and set it up that it doesn't record any of the interactions besides some weird meta data and sign that in a contract i bet a bunch of my clients would like to use my LLM. especially if I can train it on internal documentation that they can't/won't send to a big third party like chatgpt. im one throat to choke and i already have their PII so i think its a good fit.

without getting into too much detail my job supports business to people interactions. my use case is training the LLM to assist the business agents. if it can give real time information that's helpful to the agent while causally listening to the conversation thats a pretty big game changer. also i want to use it for staffing decisions since it can view historic data and make recommendations for the future.

[UncleEntity]

How big of a model do you suppose it would take to come up with a Punctuation-as-a-Service cloud-based solution?

Asking for a friend…