[kgdiem]

If I was building this in a system design interview I would use whisper, NLP, and “classic ML” classifiers with deterministic results. I would not want an LLM in the loop at all. Facebook and Google have been able to target you better than you could even perceive for years.

LLMs are slow, expensive and inconsistent. More importantly It’s not the right tool for the job.

Really feels like more “oohhh look at how important and scary LLMs are”.

*edit* PS, my company does marketing, communication and trade surveillance for FINRA registered broker dealer firms. If the CCO or anyone else with admin access wanted to monitor for someone talking badly about them they absolutely could update their list. No LLMs in the loop, very scalable, affordable, auditable and reliable. LLMs are just an interface not a solution for analysis.