[kiviuq]

Bots are great time savers when learning new technology and for doing tedious tasks. For example, I'm learning Rust and using a combination of GPT-4, local llama3, and Codeium helped me to write more Rust-like code. They can generate schema definitions from sample XML data that I use in Spark, and generally help me write better and idiomatic PySpark/Spark queries. Afterward, you wouldn't be able to tell whether the code was written by someone with years of Spark/Python/Rust experience or a noob like myself. As long as you're fluent in some related tech stack (like Scala, SQL), I find bots can get you there quickly. They also work best when combined with TDD / test-first. I get decent results when I let the bot focus on smaller aspects. When I'm unsure or the code has issues, I take it to the other Bot to find alternative solutions. This way, I can quickly get an idea of what you can do in the language, including lesser-used features. Finally I get unit tests and documentation for free.

[dmarchand90]

Could you clarify what parts you use llama and which you use gpt4 on?

[kiviuq]

I use llama for anything that falls under an NDA clause, e.g. data by which the client could be identified. Like asking it analyze existing code/algorithms, to document functions or parse data is done only locally.

if the local model got stuck I try to abstract the problem and present gpt with the general case (e.g. given 2 columns A,B, find... )