top | item 45483338

(no title)

BenoitEssiambre | 4 months ago

Yeah, the example with the eggs isn't great because an LLM would indeed get the correct interpretation but the thing is, this is based on LLMs having been trained on the context. When and LLM has the context, it is usually able to correctly fill the gaps of vague English specifications. But if you are operating at the bleeding edge of innovation or in depths of industry expertise that LLMs didn't train on, it won't be in a position to fill those blanks correctly.

And domains with less training data openly available are areas where innovation and differentiation and business moats live.

Oftentimes, only programming languages are precise enough to specify this type of knowledge.

English is often hopelessly vague. See how many definitions the word break has: https://www.merriam-webster.com/dictionary/break

And Solomonoff/Kolmogorov theories of knowledge say that programming languages are the ultimate way to specify knowledge.

discuss

order

No comments yet.