[codefreakxff]

In some areas it does a good job of giving me a better answer than me checking 5-10 random stack overflow and blog posts with different answers over 20 years...

But, it is completely incapable of saying "I don't know the answer to that" and will spew the wrong answer to anything. For fun I have arguments with ChatGPT that it is just making things up and it should just tell me "I don't know" and it will happily say "I'm sorry, you are right. Here is the right answer <insert made up fact>" and it will do so generating random garbage indefinitely.

The problem is that I can't trust it to provide facts any better than asking my bull-shitting co-worker who is convinced he is right about everything and when called out says "yeah, that's what I was saying, <insert contradictory thing>"