top | item 37641072

(no title)

Mxbonn | 2 years ago

I've been using the claude model over the past months and I have to say I usually prefer it over ChatGPT.

Some things that impressed me particular are:

* It can often give you working urls of images related to your query. (e.g. give me some images to use with this blog paragraph).

* It can list relevant publications corresponding to paragraphs, chatgpt often halucinates new papers but claude consistenly gives highly cited and relevant suggestions.

* It can work with pdf inputs.

discuss

order

amanzi|2 years ago

You didn't say which version of GPT you prefer it over. My experience of Claude hasn't been good at all - I get obvious hallucinations all the time. Whereas I get pretty consistent accurate results with GPT-4.

I just tried again now and asked it about HTMX and Django since I had just been reading an article about it. Claude invented a package called `htmx.django` and a decorator that could be imported called `@hx_request`. This is typical of my experience with Claude.

shmatt|2 years ago

Claude is bad at code and great at everything else, I thought that was pretty common knowledge by now. I second OP where I prefer using it over OpenAI models these days

jeffreygoesto|2 years ago

Why didn't you let it implement it and start a new project?

edgyquant|2 years ago

I’ve been using Claude for months now, as has my dev team and a number of other people I know, and we don’t have this problem at all. In my experience is hallucinates less. This is compared to ChatGPT with GPT4. Anecdotal evidence is worthless it seem.

inciampati|2 years ago

It won't hallucinate almost anything if you give it the entire documentation for the libraries you want to use. It can ingest many hundreds of pages of documentation without problem. Used like this it is far more powerful than GPT-4 or any existing model.

lucgagan|2 years ago

As a counter point, I've been actively assessing feasibility of migrating my experiments to Claude with not much success. Trying to migrate prompts from GPT 4 to Claude often yields half-baked results. Claude seems to require a lot more handholding to get the desired result.

visarga|2 years ago

In my information extraction prompts Claude is about as good as GPT-3.5 but slower. Its only advantage over OpenAI is context length. GPT-4 is better, 3.5 is faster.

But I am using it often to chat with PDFs and it works great for that. I would not want to give this ability up.

m3kw9|2 years ago

When using stuff like this you let the cream of top surface then use it. It will surface when enough people/publication give praise, otherwise you waste time evaluating too many models, it’s not a fun task as they can give you illusions of being great at some but end up with overall worse. Right now gpt4 is king and haven’t been any consistent chatter saying otherwise

airstrike|2 years ago

ChatGPT 3.5 or 4? The difference between them is much more massive than "0.5" appears to suggest