Ask HN: Is paid ChatGPT Plus worth it?

[JaDogg]

Last time I checked there was a limit to access GPT-4 even after paying.

GPT-3.5, Bard, Bing is free -- any real advantage? specially considering limited acess for individual users? (even after paying)

Now there is even a waitlist to pay for it. I am hitting the capability wall of free version regularly.

If you are using it, are you not running into 50 per month limit? Is that enough for you? << seems like 50 per month is wrong it is 50 per 3-4 hours, but it seem to change sometime. I can probably hit 50 per 3-4 hours limit trivially when I'm focused. I have been throttled of hackernews/reddit/etc for posting too fast for example.

(UK based if that matters)

PS. I'm using copilot. But I see that it works fine as a autocomplete for Python. I tried using it for C++ but I had to delete chunk of it as I ran into segmentation faults (very easily). It is defenitely good at generating tests tho.

[jiggawatts]

As a counter-point, I paid for it for three months immediately after its launch, had a lot of fun, and then cancelled my subscription.

Yes, GPT4 is very noticeably smarter than GPT 3.5 or any of the competitors like LLAMA 2. I rank almost all LLMs at the same level as a high school student, and GPT4 at the level of a graduate student just starting out as a junior employee.

However, I don't need a "junior" assistant, I need more of "me", which GPT4 can't currently emulate.

If I were to hire a flesh & blood human junior tech, that would be with the expectation that the junior would learn with time and pick up the specific techniques and approaches I prefer to use. Currently, GPT models cost an absurd amount of time, effort, and money to customise, and there's little chance that this would result in the equivalent of a trained employee.

These days I don't write much code, and the code that I write I can bang out faster than I can explain what I want to ChatGPT.

I've also found that the act of coding is a part of the learning process. I can't really understand something until I've taken it apart myself and put it back together again.

I keep telling my customers: I can teach it to you, but if I learn it on your behalf, you'll end up knowing nothing yourself.

[zh3]

Personally I'm on the wait list, mainly because it cracked a problem in seconds that one hour plus on stackoverflow hadn't solved. I didn't go to ChatGPT first because (erroneously) I figured the issue was too esoteric for it to crack.

Specifically, following an update to Samba 4.13 our diskless DOS systems failed to map their drives on the server. ChatGPT came up with the answer first time, with a bunch of specific settings in smb.conf, unclear which did the trick but it worked at first attempt (after numerous failed SO-inspired guesses).

The day before, a co-worker sent a draft of a Web UI layout that was clearly doable but well beyond my CSS abilities . Four hours later, with copilot assistance, the web page (a complex form) got a big thumbs up.

Today, I asked a question about how to solve a problem I'd struggled for some months. No useful answers on SO, lots of net-poking and thinking got me a working solution that seemed pretty cool. And...I asked ChatGPT, first try it gave me CSS that was definitely better than my efforts.

On the other hand, in my specific domain of expertise, the answer are either egg-suck or trival.

So (for me, personally) the real boost is in areas I have a little knowledge and can figure out the right question to ask an AI.

[JaDogg]

Yes I have this experience with GPT 3.5, where my code is superior when it actually matters. But I'm not sure if GPT 4 will help me with that. There is a waitlist to pay now.

I recently tried to use it write a .scad parser. I ended up writing it myself as code it generated was useless. (This was even in Python and I tried rephrasing and giving it multiple examples)

It also loves to import libraries. Which I do not really like I prefer avoid dependencies as much as I can.

[konha]

It seems to me people’s expectations vary a lot.

For me ChatGPT has replaced a lot of Google searches and skimming stackoverflow just to get some details for a small obstacle in my workflow.

Even if answers are not a hundred percent correct all of the time, it saves so much time to get to “good enough”.

I use it to generate shell scripts, SQL queries and general boilerplate like configuration files.

A couple of days ago I went from “I’d like to have a local DNS server running to test one aspect of my code” to a running docker container of CoreDNS with the configuration I needed for my tests in a matter of minutes. The same task would have taken forever had I googled for the information myself and stitched together snippets from the docs until it worked the way I wanted.

I run into the message limit occasionally, but 50 messages per 3 hours is more than enough most of the time.

[JaDogg]

I see. this make sense to me. But I wanted to try to see if it is sufficient... but there is a waitlist for paid now. (Perhaps recent drama has something to do with that)

[convexstrictly]

Bing Chat (Choose "Creative Mode" or "Use GPT-4" depending on UI) is GPT-4 with retrieval augmented generation using the Bing Search engine. It seems to be tuned a little differently, but I haven't found it any better or worse than GPT-4 with browsing enabled.

Note that if you don't pick "Creative Mode" or "Use GPT-4, you get Microsoft's own LLM.

There is a new GPT-4 Turbo available from OpenAI that is ahead of GPT-4 on many benchmarks:

https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...

My guess it that it will soon be incorporated into Bing Chat. So if money is tight, I would stick with Bing Chat (with the appropriate mode turned on). Note that Bing Chat is very different from vanilla Bing Search.

Bard and GPT 3.5 are decidedly inferior to GPT-4. I wouldn't waste my time using them.

Github Copilot is also markedly inferior to GPT-4 in generating code based on instructions.

Sometimes I get a little impatient waiting for Bing Chat to generate an answer. If the question is not too complicated, I have found perplexity.ai (w/o GPT-4) to be low latency and high factuality. In fact when searching for research papers on a topic, I have often found it superior to the alternatives.

[3cats-in-a-coat]

Not sure if you've used Bing Chat recently. It's performing worse and worse over time. One pattern that I keep running into in almost every conversation is that it doesn't acknowledge the question and just answers something else. When I clarify myself and ask for a better answer it starts repeating itself verbatim, again and again, and there's no way to get it out of this.

Additionally Bing Chat has a limit of messages per chat, which means you lose your context over and over again, which is a significant impediment when context is important to the problem at hand.

Another problem is Bing Chat is much more likely to search online, than ChatGPT 4. ChatGPT searches when this is logically necessary, like asking for latest news. Bing almost always searches, and then IGNORES its own knowledge, in order to give out a poor digest of what it read online. The problem is that what it read online is often not relevant to the question, because it depends on how accurate the search query was. And if I wanted just to read the search query I'd go search myself.

[kken]

>Github Copilot is also markedly inferior to GPT-4 in generating code based on instructions.

Is that still true? I noted a significant improvement with the chat function. Especially the ability to mark sections of code for review/discussion is something that you cannot easily do with ChatGPT4.

[JaDogg]

I cannot pay even if I want to. :( There is a waitlist. Are people just using OpenAI APIs? or chatgpt+?

[just-tom]

The differences between 3.5 and 4 are substantial, at least for development (you didn't provide your use case). I'm using it everyday, all day. My IDE (cursor.sh) has a wrapper around the API. It's a game changer for me. I was able to launch my SaaS twice as fast, and the code is more reliable (I'm not a senior developer, while gpt4 gives senior solutions, most of the times)

[JaDogg]

Do you run into the limit of 50 per month? or is there a way to pay more to get more GPT-4? How exactly are you using it? (50 per 3-4 hour is the correct limit, still seem small)

[Lazare]

Paying for GPT-4 is worth it.

ChatGPT Plus is one way of doing so and works fine. There is no 50 per month limit; not idea where you got that from. The limit is 50 per 3 hours, but I've honestly never hit it.

You can also just get an API key and use it that way via a number of different tools, wrappers, and frontends. Depending on your use case, that may be better or worse.

[JaDogg]

No 50 per month limit; not idea where you got that from. The limit is 50 per 3 hours. --- ah I seem to have hallucinated that :(.

So this might actually be fine. OK

[olavgg]

Hell yes!

I currently do Java, Spring Boot and Rust development.

ChatGPT is at least 100 times better than Google Search for helping you with Hibernate/JPA stuff, especially related to eager fetching and joins of child entities with child entities with child entities. I recently struggled with an issue where ChatGPT helped me with a solution for using the ILIKE operator in PostgreSQL with Hibernate which doesn't support this operator. I implemented a workaround (https://olavgg.com/show/how-to-use-spring-boot-jpa-criteriab...)

It is crazy how fast I learn about new things that I don't know how to search for and most of the examples ChatGPT spits out do work 100%. If not, you're already 95% there and only need to apply a minor change! The power of ChatGPT makes me at least 100% more productive. I can do twice as much every day as I now have a lot less "blockers" wasting my days. This also makes programming a lot more fun :D

[JaDogg]

Are you not running into the limit for paid version? how are you working with in 50 per month limit? (Sorry 50 per 3-4 hour, human error)

[daft_pink]

I use copilot for python and I wouldn't use Chatgpt for code completion or anything but writing large portions of code or functions. I generally use copilot for code.

I use ChatGPT for writing letters and emails. It saves me tons of time. I also use it to generate quick emails and other things. I really like it and it's quick and convinient. I'm sure there are alternatives that I could run locally and I would like to avoid the restrictions that I run into every once in a while.

However, I don't think $20 a month is bad for writing letters and I prefer not to use a search engine that's trying to generate links when I'm just trying to write emails.

I generally don't use it for facts, I just tell it the facts in a few sentences and it cleans it up and generates the whole email and it's great.

I would say the nice thing about paying $20 a month is you get a reliable good service and aren't continually switching and second guessing it and they continually upgrade it and add new features.

[JaDogg]

Thanks. Here is my conclusion

- Majority of people find it useful at the price point. (only 2 disagree it seems from all the comments here)

- Instead of using chatgpt, directly using OpenAI API might make more financial sense and I might need to write a wrapper on top of their APIs (or use one that is already there)

- Limits are 50 or 40 per 3 hours. API to test that - https://chat.openai.com/public-api/conversation_limit (1 person say they have not hit the limit and there seem to be no limit, I cannot test that unfortunately)

- There is a waitlist for ChatGPT+ So I cannot pay even if I want to. :(

- Almost everyone agree GPT-4 is a lot better. (High school vs Degree level as someone has pointed out)

- There seem to be a cost dashboard with ability to set limits for API.

[jeswin]

As a developer, I'd pay $100 a month for it if they allow 32k+ contexts. At least half my code is now generated from prompts.

[gareth_untether]

Use the API and have unlimited use that you pay for.

[jstummbillig]

They have 128k contexts right now, and you do not even have to pay $100 for that.

[speedgoose]

The limit is not per month but per 3 hours.

Though they change the limit based on the current load. It has been very low in the past and I hit the limit once or twice since the availability of ChatGPT plus.

You can check the current limit in this JSON document: https://chat.openai.com/public-api/conversation_limit

You don't need to be logged in.

[3cats-in-a-coat]

This is not accurate. The JSON shows 50 per 180 minutes. I and many others are getting 40 per 180 minutes right now.

[JaDogg]

Yes you are correct. I have updated original question thank you.

[Roark66]

Well, I have signed up for copilot initially but I held out with gpt plus. I cancelled copilot pretty quickly as I wasn't really using it much, but then I signed up to chatgpt plus.

It is worth it because of better access (no more "were busy now") and Gpt4.

Also in my take, yes chatgpt is worth it if you're working as a full tech stack person and you're often asked to accomplish tasks with unknown to you, but popular software. Then instead of searching through pages and pages of crappy docs (or when such docs do not exist) you can just ask chatgpt and then just verify(because it will be wrong a lot, but you can often get it to verify it's own answers).

For example, let's say you're very familiar with Jenkins and github, but your client asks you to port their cicd pipelines to on site gitlab. Then, considering a lot of stuff for gitlab enterprise are barely documented you'll spend lots of time experimenting. Having chatgpt at hand to speed this up is very beneficial.

[flowzai]

What you get from ChatGPT Plus depends on your needs and how much value you derive from it. In addition to increased usage limits and priority access, ChatGPT Plus offers advanced customization options. Plus might be worth your money if you frequently use ChatGPT for business, education, or personal projects that require more usage than the free version allows. Also, if you value faster response times and priority support, it may be a good option for you. Think about your usage patterns and whether the additional features are worth the cost.

[rebreak]

long story short, depends on your needs. for me, after using tools like advanced data analysis and photo recognition it would be really really hard to live without especially the photo recognition since i live in a foreign country. it has become a part of my workflow in many different things and although there are other models like you've mentioned, the overall experience both on desktop and mobile isn't nearly as good as what openai provides.

[JaDogg]

My concern is it I will run into the 50 per month limit. Are you running into that?

nearly as good as what openai provides. - do you mean what they provide for corporate clients?

(50 per 3-4 hours not 50 per month, sorry about that human error)

[Loic]

For the people using VS Code, how do you "integrate" it in your workflow?

Are you using an extension (with an API key) or copy/pasting in the web chat?

[JaDogg]

I have seen some third party plugins, I'm reluctant to try

[H8crilA]

Usually no - it's often better to get API access and install a custom frontend (lots of examples on GitHub - hosted or self hosted web apps, Signal/Whatsapp/Discord integrations, command line tools, ...). You'll pay for what you use - I typically pay $5-$10 per month, and that's with some code that uses GPT from Python scripts and generates most of the cost.

[Kelteseth]

We share the account and split the cost. I have shared the account with like 10 people. Yes, you can see what other people write, but that is fine for us.

[JaDogg]

Is there some near realtime cost viewer there if you have used this already. I'm pretty sure I can hit the 50 messages per 3-4 hours limit.

[gillesjacobs]

I bought it for the first three months, cancelled because I didn't use it frequent enough. Now I resubscribed but mainly because I needed image assets and DALLE3+GPT4 is really cool way to generate il image ideas.

I do believe that it might be cheaper for many developers to pay per request using the API platform and use one of the many frontend clones with your API key.

[JaDogg]

How easy it is to cancel? can you get for 1 month then cancel and get another month later?

[1B05H1N]

If you use enough to justify the cost, right?

I ran the numbers and it saves me a few hours a week on average, so it really pays for itself. If you don't use it then it doesn't make sense.

[JaDogg]

Do you run into the limit of 50 per 3-4h? is that changed now. I see there is also a wait list to join paid version

[devjab]

This is going to be a rather Scandinavian opinion, but it's worth it when your company pays for it. With the exception, that you need to be actually capable of using it for your work without sharing trade secrets or breaking the GDPR and so on.

I'm a fairly senior developer and I use it quite a lot. I think 3.5 can do most of the things you need most of the time, but 4 and the API's help you save a lot of time. It's not really world changing in that it's still not very good at actually writing code that couldn't be auto-generated before LLM's, but it's just sooooooo much more efficient at doing all that auto-generation than what you had available before, and with the API's it integrates fairly seamlessly into many IDE's. Just remember to deny it access to any code that's actually secret. I work in the energy sector, so we actually has some of that, but 90% of what I've worked on over the decades could've frankly all been open source with not great issues. But again, it'll depend on what you do. If you're in HR, contract management or similar, you'll probably not be able to share much of what you do with it legally.

But like I started out saying, get your company to pay for your subscription if you use it for work. It's a tiny fee compared to a lot of the other money your company already spends on you.

[JaDogg]

I'm not using it for office work. I just want to use it for personal projects that I want to build.

[vbeeaz]

What exactly is scandinavian about this? I didn't get the reference.

[JCharante]

It's absolutely worth it. It's like the difference between using Notepad and a proper IDE.

[JaDogg]

Do you run into the limit of 50 per month? is that changed now. I see there is also a wait list to join paid version. (Sorry 50 per 3-4 hour, it is still small)

[xvector]

Yes, it's a generational step up from 3.5 and is actually useful in the day to day