top | item 46824099

(no title)

FitchApps | 1 month ago

This is all wonderful and all but what happens when these tools aren't available - you lose internet connection or the agent is misconfigured or you simply ran out of credits. How would someone support their business / software / livelihood? First, the agents would take our software writing tasks then they encroach on CI/CD and release process and take over from there...

Now, imagine a scenario of a typical SWE in todays or maybe not-so-distant future: the agents build your software, you simply a gate-keeper/prompt engineer, all tests pass, you're now doing a production deployment at 12am and something happens but your agents are down. At that point, what do you do if you haven't build or even deployed the system? You're like a L1 support at this point, pretty useless and clueless when it comes to fully understanding and supporting the application .

discuss

order

esperent|1 month ago

I've had a fairly long career as a web dev. When I started, I used to be finicky about configuring my dev environment so that if the internet went down I could still do some kind of work. But over time, partly as I worked on bigger projects and partly as the industry changed, that became infeasible.

So you know what do, what I've been doing for about a decade, if the internet goes down? I stop working. And over that time I've worked in many places around the world, developing countries, tropical islands, small huts on remote mountains. And I've lost maybe a day of work because of connectivity issues. I've been deep in a rainforest during a monsoon and still had 4g connection.

If Anthropic goes down I can switch to Gemini. If I run out of credits (people use credits? I only use a monthly subscription) then I can find enough free credits around to get some basic work done. Increasingly, I could run a local model that would be good enough for some things and that'll become even better in the future. So no, I don't think these are any kind of valid arguments. Everyone relies on online services for their work these days, for banking, messaging, office work, etc. If there's some kind of catastrophe that breaks this, we're all screwed, not just the coders who rely on LLMs.

nzealand|1 month ago

> I've worked in many places around the world, developing countries, tropical islands, small huts on remote mountains

I am genuinely curious about your work lifestyle.

The freedom to travel anywhere while working sounds awesome.

The ability to work anywhere while traveling sounds less so.

Retric|1 month ago

Meanwhile I’ve lost roughly a month from internet issues. My guess is you’re experience was unusual enough you felt the need to component where most developers who where less lucky or just remember more issues didn’t.

bheadmaster|1 month ago

> people use credits? I only use a monthly subscription

Those still have limits, no? Or if there's a subscription that provides limitless access, please tell me which one it is.

Xfx7028|1 month ago

And here am I thinking that my life depends too much on the internet and the knowledge you can find on it. So if something big/extreme happens like nuclear war, major internet outage etc, I know nothing. No recipes, so basic medical stuff, like how to use antibiotics, electronics knowledge, whatever. I don't have any books with stuff like that like my parents used to. I have seen some examples of backed up Wikipedia for offline usage and local llms etc and am thinking of implementing something as a precaution for these extreme events.

lmc|1 month ago

> And over that time I've worked in many places around the world, developing countries, tropical islands, small huts on remote mountains. And I've lost maybe a day of work because of connectivity issues. I've been deep in a rainforest during a monsoon and still had 4g connection.

cries on a Bavarian train

alt187|1 month ago

Now I wonder, how has this become infeasible exactly?

zahlman|1 month ago

I consider it more or less immoral to be expected to use the Internet for anything other than retrieving information from others or voluntarily sharing information with others. The idea that a dev environment should even require finicky configuration to allow for productive work sans Internet appalls me. I should only have to connect in order to push to / pull from origin, deploy something or acquire build tools / dependencies, which should be cached locally and rarely require any kind of update.

b_t_s|1 month ago

Same thing you do if AWS goes down. Same thing we used to do back in the desktop days when the power went out. Heck one day before WFH was common we all got the afternoon off 'cause the toilets were busted and they couldn't keep 100 people in an office with no toilets. Stuff happens. And if that's really not acceptable, you invest in solutions with the understanding that you're dumping a lot of cash into inefficient solutions for rare problems.

pixl97|1 month ago

Ya, I will say the argument isn't much different than "what happens if there is no gas for your tractor".

jillesvangurp|1 month ago

Why wouldn't these tools be available suddenly? Once you answer the question, the challenge then becomes mitigating that situation rather than doing things the old way. Like having backup systems, SLAs from network and other providers, etc.

Actually, the last thing you probably want is somebody reverting back to doing things the way we did them 20 years ago and creating a big mess. Much easier to just declare an outage and deal with it properly according to some emergency plan (you do have one, right?).

CI/CD are relatively new actually. I remember doing that stuff by hand. I.e. I compiled our system on my Desktop system, created a zip file, and then me and our operations department would use an ISDN line to upload the zip file to the server and "deploy" it by unzipping it and restarting the server. That's only 23 years ago. We had a Hudson server somewhere but it had no access to our customer infrastructure. There was no cloud.

I can still do that stuff if I need to (and I sometimes do ;-) ). But I wouldn't dream of messing with a modern production setup like that. We have CI/CD for a reason. What if CI/CD were to break? I'd fix it rather than adding to the problem by panicking and doing things manually.

reycharles|1 month ago

> Why wouldn't these tools be available suddenly?

Take a look at how ridiculously much money is invested in these tools and the companies behind them. Those investments expect a return somehow.

i_am_proteus|1 month ago

I am not convinced of the wonderfulness, because the study implies that AI does not improve task completion time but does reduce programmer's comprehension when using a new library.

DesaiAshu|1 month ago

On device models (deepseek-coder, etc) are very good // better than the old way of using stack overflow on the internet. I have been quite productive on long haul flights without internet!

You're an engineer, your goal is to figure stuff out using the best tools in front of you

Humans are resilient, they reliably perform (and throw great parties) in all sorts of chaotic conditions. Perhaps the thing that separates us most from AI is our ability to bring out our best selves when baseline conditions worsen

Gallows4574|1 month ago

I know this gets asked all the time, but what is your preferred workflow when using local models? I was pretty deep into it early on, with Tabby and Continue.dev, but once I started using Claude Code with Opus it was hard to go back. I do the same as you, and still use them on flights and whatnot, but I think my implementation could be improved.

Bnjoroge|1 month ago

on-device models are still a tier or two below most frontier models(really opus 4.5).

dham|1 month ago

The tools are going to ~zero (~ 5 years). The open source LLM's are here. No one can put them back or take them down. No internet, no problem. I don't see a long term future in frontier llm companies.

Sevii|1 month ago

What I don't get is, how are these free LLMs getting funded? Who is paying $20-100 million to create an open weights LLM? Long term why would they keep doing it?

direwolf20|1 month ago

Do you mean the open binary LLMs, or did you find the secret training data and the random seed for LLaMa?

light_hue_1|1 month ago

This is the argument that people used to fight against rich customized IDEs like emacs for decades. What if you need to ssh into a machine that only has baseline vi in an emergency?

I'll happily optimize my life for 99.999% of the time.

If the Internet is down for a long time, I've got bigger problems anyway. Like finding food.

1718627440|1 month ago

> If the Internet is down for a long time, I've got bigger problems anyway.

I don't know about you, but I don't connect to the internet most of the time, and it makes more productive, not less.

t_mahmood|1 month ago

Yeah! I use JetBrains AI assistant sometimes, which suddenly showing only blank window, nothing else. So, not getting anything out of it. But I can see my credits are being spent!

IF I was totally dependent on it, I would be in trouble. Fortunately I am not.

raw_anon_1111|1 month ago

What good would being able to “build my software” without internet access unless I’m building software for a disconnected desktop? Exactly what am I going to do with it? How am I going to get to my servers?

zahlman|1 month ago

> unless I’m building software for a disconnected desktop?

... Why wouldn't you build software that works there?

As I understand things, the purpose of computers is to run software.

But more importantly, let's suppose your software does require an Internet connection to function.

Why should that imply a requirement for your development environment to have one?

Why should that imply a requirement for a code generation tool to have one?

akomtu|1 month ago

Or your business gets flagged by an automated system for dubious reasons with no way to appeal. It's the old story of big tech: they pretend to be on your side first, but their motives are nefarious.

darkhorse222|1 month ago

People used to and still say the same thing about GPS. As these systems mature they stay up and become incorporated into our workflows. The implication in the case of GPS was that navigating on your own is not a very critical task anymore. Correspondingly the implication here is that software design and feature design are more important than coding or technical implementation. Similar to Google, it's more important that you know how and what to ask for rather than be able to generate it yourself.

RA_Fisher|1 month ago

That reminds me of when teachers would say: what if you're without a calculator? And yet we all have smartphones in our pockets today with calculators.

palmotea|1 month ago

> That reminds me of when teachers would say: what if you're without a calculator? And yet we all have smartphones in our pockets today with calculators.

Your teachers had the right goal, but a bad argument. Learning arithmetic isn't just about being able to do a calculation. It's about getting your brain comfortable with math. If you always have to pull out a goddamn calculator, you'll be extremely limited.

Trust me, elementary-age me was dumb to not listen to those teachers and to become so calculator-dependent.

fatherwavelet|1 month ago

Certain subjects we treat as if one has to learn woodworking before taking violin lessons.

We just really underestimate sentimentality in our society because it doesn't fit our self conception.

davidmurdoch|1 month ago

Having a deep intuition about what the calculator is doing is the skill we were actually being taught. Teachers don't know always understand why things are being taught.

1718627440|1 month ago

And yet calculating your shopping expenses to prevent getting screwed by buggy vending machines, or quickly making rough estimations at your work, is as useful as ever. Tell me how you can learn calculus and group theory, when you skipped primary school math.

Kiboneu|1 month ago

It’s like with most programmers today having forgotten assembly. If their compiler breaks, what are they going to do?!

(I jest a bit, actually agree since turning assembly->compiled code is a tighter problem space than requirements in natural language->code)

ambicapter|1 month ago

What a grossly disingenuous comparison.

wodenokoto|1 month ago

The stack overflow era wasn’t that long ago and none of us could write a library call without consulting online sources.

You are at least a decade late to post fears about developers reliance on the internet. It was complete well before the LLM era

1718627440|1 month ago

> none of us could write a library call without consulting online sources.

I use SO quite often, but it is for questions I would otherwise consult other people, because I can't figure it out short of reverse-engineering something. For actual documentation man pages and info documents are pretty awesome. Honestly I dread leaving the world of libraries shipped with my OS vendor, because the quality of documentation drops fast.

wizzwizz4|1 month ago

I rely on the internet just as much as the rest of you. When that goes down, I crack out man pages, and the local copy of the documentation I can build from source code comments, and (after a 5-minute delay while I figure out how to do that) I'm back to programming. I'm probably half as quick, but I'm also learning more (speeding me up when the internet does come back on), so overall it's not actually time lost.

bigbuppo|1 month ago

Well, you're supposed to pay for the Platinum Pro Gold Deluxe package which includes priority support with an SLA so that six months down the road you get a one month credit for the outage that destroyed your business.

seanmcdirmid|1 month ago

I invested in a beefy laptop that can run Qwen Coder locally and it works pretty good. I really think local models are the future, you don’t have to worry about credits or internet access so much.

jimmaswell|1 month ago

What are the specs, and how does it compare to Copilot or GPT Codex?

cyanydeez|1 month ago

I think you laid out why so much mobey is being pressed into this: its digital crack and if they can addict enough businesses, they have subscription moats. Oraclification.

empath75|1 month ago

> - you lose internet connection or the agent is misconfigured or you simply ran out of credits.

What happens when github goes down. You shrug and take a long lunch.

newsoftheday|1 month ago

When GitHub goes down? I keep working, that's the point of a distributed version control system.

psyclobe|1 month ago

It’s kinda scary actually. After getting used to ai doing all the work, doing it yourself again is like using a toilet without a bidet.

blub|1 month ago

Losing connectivity is a non-issue because it will come back soon enough absent some global event. The realistic risks are rather:

* all services are run at a loss and they increase price to the point the corp doesn’t want to pay for everyone any more.

* it turns out that our chats are used for corporate espionage and the corps get spooked and cut access

* some dispute between EU and US happens and they cut our access.

The solution’s having EU and local models.

bathwaterpizza|29 days ago

Buy a Mac and run a local model that's likely good enough

giancarlostoro|1 month ago

> This is all wonderful and all but what happens when these tools aren't available - you lose internet connection or the agent is misconfigured or you simply ran out of credits. How would someone support their business / software / livelihood?

This is why I suggest developers use the free time they gain back writing documentation for their software (preferably in your own words not just AI slop), reading official docs, sharpening your sword, learning design patterns more thoroughly. The more you know about the code / how to code, the more you can guide the model to pick a better route for a solution.

FitchApps|1 month ago

I'm seeing things that are seriously alarming though. Claude can now write better documentation and document things 95% there (we're building a set of MCP tools and API end-points for a large enterprise..) - Claude is already either writing code or fixing bugs or suggesting fixes. We have a PM, who has access to both React and API projects, on our team who saw one of the services return 500; they used Claude to pinpoint the bug to exact database call and suggest a fix. So now, it's quite common for PMs to not only post bugs but also "suggested fixes" from the agents. In a not so distant future, developers here will be simply redundant since PM can just use Claude to code and support the entire app. Right now, they still rely on us for support and deployments but that could go away too.

luxcem|1 month ago

At some point it will get treated like infrastructure, what a typical SWE is doing when cloudfare is broken or AWS is down.

newsoftheday|1 month ago

At most places I've worked, we can still get things done when AWS/GCP/Azure/OCI are down. For my own selfhosted work, I'm more self-reliant. But I'm aware there are some companies who do 100% of their work within AWS/GCP/Azure/OCI and are probably 100% down when they go down. That's a consequence of how they decided to architect their apps, services and infrastructure.

direwolf20|1 month ago

How would you answer the same question about water or electricity?

Your pizza restaurant is all wonderful and all but what happens when the continual supply of power to the freezer breaks? How will you run your restaurant then?

greenie_beans|1 month ago

> This is all wonderful and all but what happens when these tools aren't available - you lose internet connection or the agent is misconfigured or you simply ran out of credits.

i would work on the hundreds of non-coding tasks that i need to do. or just not work?

what do you do when github actions goes down?

LtWorf|1 month ago

Don't rely solely on github actions?