Why Friday Production Deployments?
9 points| miguellima | 1 year ago
I cannot understand the logic behind it.
Why not a Monday, where all company is available to intervene if required?
9 points| miguellima | 1 year ago
I cannot understand the logic behind it.
Why not a Monday, where all company is available to intervene if required?
coffeeman6|1 year ago
If there is an outage on Friday night or Saturday it doesn't affect feature work M-F. Company gets free labour.
Less cynial: continuous deployment agile scrummaster culture says you can deploy anytime so choosing a risky time is OK (risk of missing out on poisoning yourself with alcohol on a Friday night).
This is because (ignoring any reality) deployments should never fail or introduce regressions. Agile gods said so! Friday is a flex for agileness.
PrivateButts|1 year ago
Also, Monday releases usually suck as well. We shoot for Tuesday launches, since Mondays are usually when people are catching up on busy work, or most often out sick. Besides, it gives everyone a chance to review their launch obligations, do final pre-launch checks, and an opportunity to make a go/no go call during work hours, if you shoot for morning launches.
miguellima|1 year ago
Phlebsy|1 year ago
Releases? Sure, you want those to happen early in the week so that you can monitor the rollout and how users interact with it. Deployments? Ideally, deployments change absolutely nothing about the performance characteristics of the system until a feature flag is enabled. There is some cruft in that and it requires cleaning up after yourselves, but when used right it's no different from standing up a new deployable that nobody interacts with yet as far as risk goes.
All in all, if you have a healthy CI/CD setup, use risk mitigating strategies such as feature flags/automated rollbacks, good monitoring/alerting on performance and SLOs, and you're not introducing something like 200+ novel lines of code to an existing workload running in production then I don't see the point in waiting to deploy.
Maybe I'm just too much of a fan of finding things that hurt and making them hurt as much as possible so that we are incentivized to improve them though. If something goes wrong on a deployment/release on Friday, it would go wrong on Monday too. Find what was broken about your process that let it slip through and fix that.
aynyc|1 year ago
miguellima|1 year ago
tacostakohashi|1 year ago
We work on writing code M-F, 9-5, when managers and customers are around so we collaborate and troubleshoot together then and stuff, fine.
We need to deploy, rollback, do checkouts, etc. _after hours_ so it doesn't affect the business. Sometimes it's deploy on Friday night... then some problem is found first thing Monday morning of Sunday night (from Asia Monday users) that requires "urgent" attention, so you end up with both a late start and an early finish to the weekend.
Deploying software is a standard, predictable, part of the job/business hours, so it should really be done during regular hours, or otherwise hire some dedicated "second shift" people to do it after hours / during their _normal_, agreed hours. I don't mind being flexible / "going the extra mile" sometimes... but when it is most weekends, it's a big ask, it's basically working 1.5 jobs for 1 salary.
In practice, usually some staff member who wants to "go the extra mile" will volunteer for this thankless task as a way to get noticed... but instead they end up getting burnt out and jaded, and then quit and find the next sucker to saddle with it.
everforward|1 year ago
I just pointed out that it was effectively slashing my compensation per effort, during times I especially didn’t want to work. I proposed either comp time, or bonuses amounting to overtime on our “hourly rate” (salary divided by work hours in the year).
My manager opted for comp time, because he could do that without needing to involve HR and all the pay related people. Apparently no one had ever bothered to ask about it, and had just been working nights and weekends for free.
nevon|1 year ago
Now, obviously there's always _some_ level of risk, but for the vast majority of changes I have no problem deploying no matter what day it is, and I have yet to pay for it with my weekend for the past decade.
ipaddr|1 year ago
comprev|1 year ago
miguellima|1 year ago
dyingkneepad|1 year ago
jf22|1 year ago
dolleik|1 year ago
pestatije|1 year ago
coffeeman6|1 year ago
But not getting your tickets cleared M-F because of outage is war!