Some router near a construction site had dust settle into the gap between the laser and the fiber, and it attenuated the signal enough to see 40-50% packet loss.
We figured out where the loss was and had our NOC email the relevant transit provider. A day later we got an email back from the tech they dispatched with the story.
But it's usually DHCP that sets the wrong DNS servers.
It's funny that some folks claim DNS outage is a legitimate issue in systems whose both ends they control. I get it; reimplementing functionality is rarely a good sign, but since you already know your own addresses in the first place, you should also have an internal mechanism for sharing them.
p_l|1 year ago
jcgrillo|1 year ago
[1] https://www.ibiblio.org/harris/500milemail.html
sophacles|1 year ago
Some router near a construction site had dust settle into the gap between the laser and the fiber, and it attenuated the signal enough to see 40-50% packet loss.
We figured out where the loss was and had our NOC email the relevant transit provider. A day later we got an email back from the tech they dispatched with the story.
jeffrallen|1 year ago
skunkworker|1 year ago
marcosdumay|1 year ago
Really complex systems (the Web) also fail because of caching.
Sohcahtoa82|1 year ago
anilakar|1 year ago
It's funny that some folks claim DNS outage is a legitimate issue in systems whose both ends they control. I get it; reimplementing functionality is rarely a good sign, but since you already know your own addresses in the first place, you should also have an internal mechanism for sharing them.
rickydroll|1 year ago
drivers99|1 year ago
DEADMINCE|1 year ago