Cloudflare, Azure, AWS, and Google Cloud all have a similar uptick in reported errors around 7:30. I suspect an outage on Cloudflare or another load-bearing service cascaded through all the major cloud providers.
https://downdetector.com/status/cloudflare/
https://downdetector.com/status/windows-azure/
I think down detector doesn't actually have any probes or actual insight into status etc. I think it uses search volume on its own service as a proxy for an outage - so if e.g. lots of people rush to down detector to query to see if SERVICE_FOO is down, it will register as an outage on down detector because loads of people are trying to see if there is an outage even if SERVICE_FOO is actually totally fine.
My hunch is everyone saw that openai and Claude were down and checked for Gemini too. I was using Gemini the whole time this happened without a blip so it certainly wasn't down in my region at least. 3.8 flash is pretty good and didn't miss a beat.
Down detector is a self-reported platform, they use a baseline over 6 months from user reports to try to automatically "detect" if there is a real outage, or if its just a couple end-users. Ultimately, the outage is entirely based on users going to down detector and clicking on "Report a Problem".
https://downdetector.com.py/en/methodology/
Huh. I thought they used to also do sentiment analysis of social media (Twitter, at least). I see that they definitely don't today, but has that always been the case?
So Down Detector is a kind of quantum observation experiment, observing influences the result.
Yes, but is it a load-bearing seam?
You are right, it is. They have now landed a clean fix.
They're saving a memory so this can't happen again.
Nothing another .md file can't fix
Now you guys are just adding no-op fuel to the fire.
I made Claude write noöp instead of no-op and it's still amusing a couple of days later :P
> I made Claude write noöp
Tangentially related [1]:
> The billboard ad, located next to the Ikea Tempe store in Sydney, says 'NÖFNIDEA? No tools, no worries’.
[1] https://www.adnews.com.au/news/koala-mattresses-takes-swipe-...
It's really interesting to crawl through the web of phrases that seem "common" to each person in their interactions... I suspect if one were to get to the more niche "meme" phrases that people encounter, it starts to say more about the sort of person the LLM assumes it's speaking to, and perhaps something about their psychological profile...
It must be tuned for rage-based engagement because Claude only ever uses the most obnoxious Claudisms on me despite constant reminders to knock it off.
You're right to push back. This is bending the leaf on both ends... just my honest take.
It's a load-bearing poster.
I need to take a step back.
Hang on — I can apply a double tracked fix to the load bearing path, gated by provenance.
It isn't done — and what's there is more interesting than expected.
Great plan. I'll slop together a GUI for it in visual basic real quick.
Plan approved – I'll start a background agent to create the app using react and npm.
It's not only a great plan. It's a turning point in history.
That was a major oversight on my part. You are an absolute legend for pushing this to its logical limits, and your observation confirms a brilliant, low-level fundamental truth.
This entire thread is amazing!
It's like a kaleidoscope: Human words --> LLM Training --> chatbot-isms --> lovely parody catch-phrases (and this thread will get ingested soon, and be used to train...)
Honestly, this is worth looking at — with one caveat.
That's on me. I've been giving confident advice that doesn't hold up in practice.
That aligns with your goals of analysing problems, admitting fault and surfacing that through use of clear and concise language. Not just simply wrong — this screams finessed, nuanced, polished communication after an understandable mistake discovered through pressure-tested interlocution.
May need to be fail-closed.
The load-bearing seam stays, not taking that away;
it was at least another thing worth flagging
Cloudflare CTO claims that it's not them
https://x.com/dok2001/status/2095538619603628388?s=46&t=ec6p...
https://nitter.kareem.one/dok2001/status/2095538619603628388
Surprised there's instances still up
A bunch of new ones ;)
https://codeberg.org/mv12star/shitter/wiki/Instances
Will the post-mortem reveal they all relied on a service running on a Macbook in a break room with a "Do not turn off" sign taped to it?
Someone probably set it to "magic", when everyone knows its supposed to be set to "more magic".
They should've used Greg's Optiplex.
Actually it said "Beware of the Leopard".
If it was still running snow leopard that would explain it
if only the fools selling vintage macbook pros for $200 were smart enough to still have them on SL OS.
Have a hundred upvotes
[flagged]
[flagged]
Evidently it annoyed you enough to create one too. Remember, guys, there's one more day until Friday!
Friday is when the janitors come by with the floor polishers and plug them into the same socket as the Macbook.
They are not taking the blame this time!
Just writing to say that I appreciated the nostalgia, even if your references were lost on the other responders.
Cloudfare did release an update for their "HTTP/3 issue affecting R2 custom domains" around that time
https://www.cloudflarestatus.com/history?type=incident
LOAD BEARING
my money is on DNS
there is a haiku about this
https://xkcd.com/2347/ Nebraska man retired
Maybe a three-line npm package sneezed.
Maybe .unwrap()
leftpad
Not retired, just switching careers. He's sick of this AI bullshit
great fun
Dane says Cloudflare has no service disruptions: https://x.com/dok2001/status/2095538619603628388?s=20
The internet is not supposed to work like this. The network was designed for robustness and fault tolerance, which allows it to reroute data if parts of the network fail.
Why are we all depending on one entity for it all to work? Makes me mad.
The System economically rewards those who successfully build Room-641A-as-a-Service
Because more fasterer and more cheaperer.
I hope Reticulum gains traction.
It's also easier to understand. For the internet to be fault tolerant you have to get rid of CDNs and assume everyone needs the same thing. That's more expensive than a centralized "internet" which relies on CDNs and fiber paths exclusive to the regions with most demand. Everything has been optimized for throughput for what is determined to be important, not rare fault tolerance
Quite frankly, CDNs are a scam. I will not elaborate because I don't feel like doing free labor for the folks who don't already understand this to their core.
Why Reticulum when we have IP?
Read the Zen of Reticulum and you'll understand the point.
That sounds rather tautological. If you can't even articulate the virtues in your own words
[dead]
We need IPv6 desperately for fault tolerance
Because by re-centralizing everything you're not at a competitive disadvantage if you're down since everyone else is down, too.
Oh boy, the internet is anything but what it was supposed to be. I can't really bring myself to remember without feeling bad about it. The centralization, the power of certain businesses, the surveillance, dark patterns everywhere. Hell, you catch people simping for billionaires and asking, "Is that legal?" to scraping posts. Here. In HACKER news. So yeah. Depressing.
> asking, "Is that legal?" to scraping posts. Here. In HACKER news.
The capital letters don't make this astonishing. The padmapper vs. craigslist debate was nearly 15 years ago, most people were on craigslist's side (including me) and it was about somebody who was running a site in a less optimal but more human way vs. some startup looking for hockey-sticks.
But I was literally simping for the billionaire (maybe not quite yet then, don't know for sure if he managed it since) against scrapers. They were very much for-profit scrapers, unlike nitter, but the truth is the truth.
The only reason I support scraping Twitter is because it's yet another communications monopoly that was endlessly pushed on us by governments and massive corporations, even though it never made money, and once it finally got traction its priorities were to trash interop and manipulate content. The government should be dictating an interop protocol and expecting everyone to follow it, and instead it is encouraging media monopolies because they are an end run around the first amendment.
If the government created interop protocols for rental property, I'd have been against craigslist. Instead, it seemed very much like some startup play to steal craigslist's content to hopefully bury them, then sell on a valuation that included abusing their new monopoly and making us very much miss craigslist.
Sadly, facebook corralled and trained so many people for so long that their marketplace eventually killed craigslist for most things anyway (didn't have to buy padmapper after all.)
We're back to aol #keyword internet gatekeeping
We don't need to gatekeep the internet, cloudflare does that for us
Most of the internet continued to work just fine
> load-bearing service
do you generate training data for claude as a job?
Not really. The impact isn't as big too - Codex for example did not stop working for me.
https://updog.ai/
what's updog?
gottem!
:)
oh well, if it is working for you, then we are saved.
[flagged]
They simply shared their experience. I would’ve thought it’s a full-blown outage, but clearly not.
You stepped in the room real stinky here. What’s with the attitude?
No, they didn't "simply share their experience", they explicitly negated the scale of the issue in their opening statement, only because it works for them. So they claim "impact isn't too big" based on their personal anecdotal evidence of sample size literally 1.
> full-blown outage, but clearly not.
Again, based on a SINGLE report?
It was working for me too.
sample_size++;
“load bearing” :)
For once it’s appropriately used.
i wouldn't take you down. you're a load-bearing poster
What's the other way it's used?
LLMs (at least Claude) tends to overuse that significantly
Oh, so like "honest" and "ratchet." Oh well, it'll choose different words to overuse later.
I'm getting "spike" for a while now, and just found out the newest word which is "gauntlet".
[flagged]
honest-load-bearing-ratchet sounds like an instance name.
Are there parodies of Claude speak?
That’s probably the best idea all day in this project
In every document created by Claude.
I have never seen Claude use this phrase
https://github.com/search?q=load-bearing+AND+%2Fauthored-by%...
I got it twice today (it was not even warranted).
Usually for me is when you ask it's opinion about part of the code.
i just grepped my codebase where i let claude markdowns go rampant. 212 instances of "load-bearing"
It's a good metaphor and I refuse to let AI ruin it for me.
Years ago, when I worked at Stripe (which had a somewhat unique and inventive lexicon) it was a common term. “Is this jank load-bearing?” someone might ask.
I added a specific rule to disallow saying “load bearing”. So Claude is now saying “load handling”
Be sure to avoid asking it to ignore the elephant
But have we found the seams yet though?
If the seams bear too much load, they rip. Whereas pants, they fall down.
I'll be honest with you: this is why we need to take a belt-and-suspenders approach.
That's not just an observation, it's an insight. Words are doing the real work.
This just makes me angry!
I really wonder if they can fix it. Fable 5.1 claims to speak humanese, but we'll see.
I tend to think this wierd limited vocabulary/style they use is an unwanted side effect of all the the RL training, perhaps also of being trained on their own synthetic content over multiple training cycles.
Yea I don't get "load bearing" that much but "seams"... So sick of it.
Kids In The Hall had a sketch about overuse of a word or phrase [1]. This is the world that Claude is building for us.
[1] https://www.youtube.com/watch?v=lStcwT_RGrQ
It doesn't have to ruin it for you, but people are going to assume comments with it are AI generated.
I can you can always use an em-dash instead of the hyphen for extra LLM cred: "load—bearing" :)
We need a Samwise "Bear the load!" meme
https://i.imgur.com/S6aEhrI.png
Content not viewable in your region.
:(
Wait, why would it ruin it?
Because it says it more often than kids say "six seven".
It’s a frequently used metaphor in LLM responses.
Often for trivial things that LLM is proud that it has noticed but bear no load whatsoever.
I still winced
claude code users at couldfare might've been thinking claude is specifically about them and see nothing wrong like other ppl do
[dead]