Cloudflare outage affecting numerous sites on Monday AM [Update: fixed]
Sarah Perez
@sarahintampa
/
11 hours
Cloudflare, a company providing performance and security to websites, is having network problems of its own this morning — and taking down a lot of its customers’ sites and apps in the process. Affected companies include podcast app Overcast, chat service Discord, managed hosting provider WP Engine, eCommerce hosting provider Sonassi, public web front-end CDN service CDNJS, and many others — including the sites that rely on the web hosting or who partner with Cloudflare for their CDN service.
According to Cloudflare, it identified a possible route leak that’s impacting some of the Cloudflare IP ranges, and its working now to resolve the issue.
Hi Jakub, you can follow our status page as we investigate this issue here: https://t.co/bogkL6UXjM ^Si
— Cloudflare Help (@CloudflareHelp) June 24, 2019
Sorry, the servers are having issues this morning due to problems at my CDN, @CloudflareHelp.
The bad news is that there’s nothing I can really do about it.
The good news is that there’s nothing I can really do about it. 🏖
(seriously, they have good people there, it’ll be OK)
— Overcast (@OvercastFM) June 24, 2019
The problems were first identified around 7:02 AM EST, says Cloudflare, and the problem was identified shortly thereafter.
Its status page has been providing continual updates.
The company said at 8:34 AM EST, “this leak is impacting many internet services including Cloudflare. We are continuing to work with the network provider that created this route leak to remove it.”
Well. @Cloudflare is a bit broken right now… pic.twitter.com/4SS2lt4Jf2
— Dan Faulknor (@DanFaulknor) June 24, 2019
Update: The company at 12:42 AM UTC / 8:42 AM EST says the issue is resolved:
The network responsible for the route leak has now fixed the issue. We are seeing improvement and are continuing to monitor this before we consider this issue resolved.
Update 2: Cloudflare statement —
Earlier today, a widespread BGP routing leak affected a number of Internet services and a portion of traffic to Cloudflare. All of Cloudflare’s systems continued to run normally, but traffic wasn’t getting to us for a portion of our domains. At this point, the network outage has been fixed and traffic levels are returning to normal.
BGP acts as the backbone of the Internet, routing traffic through Internet transit providers and then to services like Cloudflare. There are more than 700k routes across the Internet. By nature, route leaks are localized and can be caused by error or through malicious intent. We’ve written extensively about BGP and how we’ve adopted RPKI to help further secure it.
Update 3 – Cloudflare CEO Matthew Prince threw shade on those to blame for this, via a tweet:
The teams at @verizon and @noction should be incredibly embarrassed at their failings this morning which impacted @Cloudflare and other large chunks of the Internet. It’s absurd BGP is so fragile. It’s more absurd Verizon would blindly accept routes without basic filters.
— Matthew Prince 🌥 (@eastdakota) June 24, 2019
