Cloudflare went offline this morning, probably waking up a number of ops teams,

Cloudflare went offline this morning, probably waking up a number of ops teams, including our own. Here’s their PM: http://blog.cloudflare.com/todays-outage-post-mortem-82515

I would suggest “test first on one DC, then deploy across the board”.

“staged deployment.” It’s not just for software.

The video is nice: http://www.youtube.com/watch?v=wMRaKtydILI&feature=youtu.be

Flowspec accepted the rule and relayed it to our edge network. What should have happened is that no packet should have matched that rule because no packet was actually that large. What happened instead is that the routers encountered the rule and then proceeded to consume all their RAM until they crashed

1 Like