Details of the Cloudflare outage on July 2, 2019  

written by John Graham-Cumming. added over 1 year ago by @icyflame ARCHIVES

cloudflare incident post-mortem response sre regex regular-expressions    

This particular change was to be deployed in “simulate” mode where real customer traffic passes through the rule but nothing is blocked. We use that mode to test the effectiveness of a rule and measure its false positive and false negative rate. But even in the simulate mode the rules actually need to execute and in this case the rule contained a regular expression that consumed excessive CPU.

Cutouts is an open source application. Code licensed under the MIT license. Copyright 2018 Siddharth Kannan