Between 16:04:05 and 18:35:39 on March 15th donors received an error instead of being sent to our payment partners to pay their donations. This was due to an error in code we deployed and was compounded by a missing alert when the specific error was triggered.
At 18:35 we rolled back the bad deploy and added the missing alert to our monitoring system.