I once took out a live, Tier 1 Telco system
I did it with an SQL query. I’d been doing lots of fairly long (to run) queries without issue, and forgot busy Hour was actually going to be busy, that day (customer had just migrated a load of their subscribers but still, we weren’t expecting it to be so busy). The whole situation went like this:
1. Loyal AC starts the query running.
2. And pops out to the local Chinese chippy, for some chips and curry.
3. And arrives back to find the company’s directors (all four of the trilogy) in the server room at 5:30PM.
Turns out one of our processes wasn’t resilient to a rather important table being locked too long.
AC - that one doesn’t go my CV.
-