Single point of multiple failures.
I was a member of the ops team in a large multi site organisation. The primary site had redundant data links to the other sites. Two shiny new high capacity links provided by a large telco famous for many, many other things too....
I was called in one day to check the cross site links. They were all down. Famous telco swore blind their network was fine, just not getting data from us.
So it must be a problem at our end ;-( We're up, the links are up, just not getting a response from them on either line.
The two independent links left our site, by two different routes, and disappeared into the famous telco's network. Both went into the same famous telco's building, in the same room....
Turned out it wasn't a problem at our end ;-)
Biting the hand that feeds IT
