Turn it off, not on again!
OK, long time ago, they all are?
Frantic, Sunday, phone call from the south coast, "It goes live on Monday morning and it keeps crashing"
We have tried everyone else and we have tried everyone else, there is no one who can help.
It was a PABX with twin, fully redundant, hot swap, processors, they kept swapping before they could get any useful data configured. All they told me was it kept crashing.
(I am guessing you know my Sunday fix already)
They must have been desperate, I was the technical trainer and, at that date, unproven to the field engineers. Can't do it become a trainer, can’t train, become a manager.
So, as a non overtime grade I drove from Luton down to the south coast where I was witness to all those Kiss Me Quick hats wearing holiday makers, me tools in hand.
I got to site, where the errant box was, no phones on that site as there were no externa lines connected yet, and a 20 minute drive to the main site that had service and possible support. You could feel their pain.
I asked them to show me the problem, sure enough it crashed and the hot standby took over but as they had been unable, in the time it was running, to save the database, it started empty.
I watched this a couple of times, turned off the standby processor and there it sat; unhappy, sulking a bit but up and running.
Silence, and joy; then off they went programming and saving until they were happy it would do the job. Shed loads of “WTF” alarms but stable.
Proper fix came late Monday.
Me, no glory from the mangers who said I should not have gone, true but unkind. The engineers, totally my best ever buddies. Really helped me in my job as they knew I could actually “Do It”.
Not being buried in the situation as they felt they were, I was able to see the wood for the trees.
Sometimes you just get lucky.