Re: The Hot Shot Database Team
Turned out the latency killed it
I remember going on a (rare) on-site visit with a user of our software. Watching them operate it, there was one bit of processing where they copied everything to the local drive, ran the processing, then copied it back to the network. Intrigued, I asked why. They said that on the network drive, the processing took half an hour instead of a few seconds.
We'd not seen this but I did spot one thing: they were on token ring and we were on ethernet. Getting back to the office, I investigated and found that one of my colleagues had decided that the best way to write a bunch of binary data to disk was looping through the buffer writing one byte at a time - instead of just one write operation for the whole thing. The effect on ethernet wasn't really noticeable but on token ring, well it had to wait for a token for each byte. 30 second fix once found. The guy who wrote that had a particular talent for coding obscure bugs, hiding a stupid decision behind many layers.