Re: A production server? I raise you a datacentre!
Switch/router backups are frequently overlooked. I like Oxidized, but RANCID does the same sort of config management.
Set it up once, add/test new devices, and then forget about them until there's a crisis.
(wanders off to confirm mine's running as expected)