Re: "... the number of incidents dropped dramatically."
There's an alternative scenario that could bring about the same outcome. If the out-of-hours incentives were dropped there'd out-of-hours reports might get ignored until normal hours. The users would then learn to wait before reporting the issue.
The correct incentive structure, of course, is one that primarily measures and rewards fire prevention rather than fire fighting.