I'll admit to finding your claim surprising, since the term has its origin as a description of a certain kind of church office. And defamatory? It's a traditional term for a non-job and carries a hint of disapproval, but that's not really defamation.