"pay PAYE, Pensions, sick pay, holiday pay, and paternity pay"
Companies cannot avoid the law, even small companies with single employees. Yes, certain rules are amended for Director/Employee, but the appropriate laws still apply. All "benefits" and "rights" must still be met by the Contractor's company, that's why the day rate is higher, to cover the cost of those provisions.