Also ban hoverboards, and e-scooters.
I once heard drones as being referred to by the government as "new technology". Its not new technology, just existing technology put together to form a slightly different version of the age old radio controlled device. Its just marketing.
Back before quadcopters were a thing I remember stabilised radio controlled helicopters being the big toy for xmas. I got a few, some were able to fly happily outdoors. Not once did they trigger a news item regarding how dangerous they were to planes etc.
Maybe its because these quadcopters have cameras and video links. Well, perhaps just ban those types, to the general public at least. No camera = user forced to fly while looking at the craft and there being no point i getting close to a plane. If you need a camera on the drone I suggest such models are regulated and restricted in the same way certain fireworks are simply not accessible to the public, through legal means.