Surely?
If people start mining hundreds of tons (or thousands even) of space rock and bringing them to earth that will affect the earths orbit around the sun (Increase earth mass, increase gravitational effect on the sun, drag earth into firey furnace)
how much space gold would that take?