No problem, make it like a giant jukebox and just store all the LPs in the evacuated area and use robotics to change or flip records.
Also the platter needs to be heavy, the most heavy elements are a bit radioactive with really short half lives so are probably not suitable, osmium is the heaviest stable element but it is a bit reactive, iridium and platinum are almost as heavy and osmium/iridium/platinum alloy is pretty unreactive.
Now we should be approaching the $2m mark