Infinite space does not imply infinite matter.
You can spread out the matter you've got until the cows come home, but you can still only squish what you've got in to some finite amount of neutron stars. Even if you keep pulling them apart and squishing them back together, as you say, you're on the clock against the heat death of the universe.
At least, that is my understanding.
Still, I'd like to keep such massively dense matter away from my head, lest it gets squashed.