An alternate Why?
Bearing in mind that UNIX/Linux and X11 has always been network capable, I have to ask Why? but from a different perspective.
Configure your humongous server as a single Linux machine (or a small number of large machines). Put a thin deployment Linux distro on the desktop machines, running XDMCP or a modern alternative. Configure for the X11 sound extensions on the thin clients. Manage the single system for multiple users.
You have multiple thin clients with no user local storage and a single system image on the large server to maintain. And none of the Citrix infrastructure or costs.
I know I'm playing devil's advocate here, but this is the tradditional way of managing shared UNIX systems.