Not that subtle
The difference between High Res and CD is audible by many people with normal hearing.
The problem is, you need a good setup for this.
You can hear the highest res audio on crap iPhone headset or even crappier more expensive Beats B.S. and you won't tell the difference from a lower res source.
Similarly if your recording sucks because you have no idea how to record, mix or master, or you are recording horrible instruments or voices, no amount of high res audio will save you.
Conversely, with a good Hi-Fi / Pro installation, calibrated and rightly set up for the audience, as well as a not too crappy room (sound-wise), and of course good recordings, I beg to differ, many people will hear the difference.