I was brought up to associate Indian word "Caste" as referring to colour of skin. Higher castes had lighter skin. Lower castes had darker skin. Skin colour is deep inside the Indian thought processes.
Meaning of higher and lower being social rankings.