It would be the latter. (even though horrible cultural norms are still practiced by the upper castes)

Developing a caste system is the natural reaction to living among barbarians when you have nowhere to go and can't kill them. The diversity melting pot stew multicultural society is a completely modern invention that is proven not to work and would already be on the way out if not being forced by certain elites that see everyone else as the same species of cattle.