People only felt the need to justify slavery once public opinion was already turning against it. Throughout history, while racialist ideas were pervasive, people went about slavery all the time without linking it to race. They didn't need racial justification because slavery needed no justification. For a long time, there were no abolitionists.