Spook is just another random word that became a black slur in history, apparently because their skin blending into the night either makes them look like ghosts or makes it easier to sneak up and "spook" you.

Fittingly, literally no one uses it whatsoever. Even most of the so called racists, because it doesn't get the same reaction likely due to the fact people weren't taught to react emotionally to hearing it.