It's noted in the Old Testament that the tribes that Israel spared, despite God explicitly telling them to wipe them out entirely, stuck around as subversive elements that led to Israel repeatedly falling into sin and getting conquered. Again, often by said remains of the tribes they were told to remove.