They would've loved to remove them, but the simple reason is that the Franks didn't have enough resources. After the Umayyad were turned back at Tours, they had a couple of holdouts in southern France. It took a few years for Charles Martell and his son to fully drive them out.

But the Umayyad were smashed at Tours and their leader was killed. They weren't a mortal threat to Western Europe after that.

They would've loved to remove them, but the simple reason is that the Franks didn't have enough resources. After the Umayyad were turned back at Tours, they held onto a couple of holdouts in southern France. It took a few years for Charles Martell and his son to fully drive them out.

But the Umayyad were smashed at Tours and their leader was killed. They weren't a mortal threat to Western Europe after that.