What if your crime is, much like Novaxx, simply "being unvaccinated? Or "having the wrong politics" or "not being supportive enough of the regime" or "being transphobic"..?

Then the problem is that law, not this one. If Australians start being prosecuted for not supporting Money's cult of groomers, foreigners being deported is the least of our problems.

The hypocrisy of all this was made very apparent when they ruled that "Aboriginals" can't be deported, even if they were literally born overseas...

"They" did not rule that, a judge did. The judge =/= the senators passing a law to overrule them.