The guys who ran The Pirate Bay had some interesting ideas on how to "safely" run things on hosted computers.

IIRC they only hardware under their direct control was a front-facing routing/load-balancing system that routed all traffic through VPN connections. Then they'd host different aspects of the website's software stack (database, web server, etc...) using different providers, also routing all that traffic through VPN and the router/load balancer.

The idea was to "blend in" as much as possible so the hosting providers don't know they're hosing part of TPB. Which is made easier by all the traffic being encrypted by and routed through the VPN. And if they did get caught/shut down by one provider, all they had to do was update a file on the router/load balancer to point it to a replacement host using a different provider.

Then for that routing/load balancing bit they had multiple hot backups in various parts of the world that were set up to auto-switchover if the primary went down.