Part of me wonders what the world would look like if they didn't invade their neighbors and galvanize the world into war against them.

Yeah. How would the Nazis have failed internally, if they'd not been forced into collapse due to foreign factors? It's a question we'll never have a proper answer to, but worth asking. Here's another one: what would happen to the Third Reich after the power vacuum of Hitler dying? Interesting moot questions.