This is something I've been thinking a lot about with regards to the popular games these days that aren't F2P and I often poke at open world stuff to see what makes them tick. Take away the large scale world and what do you have aside from that? An extremely basic third person controller, a bunch of weapons they probably spent five seconds doing and then a soft body physics simulation for vehicles and vehicle damage.
They seem to spend most of their time spamming art assets all over the places to make the game seem bigger than it really is but if you actually try to 'game' in it you quickly realise that there's fuck all to do and they've put tons of empty space between the game. Seems like people who enjoy these games are the types who are easily distracted by all the shiny stuff and don't really care much about the gameplay of which there is very little.
It's so bad now that when I look at any modern game I check for whether it's linear or not and make sure there's no designing mechanics in there. The reason being is chances are if it's linear the developer probably spent more time with the level design and making it fun than simply scattering assets about the place and overcompensating with procedural generation.
Definitely a factor - for games that need one. Doom Eternal, in my opinion, is an example of where an expanded universe, lore and story actually detracted from the game. Some would argue that the increased mechanical complexity did as well, with many favouring the simpler Doom 2016.
I think, as a designer, you're ultimately crafting an experience. It needs to be cohesive and it needs to be compelling. Anything that doesn't add to that need not apply.
I'd argue the opposite for Doom Eternal in that I loved the fact they made the 'Doom Slayer' the original Doomguy and he's been fucking hell up with no lube for centuries that all the Demons screaming at you is them having PTSD seeing you!
The mechanics were hit and miss as some traversal puzzles were annoying while the combat was improved with the 'slaughtering enemies provides EVERYTHING you need' mechanic.
Trying to think of a bad example, I'd say probably Last of Us 2 as from appearance it played the same as the original that everyone enjoyed but the story threw everyone out of it that it ruined the experience. The 'no one wants to play as Abby' comes to mind.
Each to their own. I also liked the characterisation of the Doom Guy, but that's where my appreciation of the lore/story ended. The need to expand the universe and add gravity/grandiosity is ultimately what moved the game away from being what it was good at. As a result, it went from being a short and sharp corridor shooter to including a hub, replete with upgrades and other bullshit, and a bunch of uninspired and oversized "modern" levels to sell the premise.
Definitely agree on TLoU though. Tranny killed the beloved protagonist, and with it the franchise. Didn't help turning the second most liked character into a bulldyke who wouldn't tolerate bigot sandwiches in a world of starvation, either.