I'm a lifelong JRPG fan who's played just about every 16 and 32 bit RPG there is. Massive fan of anything Square, can tell you just about anything about the first 12 Final Fantasy games, etc. I've even beaten some really obscure shit like Paladin's Quest. But one series I never played was SMT.
First off, the only way to play almost all of the games in English is fan translations, and I tend to shy away from that sort of thing because they're often crappy. So if there are any really good translations out there, that'd help.
Second, they had a reputation for being grindy. I can handle a certain amount of grinding. Dragon Quest games are about where my limit is. I like DQ for the most part, but I don't like walking back and forth just outside of town, mindlessly mashing "A" for hours, and most of them devolve into just that around the halfway mark. I haven't played anything newer than 5 though, so that may have changed over time. Basically, if SMT is any less grindy than the early DQ games, I'm good to go.
Third, I don't really know where to start. I've got forty years of content to sift through. Do I play the DDS games? Do they hold up? I'd be playing the SNES remakes, almost certainly. How about the side games like Nine and If?
Oh, and for what it's worth, I didn't like Persona 4 at all. The level design was insanely bland (nothing but identical hallways) and the battles were too easy. But I've heard P4 is the least SMT-like of the Persona games, so that might not be a problem.
More recent entries in Persona focus on the social sim aspect and the story along with dungeon crawling all with equal focus. Smt on the other hand, focuses pirmarily on dungeon crawling with much less story. Thats not to say smt has no story but story in smt games often takes a back seat for long stretches of time in favor of the gameplay aspect whereas persona games tend to have very long story sequences in between gameplay that ties things together. Another thing is thst often smt games have stories that are more open ended than persona games, with an alignment system (law vs chaos basically) that often changes the final stretches of the game and the endings based on your choice, with no real right or wrong, everything is morally grey. Persona games stories are more involved but they are also more set in stone where you dont have as mich player freedom to change how things play out.
As for the difficulty, smt is known for having the kind of difficulty where you are always one bad turn away from a party wipe if you arent paying attention, even in regular encounters. However most of that can be dealt with as you learn the mechanics. Instead, the main difficulty in smt games come from bosses, where you will frequently get walled by a boss until you figure the mechanics of how the boss works and how to deal with the boss's crap. Its not a level thing so much as figuring out a strategy that works on the boss.