You've heard correctly. Jump right in - there's no direct plot connections to previous games.
I own P4G on vita and the steelbook P5. Never played either. Bought them as I loved JRPGs for decades, heard the highest praise for the games. What holds me back is reading how daunting and long they are. Which also concerns me having me think there's a high learning curve.