Def recommend a Go. I love mine. Got it from Amazon after trading in some really old GBA games to make the price a little more easier to take the plunge.
Sure, I still have an older PSP and some UMDs... honestly? I haven't played anything from my UMD library since having my Go.