Man, I remember my OG Ceramic White PSP. When I unpacked it and picked it up for the first time I was really amazed at the thing's build quality.
Anyways make sure you get a memory stick. I was also a huge fan of the screen protector, hand strap (not a charm) and the carry case. If you can still find it the Logitech hard form case was amazing and you can print out your own designs for it.
As far as games go? Cor, there are a lot of them. If you get nothing else, pick up Lumines. The game was designed specifically for the PSP and the game play feels absolutely natural on it. I sunk lots of time into MegaMan powered up, Maverick Hunter X, Monster Hunter Freedom (although 2 and 2g were infinitely better), Gurumin, Chains of Olympus, Killzone:Liberation, War of the Lions, Portable Ops, and Loco Roco. Disgaea was good for a while but that game really is a grindfest. Holy Invasion of Privacy, Badman! was pretty damn good as well. Steambot battle arena was good (mostly because I love that series).
I never did play Patapon though I heard good things about it and it's sequel. LocoRoco 2 looks good but I never played it. Same with Dissidia, Kingdom Hearts, Little Big Planet.
Upcoming? Badman 2, Patchwork Heros, Prinny 2 (very hard game), Zettai Hero (unannounced for US but AWESOME), Classic Dungeon (same deal here), and ModNation racers all look really cool. Peace Walker looks like it's going to be mindblowingly good and a true 'must play' for the PSP.