Memory prices will go down.. that doesn't bother me.
I like that I can save my game files to the PS+ cloud; and therefore it becomes much easier to use multiple memory cards however I have a 32GB with all the free PS+ content (i.e. Uncharted, Gravity Rush, Wipeout 2048, Plants vs Zombies, FF, ChronoVolt, and a few other freebies as well as two movies and about 200 MP3's and I still have about 16GB free so I really don't think I'll need to change out my memory anytime soon.
Personally I probably paid $100+ more then I would have liked to all things considered (memory cards, cases, screen protectors, etc.) but I've also gotten several months of enjoyment out of my Vita as well so I don't consider that a loss.
As I mentioned earlier though I just wish it had more in the way of apps so that I didn't have to constantly put it down and pick up my phone or tablet to check on things.