While they did take out the UMD, this info from IGN sounds like games will not be download only:
"NGP will use a new game medium, a small flash memory based card, dedicated for NGP software titles. The cards will store full game titles and add-on game content or save data. Sony notes that...