A lot of good advice already mentioned so I'll just chime in on 2 things.
1. To get over the "pretty" comment, grow some facial hair, keep a short haircut, and offset your "pretty" face by lifting/bulking, wearing more masculine clothes (solid color polos, rugbys, subtle vertical striped...