Yes, sex is harder when you are very thick and you have to do generous foreplay to get inside and stroke away. Not a bad thing, and there will be some that just wont do it. That said, my chance are pretty much close as the next guy in finding the right person.
In HS there were jerks that made fun of my cock, and I didn't like the locker room all that much because of jealousy? or pettiness?
Job wise I think there is more of an issue, and some public places. Many years ago when leotard was the in thing for workout pants, and a friend in the business wanted to give one to me as a gift so I wore it in the gym, I have been told to not wear it again as my bulge was distracting to the members. When I waited on tables I had a lesbian telling me that she wasn't interested in me, because she could see that I was too happy to see her. I wasn't told by what she meant by that, until I was inform later that I was walking around with a hard on. Overall I think it did help in my tips, because I was a lousy waiter. I didn't walk around with a hard on, as I am 5.5 inch around thick soft.
There have been many instance like that where the women felt uncomfortable with my bulge, and in work places I tend to keep my distance from women in general for job security. It's not so much that I have a big one, but that its thick and short and tend to bulge more noticebly then if I had a longer skinny one. I am reminded tho of the time where my best friend who an african american from Detroit where I had lived would get strange comment from stupid girls asking about his cock size just because of his color. That was about 25 years ago, so I think things have change a little bit for the better. But I also think people do tend to get a little preocupied about whats in the pants and make things a little more of a headache to deal with. A little bit jealous, maybe? Would I want to trade it for a smaller one? I don't know because I could have a totally different experience if I had a different body. I am deaf as well so that another whole set of issues. I could also play that same game if only I had perfect hearing.