The best thing about a large cock (or a fit body, or a good education, or good looks) is that it gives you confidence which makes you a better lover. Everything is just a mediating variable on the way to being confident; do yourself a favour and skip the middle ground. You'll find big guys on this forum who are fucking prolific; and have fucked everything. Yet there's also virgins; fit, good looking suckers with 8" cocks who can't meet a girl. The variable isn't their penises; it's their confidence.
Another thing that helps - have you ever been attracted to a girl with average breasts? Note I say
average and not small; because you're not small. Think about how little it bothered you because that's how not-bothered girls are about the size of a penis once they meet someone they like and are attracted to. Pretty much all guys hate "size queens"; I'd never respond to a personal ad that demanded I have a particular size cock.
Another angle - a bigger penis is sort of like the dragon on a heroin trip. The "ideal" is always a little further away. It's pretty well established that even guys here round up - even I'll confess that my stats are the upper bound on a particularly throbbing hardon. The guys who are 6 want to be 7; the 7s want to be 8, and even the 8s are in awe of the few 9-10 guys around. And - guess what - all those guys with 4.5-5" cocks would kill for the extra half inch you have. Just as "above average" is an important milestone, so too is "average".
If that doesn't make you feel any better then you should probably go out and meet someone