I'd say anything over 7 is large, and average does fit in the 5-6 zone. I don't belong in either, I'm somewhere near 7, but just no there. I'm okay with being a bit above average.
But we seriously need to take girth into consideration. That, sadly, isn't a good word for me.