Never! A penis is only a part of a person.
Height, hair color or the lack of hair, penis size and ball size are never in the equation. Some of the best sex I have ever had was with a 104 lb, 4'10" tall, bald, but hairy guy, with an erect dick of about 3" in length and maybe 3" in girth. He had tiny, high riding balls, in a tight and hairy ball sack.
He knew how to make love and to make the person he was with feel like a King and the most important person on earth. This happened during the time that I was separated from my wife and was lonely and unhappy. He had been a friend since childhood and he came to my rescue. I will forever be grateful to him for helping me to understand that life could be better and that it would be if I just let it. We are still good friends, and when I see him (yes, and his wife) about every 2 years, I remember and wish I could relive that time we had together. But, I know it never will happen.