That heightism is a thing.
While i don't have a problem with my height and i asume women wouldn't have a problem with it after they get to know you, but you're on a instantaneous disadvantage as a short dude (i a 5'7" for example) when it comes to first impression.
I can totally get a girl much taller than me thinking it would be somewhat awkward and so would probably i, but now i am talking about girls my height or even shorter