Pieter, from what I've seen, most women don't openly tell guys to their faces that they are hot or good looking. They most likely say it to each other or when the guy is around. Which means they are probably saying you're attractive, just not when you around. No one wants to be embarrassed by commenting on someone and not getting any attention back, so most people don't take the chance. I've always been amazed when I run into people who I haven't talk to in a while or people I know find me online and confess that they found me attractive but never said anything before. I'm like, why not??? LOL
You're a good looking guy as the others have stated but what women and men really like is confidence, not arrogance, but confidence. Have a great personality and make people feel comfortable around you. If you like someone, find a way to express that and take your chances. Great rewards are all about taking great risks. Don't let your ego get caught up with whether someone finds you attractive or not. I guarantee, no matter who you are on earth--some people will find you attractive and some will not. That's a fact. So accept and put in a little effort to focus on the people who find you attractive--the ones who don't, just aren't the ones for you.