Always was an issue even when I was younger. Nowadays, as I get closer to the half century mark, it's even more so because the feeling just isn't there. I used to use lambskin condoms back in the day and they were much better because they weren't tight like the latex ones are and they felt way more natural. But they really only help prevent pregnancy and aren't much help against STD's, so I think we're stuck with what we have.
BTW, incorporating the putting on part into sex play & foreplay does help. If my partner will kiss me real good and give my nips some attention while we're putting on the condom, we can usually keep it going. Depending on the day, though, actual sex with it on can either be sort of lame because the feeling is lost, or can be great because I last forever.
Enjoy the moment is the best you can do.