Gynecomastia is not as rare as some might believe. Do you know the reason for yours? Is it from excessive eating, lack of exercise or hormonal? It can be treated according to the reasoning for its existance, including in more drastic situations through breast reduction or removal surgery, Okay, enough of the medical talk--
As to how I perceive it, I don't know that I give it too much thought. On a larger man--as in overweight (or should I say weight challenged?)--it is less noticeable, unless he has developed double-Ds. This of course brings me to the next point--are your breasts large or small? Larger breasts will obviously attract more attention than the smaller ones (I suspect women may encounter this encumbrance as well). In general I have not put any thought to it, I see it happens. If they are not exceptionally large and/or are covered in a nice blanket of fur--furry chest syndrome--I am more attracted to them.
To be honest, I have only been sexual with 3 or 4 men who had this, one was in his 80s--that was probably a hormone change as he aged. One was a heavy set gentleman of about 40 years of age--years later he lost the weight and the breasts. Well, he reduced their size--there was still definitely something there. The third man was my second wife--oh please, like she's going to object to this? It would be a compliement to her (the ugly old battleaxe).-- and the other one was some man I picked up at a diner one night and I never saw him again, so I don't know the reason.
No, it has never nauseated me. I see the man, I may give it a few seconds thought, but never got bothered by it. To me each body is a fascinating and intriguing package all of its own.