Some men smell absolutely fucking amazing, really intoxicating no matter what state of cleanliness they are in or how much fragrance they do or do not have on, and some men smell utterly repellent. I have been known to find myself more attracted to a man with an delicious odour than his more handsome friend and conversely I have been known to find strikingly handsome men completely revolting because of their (to me at least) overpoweringly awful funk.
As someone with a very sensitive nose I know what people mean when they say "funk" or "Musk" but what I smell is much more subtle and unique than that, underneath the more pungent smells of dampness, sweat and civet and other "musk" indicators, I can smell the foods a man eats, the things he cleans himself with (even if he hasn't cleaned himself in a while), what state of health he's in, how hormonal he is, if he had sex recently, other aspects of cleanliness like how fresh his sheets are at home, the places he's been recently, and a host of other things some of which I couldn't even name or describe.
So yes sometimes I do love a specific man's specific smell, regardless of how clean he is and sometimes I can't stand a man's smell no matter how clean he is. I can't say I love all men's smells though regardless of how clean or dirty they are.