I remember in old movies the men calling their wives Mother, Mum, or Ma, and the women calling their husbands Pappy, PA, Father, etc. I also remember some old books where calling a man Dad was akin to calling him a dweeb.
I don't do it unprompted. It would never even cross my mind. My pet names for men are based on their personalities, inside jokes, or are typical signs of affection, like Baby, Honey, and the like. I guess the closest I get is Mister, which I only use as a greeting. A few men have referred to themselves as Daddy, and I have obliged them by following suit. It doesn't bother me, but I wouldn't choose that name for them on my own. The word has no association for me. I think I may have called my father Dad two or three times. I mostly just awaited eye contact and spoke only when I had his undivided attention. Generally, if I absolutely had to call him something, I called him by our last name, like everyone else.
If a dude called me Mommy, it would make me very uncomfortable.