Yes occasionally. I will with my wife when she is on the phone with me. I also like to when she heads off into the shower in the morning. She will get up, take her clothes off in front of the bed and not even know how much she is turning me on.
One time, back in the day, I was with a former lover and she was on top of me when the phone rang. The room mate yelled at me from beyond the closed bedroom door it was for me. So here I am having a calm business conversation with someone while my GF was trying to make me squeal by contracting her vaginal muscles and moving up and down on me. I think I came in less than ten seconds when the call was done.
And as far as right or wrong, who is to say. Right or wrong is what we, ourselves make of it. You go and do what you want, when you want.