I think I have many more casual men friends than women, although my closest friends are women.
One of those men, a person that I truly call a friend that I respect and admire was giving a speech at a ceremony many years ago before I remarried. I began crying because it touched me so deeply, and it was so personal coming from him. After the ceremony I went and hugged him and told him I loved him and I loved his speech. He got choked up, and we hugged some more. And I thought that was that.
But less than a month later he found me in a coffee shop. I thought it was just a coincidence he was there, but he actually tracked me there and said had to talk to me. He had been thinking about what I said (I believe he said 'confessed'), and he had to tell me that he was truly sorry, but there was too much to give up to be with me.
Needless to say, I was dazed and confused, and I thought he was drunk at first. But apparently he misread my admission of love to him that evening, and he had been tossing scenarios over in his mind how we might be able to work things out. But there was no way he could do it without hurting a number of people, not the least of which was his wife and kids! And I would be hurting people as well.
I could have just agreed with him and said he was right and leave it at that, but that's not the Ellie way. Instead, I had to embarrass him and tell him that I did not mean it the way he received it. I love him as I would love a dear friend or family member.
I thought I had driven a stake through his heart, and he would slink away in a state of deep depression. Instead, he took a deep breath and said "Oh, thank god!" And we hugged again!
We're still friends, but I haven't seen him in ages.
I think this is the first time I've ever told this story to anyone, but the OP's post brought back memories, and I think I know where he might be coming from.