In my personal opinion, I think a guy as hairy as you would look better if you at least trimmed it back a bit. But the only opinions that really should matter are yours and your sex partner. What do YOU prefer?
And as always, it's just hair. Your preference can always change to suit your mood. It comes off easy and grows back fast.