You're lucky if you can find a person who loves you, but is open-mined enough not to be jealous if you have sex with someone else. We're both in this situation - both of us are very highly sexed, and need sex with other people from time to time. Our previous marriages came to an end because our former partners didn't have the same attitude to sex. My lovely wife R isn't "just interested in having sex and that's that" but doesn't see why she should deny herself sex with others, male and female, if the opportunity arises. This is exactly my attitude too. Sex is one of the great pleasures of life, why restrict your opportunities and pleasure?
We swing together but are perfectly OK with the other having one-on-one casual hetero and same-sex enjoyment, as long as we don't keep it a secret.