I understand what you think you want, but if it goes wrong, where does it leave you? No one wants to be forced to do anything that they don't want to do. If you really feel compelled to see him, go to the gym or go swimming, but use caution, if you want to continue being friends - even if you currently aren't that close.