Hm, going to such a place would be the last thing in my mind actually. 'Tis the sort of place that can be 'reproduced' elsewhere in the world, like foreign food. A lot of other activities, open spaces and experiences would come first without a doubt.
But, if something happened to all of us together and then people decided, out of the blue, to go to such a place, I wouldn't, because I don't have any curiosity with such places, neither here, nor in Japan. However, from what I gather from my friends, they wouldn't mind going with a bi/gay friend and, if it was the bi/gay one's idea, several of them would do it to humor said friend, to be honest, as not to have that experience alone, for companionship, not exactly because they'd be really excited to go.
Anyway, if you would heed an advice or two, because we don't know you at all: avoid staring. Specially those that know about your sexuality, because they would be the ones 'on the lookout' about your behaviour. But without knowing any of them either, that might be neither here nor there. Maybe they simply don't care? Really, just avoid staring or getting hard. I think these are the basic things to avoid to be on the safe side.