I think this question is too up for subjective interpretation by what you actually mean by “crossfitters” and “bodybuilders”.
While the consensus here seems to be that crossfitters are very fit normal men who take pride in their fitness, this is not a universal standpoint.
CrossFit (to me at least) has quite a lot of negative connotations. CrossFit (as I view it) is filled with a lot of over-enthusiastic yet insufficiently-skilled amateurs, whereas bodybuilding is, to me far more accessible and relatable.
A lot of people have this image that bodybuilding is filled with roided, cartoonishly huge freaks. And while I won’t say that stereotype exists without a grain of truth in some spheres, I will say that it’s generally a much simplified view of only the negative connotations of extreme bodybuilding cherry-picked away from the positive aspects of it.
To me bodybuilders have a much more aesthetically pleasing and defined muscular physique - whereas to me, crossfitters could be any Tom, Dick or Harry who just self-declares themself to be fit or lead (even if they aren’t).
I guess, even though I am neither a crossfitter or a bodybuilder, I have always tended to attend gyms at the heavier-lifting or bodybuilding end of the spectrum.
And I actually find that even bodybuilders are come in all personalities, from the approachable, friendly, affable, funny, dedicated, intelligent, sophisticated, business-oriented...etc
The same of course could be said of crossfitters, but it seems even gay men have an unjustified negative view of bodybuilders.
Sexual preference for one body type over the other is fine, but when it comes from underlying assumptions that are largely baseless snap judgments, then it should be examined more introspectively.