My husband and I wear similar shirt sizes, so we definitely share those - and things like ties, socks, etc. We have the same waist size, but he can't really wear my pants cuz I'm about 4 inches shorter, though I can wear his if I cuff them.
We don't typically share underwear, but it's not unheard-of for us in laundry-day situations.