Personally I have found shorter guys to be very nimble and that makes things a bit more fun. Plus if they are very muscular they can still overpower you, if that's your thing.
I have also noticed that just unlike ages guys which tend to decrease , height tends to be increased. I am about 5'8" if that in sneakers and most guys never advertise their height as being less than that and on more than one occasion I have been taller (or at least their equal) barefoot than their advertized height of 5'9". However, size has never been a priority for me. I'm more interested in their intellect...