FYI most people are not ugly or below average (those are in the margins). A lot are between average or decent/attractive. So this false binary makes little sense.
That is too simplistic. When you say 'get almost any woman' what are you referring to exactly? Better odds in the lust department? How about relationship stability and longevity? Even the highly attractive are not 'everyone's type' and may not actually meet the cut in terms of favourable traits (kindness, intellect, stability, fidelity, religiosity, agreeableness and responsibility). People do not just have singular attributes they are some combination of desirable and undesirable ones (and its up to you to figure out what you can and cannot deal with). Trust me even a good looking man can get old rather quickly.