Unfortunately, the outward looks are what attract people to you first. The phrase "first impressions matter" was born out of that reality. Before you speak, you were judged partially already.
Granted there are some universal standards for female beauty, judging beauty and ugliness are both subjective descriptions. . From a male perspective, the beauty of the woman relates to her sex appeal most of the time. How her body is curved and the contours it has play a huge role in a man's analysis of a woman's good looks. Occasionally, on my way to lunch and off the train, I miss a step because I am taking in all those details on a female who just walked out of a store and cut in front of me. I try not to be caught murmuring "Damn!". That would be embarrassing and signal desperation right? But there I am helpless and reacting. Can't help it when you see a flaming hot gazelle in tight jeans and a t-shirt who intentionally put her phone on her back pocket exactly to highlight her rumps.
PS: What timo Madow said about males is accurate. A guy can have average or below average facial features and yet be considered handsome by most women if he has strength and firm body. There are males who can be called Beautiful but it is not something men are comfortable with. Most males prefer healthy body and agility over soft facial features.