Technically in the deen, women can wear whatever they want at home; obviously this is within reason for both males and females, i.e., don't come downstairs dressed like the Macho Man Randy Savage when your ayeeyo is trying to have breakfast
If it makes you feel better, my grandpa didn't like my shirt once. I said ok, left the room for 15 minutes, came back with the same shirt. He didn't notice and/or care.
My theory is that at that exact intersection of time-space, something about my shirt pissed him off. Perhaps your father experienced the same phenomenon? Maybe he just didn't like your trousers? If they had a floral pattern, I could understand his rationale. Go back wearing the same pants later today and report your findings - this needs further study...
P.S. The lady in the photo above has about 20 cm of torso and 3 m of legs. She must run like a gazelle.
Sincerely,
The Macho Man Randy Savage