I say it to my friends all the time and they don't mind it. It's kinda like how guys call each other "man", "ninyahow". It's caadi.
Waryaahe is gender neutral, it's not exclusive to guys only.
Men who call women naaya have no manners. That's a fact.
When a man calls you naaya, women usually interpret it as "naag-yahay", basically, "you woman". It sounds demeaning and sexist, hence why they get angry. It's not rocket science, really.
It's caadi when women say it to each other because women aren't inherently sexist to each other.

Wa kaas dee.
Yes! A lot of reer waqooyi men call women naaya but they're usually lowclass/reer miyi/unmannered people.

Men from respectable families avoid saying it.
My hooyo and ayeeyos sometimes call/called me "naa Cawooy" but that's it.
My aabo & awoowo have never ever called me "naayaa"
Habos, eedos: Not anymore. Only when I was a kiddo.
Adeeros, abtiyaal: Nope.
Siblings: Kuma dhacaan.