Carlite65 is right, about 95% of the time. Think of how you want the current to flow: you always want it to flow from the female to the male across the connector. Ford screwed up in a few places: the fuel sending unit line on the main harness is a good example. It is male for most years coming from the main underdash harness to the tailight harness. Current actually flows from the dash gauge to the sending unit. Sometimes, though, Ford had to change this polarity paradigm to ensure the multi-pin connector could only be put together one way.
So...from the speaker itself, the plug should be male; from the radio, the plug should be female.