Well, to be fair, when men see it as an insult to be addressed with words associated with women... or when society in general considers "feminine" words and expressions to be insults... that is absolutely an insult to women. It ultimately comes down to the fact that the feminine is devalued in society, and by extension anyone associated with femininity — female, male, or otherwise — is deemed inferior. In this sense, feminism wants to see things improve for everyone. Men included.
But apart from my general "this is why we need feminism" take... ;) ... yes, I agree that sometimes the "problem" a given person sees actually exists more in their personal biases than in any objective, external truth. In the case of this song, some people saw "misogyny." As I see it, the misogyny was in themselves — not in the song.
Thanks for sharing your thoughts, Michael!