My 4 year old is so mean to me, and I'm his mom!?

This is my second child, he's 4 and this has been going on since he was weaned. I try and try to play, hang out, and whatever else but still he does not like me it seems-helI I even try to give him treats and he's still downright mean to me. He's mean to his sister too, but loves her, says he loves me-I'm sure he does, but is also mean to other little girls alot of the time. His dad isn't a jerk, he tries to explain that he can't behave this way over and over. I'm not mean, I'm attentive and try to give him all I've got-I'm not overbearing-I let him do his own thing you know, but this has just gone too far!! He absolutely adores his dad and other men pretty much all across the board. We're a progressive family, equal rights and all that is really important to us, no cheauvanism here from us. What gives?