Has man evolved past testosterone influenced tendencies?

Being a male that is smaller than his peers, I have always felt like I need to defend myself against those that think they can pick on me just because I'm smaller. Altohugh most don't want to admit it, I believe that man hasn't evolved past testosterone influenced tendencies regarding individual size and stature.