erm I think it should be established that people are cultural.. some probably more so than others, and that culture seems to be heavily engrained in their minds and has more impact on their actions rather than their religion (Islam)
When Islam says lower your gaze, it means when a member of the opposite sex is looking as you in a sexual sense etc, not for simply walking down the street.. that is a cultural thing..
And as for Muslim men.. mdoesty is of course encouraged, and men have to definitely be covered from naval to knee, men have to lower their gaze too - it isn't all about the woman