We've had problems with this in the past. Some people aren't good sports about it. However the way the system is setup, it uses a logorithmic forumula to calculate rankings, so if you have a bunch of high votes, and very few low votes, the high votes are going to count more than the low votes. Like if you have a single 1, it won't hurt you very much. I personally have a few 1's as well, but just don't let it get to you.