Haha, no need to step down. If you have a nice car, people will rate you high and you will move up.
And as for the ones, the system is developed in a way where it weighs out "far out" votes like that using a logarithmic algorithm. Basically if you have mostly 8's through 10's and you get a few 1's or 2's, it will weigh the 8s, 9s, and 10s heavier than the 1's and 2's. This is apparent by you getting a couple of low ratings, but still remaining number 3 in the rankings.