Unrated Users have Rating 0 for Performance Calculations about carrot HOT 1 CLOSED

First, sorry for the incredible latency here.

...unrated users count as having rating 0 instead of the default rating of 1400.

This is not too surprising. It is a part of the whole fake rating problem (#18 for details).

One possible fix would be to also use default rating if the rating is zero. There may be some false positives who actually have rating zero but they should be negligible, as there currently is no active user who has that rating. I tested this and it seems more accurate than before.

Note that this change does not help with users with fake ratings other than 0. Neither can I think of some other easy way to detect them. So prediction will remain inaccurate with such cases in the data.

So this is a not a complete fix, but I agree that this sounds like an improvement overall.

from carrot.