When we introduced the Top Players leaderboard a while back, the intention was to create a place that tracked each player’s average score and then ranked everyone based on that average score. Some folks have noticed that in the past 24 hours, this leaderboard just changed significantly, and stopped stagnating. Why?
Because, we realized that our computation of Average Score was naïve and wrong. So, we fixed it. Since we launched it, we’ve only been counting full games (for completeness, we define a “full game” as any game that you’ve played in for longer than 1:50). But, when we computed your average score, we did so by taking every complete game you’ve EVER played and doing the math. The problem with this, as observed by Puzzlex28, is that it doesn’t take “improvement over time” into consideration. For example, here’s an aggregated stats chart of one of our best players:
The black line demonstrates the average score over time, and also, the player’s trend. With our old averaging system, all of the early games were still holding down the newer, improved later games. With our new system, we are sampling a much smaller window of scores, so it much more accurately tells you where you stand in average score.
This change has brought a lot of dynamicism to the Top Players leaderboard (which was the original intent), and demonstrates who is consistently clocking in the highest scores over time.
Hope this helps explain what’s going on!
– Black Snapper