Post by leafo in [Update: added karma sort] Updated submissions page, report broken games, submission randomizer, comment linkbacks

GMTK Game Jam 2019 » Community

Viewing post in [Update: added karma sort] Updated submissions page, report broken games, submission randomizer, comment linkbacks

One last update before the rating period is over. I added a Karma sort. This one is inspired by Ludum Dare, where it's sorted by ratings_given - ratings_recieved. What this means is that people who have rated a lot, but not received many ratings are bubbled to the top. I'm actually going to tweak this formula a bit to give precedence to those who need ratings more, but I figured I should get it out quick since many people were asking for it. Enjoy.

As a reminder, after the rating period is over, the final results will be delayed for about an hour as we process the votes. Thanks

leafoAdmin5 years ago (3 edits)

Experimenting with a different formula, slightly different ordering but should give preference to those who are more in need of ratings, and prevent super-raters from getting too much karma (diminishing returns).

Formula is:

karma = ln(1 + ratings_given) - log5(1 + ratings_received)

If you have ideas for other formulas tell me and I'll try them out.

Edit: I also personally think that a karma system like this is flawed. I wrote about why, and my proposed solution here: https://itch.io/t/527869/karma-system-for-the-game-jams#post-895699

I added the karma sorting option as an experiment, something to try out and see how it works.

Yahia Zakaria5 years ago

How about making a weighted karma system? The new Karma system looks only at how many games a participant rated so they can rate all the popular games to gain karma and ignore ones that actually needs ratings. I think we can weight the karma so that a rater gains more points if the game they rated had a low number of rates at the time of rating. Therefore, the participant will be incentivized to not only rate others but also rate the games that need rates.

Johnny Dalvi5 years ago

I think that this is a good system, just need some tweaking over time but it has been proven to work on LD.
Perhaps a good idea to prevent this kind of abuse is to give karma just to whom comments on the game, giving feedback (and only once per game for each user). Thanks for adding it btw