DEV Community

Cover image for JS13k Meta Postmortem
Joao L.
Joao L.

Posted on

JS13k Meta Postmortem

The results for this year's JS13k game jam are out. I was blessed with 20th place with my game Regresso. But this post isn't about my game. Today I want to talk about the competition itself, namely about the voting system. If you haven't checked this year's list, do it now!

TOC:


The judging

JS13K is a competition that gathers developers from different backgrounds and skill levels. Sure, senior game developers always have an edge in this competition, but the limit of 13 kilobytes per game really forces you to be creative and helps level out the battlefield a little bit.

In the past year, the competition counted on an army of judges that played some of the games and then casted their votes. I trust the organizers to have picked great experts but in the past 2 years I always felt like that just wasn't enough. From the reviews I got in the last two years, it seemed to come down to luck whether the few judges of your game enjoyed it or not. But game reviewing is far from being an objective science.

Solving analysis paralysis

This year, though, they tried something different. All participants were invited to vote for all other games. The way they did this was with a series of 1vs1 battles. The more people voted, the more accurate the results. As long as enough people vote, of course.

Alt Text

I found this to be a great idea. When you look at a list of 240 games, it may look daunting to vote for all of them. The name of this problem is Analysis Paralysis. But if you are presented with only 2 games, picking the best one is basically trivial.

From what I could gather from my twitter feed, people almost had as much fun playing the "voting game" as they did playing the games themselves. The introduction of a vote-o-meter also helped reinforce the gamification of voting.

Alt Text

Digging through the vote API

You can't give developers an API and expect them not to poke around. I didn't want to poke too much - just enough to mine all data into an easily digestible JSON. There are things missing the the frontend of the voting website which I very curious to know.

First, I wanted a list of all my 128 comments. I have published them here.

Second, I believe there is room for some sort of "Honor Board". Since all voters were able to vote for 6 different categories - innovation, fun, theme, gameplay, graphics, and technical - I was very curious to know if it would be possible to make a top 5 for each category!

So without further ado, here's the Honor Board for JS13K 2019. Note: as a tie breaker, I used the sum of the points from all categories.

Honor Board

Top 5 Innovative games

"Push Back", 53 points
"Retrohaunt", 52 points
"xx142-b2.exe", 47 points​
​"Entangled", 47 points
"nano-wirebot", 46 points

Runner ups: "Wolf and Sheep", "Watch your Back"

Top 5 Fun games

"Retrohaunt", 51 points
"oh, flip!", 50 points
"The Martians are Back!", 50 points
"Dwarfs: There and Back Again", 49 points
"SenTetrox", 49 points

Runner ups: "Back attacker", "racer"

Top 5 Theme

"xx142-b2.exe", 48 points​
"Back Attacker", 48 points​
"Turtleback", 48 points​
"Watch Your Back!", 48 points​
"Palindrome", 47 points

Runner ups: "Back 2 Back", "Back to Game"

Top 5 Gameplay

"[SWAGSHOT]", 50 points​
"The Wandering Wraith", 49 points​
"Back Attacker", 49 points​
"Dwarfs: There and Back Again", 49 points​
"Triangle: Back To Home", 49 points

Runner ups: "racer", "Bounce Back"

Top 5 Graphics

"The Wandering Wraith", 52 points​
"[SWAGSHOT]", 52 points​
"xx142-b2.exe", 51 points​
"Bounce Back", 51 points​
"Backcountry", 50 points

"Runner ups: "Slipstream 13k", "Get Back Up"

Top 5 Technical

"VOIDCALL", 52 points
​"xx142-b2.exe", 51 points
​"Yet Another Doom Clone", 51 points
​"Push Back", 50 points
​"Backcountry", 50 points

Runner ups: "Librecraft", "[SWAGSHOT]"

Top engaging voters

Last, but not least, I wanted to sincerely thank all developers who took the time to comment on the games they voted. It's really helpful. I hope I wasn't too harsh on my own comments and I really hope that anyone who found my comments were unfair feels comfortable to discuss it with me over twitter.

Here's the top 20 most engaging voters:

"arturaugusto", 183 comments
"lopis", 128 comments
"yeonjuan", 123 comments
"baturinsky", 115 comments
"salvan13", 113 comments
"vik-13", 111 comments
"picosonic", 100 comments
"carlini", 95 comments
"tyler6699", 91 comments
"KeithKarnage", 90 comments
"alexandercurtis", 85 comments
"miwamiwa", 84 comments
"64Mega", 78 comments
"Siorki", 68 comments
"Hambo3", 67 comments
"wololoa", 64 comments
"Vertfromage", 62 comments
"johnedvard", 61 comments
"Schnark", 61 comments
"BenjaminWFox", 52 comments
"randytayler", 52 comments

Closing notes

I think there is still room to improve on this voting system, as I am sure the organizers are aware. Nerds always love to have more stats and the voting app could help provide them quite easily.

One front where the system could be improved is to provide a bit more in terms of instructions. I'm not sure if the voting categories were purposely vague, but e.g. "theme" could mean that the theme of the game was interesting, or that the game adequately follows the theme of the competition.

I also think there could be more categories. There was no way to vote for games with good background music or sound effects (other than the generic "technical"). Also, if web monetization is enabled in the games, it should be possible to vote for the game that best implemented that feature.

For nerds

Data dump from the voting API

Script for getting the top lists

Oldest comments (1)

Collapse
 
salvan13 profile image
Antonio Salvati 🦊

Nice to see those statistics! Thanks!