What’s Wrong with the IGF

UPDATE: We’ve posted a public statement about this post here.

Hello there.

Way back in December we posted an update saying that we would post “about our terrible IGF experience.” Granted, we may have exaggerated a few things back then. (read: a lot of things!) But with the IGF finals at GDC coming up, there is no better time than the present to relate our experience.

First, some backstory: We are an independent developer producing an iPhone game named Kale In Dinoland:

This year the IGF decided to use TestFlight for its iPhone games. We paid the $100 customary to the festival, as over 500 other developers did for their games. Going in, we didn’t expect to get nominated for anything. The game was content-complete but wasn’t done to the level of polish we wanted. Not to mention, there were still bugs. But this isn’t about the overall quality of our build, it’s about giving every game its fair shake.

Let me explain. When the IGF chose TestFlight for iOS distribution, they made a big mistake. We were given a list of all of our judges’ email addresses, revealing their identities. We aren’t going to release those names to respect the judges, but let’s just say we had a heavy-hitter.  For every judge, we could see how much they played; if they even started the game at all. How do we know this?

TestFlight records NSLogs (iPhone version of console logging) and custom “checkpoints,” uploading this data seamlessly for us to see. In addition, when a judge opened the TestFlight invitation email, downloaded and then installed the game on their iDevice, we can see all of that. I believe that the IGF organizers, who are usually lips-sealed on the judging process, did not know about this functionality. We can see exactly when a judge installed the game, when they started playing, how long they played, and how far they got. 

As you can imagine, this was an opportunity for us to see what really goes on behind closed doors at the IGF. How much do games really get played? Does hype count for everything? Is it true that to be a contender in the current IGF, your game has to already be widely known in indie circles? Does this mean that most of the judges won’t end up playing your game in these circumstances regardless of the quality of the title?

Here are the statistics:

Eight (8) judges were assigned to Kale In Dinoland. Of those judges, 1 didn’t install the game or respond to any of our invitations (which we had to send multiple times before judges joined). 3 judges didn’t play the game. Of the remaining 5 judges that played the game, 3 played it very close to the IGF deadline, which was December 5th. One judge, our outlier, played the game for 53.2 minutes. Excluding the outlier, on average each judge – including the 3 that didn’t play it – played the game for almost 5 minutes’ time. Back in that build, Kale’s intro cutscene took about a minute’s time. So we’re talking almost 4 minutes for each judge of actual game time.

Granted, they could have deduced the game was absolutely terrible and didn’t deserve their time. About this time, though, we were also running a beta that was being played by anonymous iOS gamers from the community. These helpful gamers were all interested in the game, having seen it on TouchArcade and IndieGames.com. What is the influence of prior marketing? The average play time for these external beta testers was 34 minutes, accounting for that one minute of cutscene time.

So, a large group of anonymous gamers who were not required to play the game averaged about 30 minutes more play time than the the 7 judges who were required to play the game, 3 of whom did not even play the game. Is 4 minutes enough time for someone to give a fair assessment of a 2-hour-long game? How many more games were given similar treatment? Had we not taken initiative and sent multiple emails urging judges to download the game via TestFlight, how many judges would have ended up playing the game? Here’s the last email I sent out, urging the judges to accept the TF invite:

The build has been up for a while now (I sent emails via TF), but only 1 judge has installed, and 4 other judges still haven’t even signed up for TestFlight.

The sad truth is, the heads of the IGF know about all of this. They made the mistake of using TestFlight and allowing us, the developers, to see backstage. Shortly after posting the update that included negative remarks about the IGF – on this relatively unknown blog – we were mysteriously followed on Twitter by @brandonnn and received an email from none other than Simon Carless.

Hey folks,

It’s just been brought to my attention that you believe that you’ve had some issues with your IGF experience and are preparing to blog about it. My name’s Simon Carless and I head up the GDC events, including the IGF – and I’m CC-ing Brandon Boyer, the IGF chairman here.

Before you go ahead and do that, could we have a phonecall discussing your perception of what happened during judging and your impressions of what didn’t run correctly from your perspective? We _do_ actually care about individual entrants such as yourselves, and it upsets us when people don’t feel like we’re doing a good job. So let’s talk about it directly!

Myself and Brandon are available at a few times on Monday – I’m in U.S. pacific time and he’s on U.S. central time. Do you have time for a call?

Thanks,

Simon Carless

EVP, UBM TechWeb Game Network

We considered calling. At the very least, we decided not to post what we would have, and gave it some second thought. Let’s be honest: It is obvious that Brandon Boyer and friends care about the IGF as the prime outlet for indie games. We don’t doubt that. But this isn’t about handling the situation silently. If we had called and talked about our concerns, the heads of the IGF don’t have to be held accountable for a broken judging system. It’s about transparency, which is something the IGF completely lacks.

So there it is, our story about the IGF. We hope that, as a community, we can change the IGF for the better by exposing flaws in the judging system and holding those in power accountable. But until then, please hold off on marking the IGF as the be-all end-all of indie games. Instead, join protests like the IGF Pirate Kart. And if you’re still not convinced there’s something wrong with the IGF judging system, hear it from a judge herself.

Bastion, and why I can’t look past its ending

I bought and played Bastion the night it came out, having followed Supergiant Games ever since January, when I found a link to a game that – upon first glance – looked similar to an isometric RPG game I was set on creating. But Bastion was its own thing, which I soon found out during the developer videos at Giantbomb.

The reason I was so interested? Sure, the art was amazing – at that point I wasn’t aware the sound was as well – but the narrator. Here was a developer set on doing something new, set on bringing a baby into this world.

I guess with every new sequel to a sequel, I get queasy. There just aren’t that many original designs floating around right now – seems like everyone is dead-set on repackaging the same bullshit we’ve already seen with a different colored ribbon. People have compared Bastion to an old SNES game. I don’t see it. But what I do see is this freshness, and perhaps that’s what people really mean now when they call it an SNES game: an original game. For god’s sake, an original game!

Everyone I told about Bastion during this time wasn’t thrilled. They didn’t see the potential the game had, being caught up with the nth installment of whatever RPG series and reluctant to try an XBLA title. But this isn’t about how I was right and they were wrong. This is about why I, fundamentally, can’t look past Bastion’s ending.

(SPOILER ALERT)

When you get to the end of Bastion, the game freezes and you are offered – in a menu screen – two options, either to try and save Zulf or leave him behind. The reason I am so opposed to this is before the menu pops up, the game design is spot-on. Near perfect. Every part of the game felt enjoyable to me. But this – MENU – pops up, I’m thinking, “What is this? No “good-or-evil” menus popped up in the entire game!” All of a sudden I was shocked.

It may have been Supergiant’s tight development schedule. But I view the menu as a blunder, a smear on the perfect canvas.

Bastion is a game devoted to dynamically engaging the player through gameplay. The narration represents the epitome of this fact: he reacts to you, he talks to you, and you trust him. The entire game leading up to the ending moment was filled with direct engagement. You were told your decisions in the game, on the playing field, had meaning. And I was foolish enough to believe they would follow through on this design theme. I was wrong.

What should have happened? There should have been no pop-up. The player should have been able to either realize there was a choice, and choose, or not realize there was a choice. And that potential: for people to not realize there was a choice, and blindly trudge forward leaving Zulf behind only to later find out they could have saved him – is a moment I wished occurred in Bastion, one that I can’t look past.

Storm in a Teacup Review

Today I take a look at Chillingo’s latest game, Storm in a Teacup for the iPhone, which goes for 99 cents on the App Store.

Storm in a Teacup is a physics-based platformer (what a surprise from the creators of Angry Birds) with polished graphics and sound design. In terms of art direction, the game tries its hardest to feel stylistically whole, but the style feels a bit off, like the game was thrown together in Photoshop. Plus, there’s annoying stickers everywhere, presumably desperate attempts at subliminally teasing the player into collecting more trinkets. In addition, if you take a look at the player’s character you’ll see it isn’t very consistent with the rest of the game. Here’s the low-down:

What to Like:

• Physics puzzles
• Smooth gameplay
• Cuteness
• Simplicity
• Perfect for perfectionists
• 99 CENTS MAN!!

What to Dislike:

• Simple physics puzzles
• Relies on pixel-perfect jumps a little too much
• Cuteness
• Conflicting art style
• No story

While it was fun while it lasted, physics platformers are getting a little stale as of late. Chillingo seems to be experimenting here, just releasing small games with undeveloped (almost alpha-level) art styles in a search for the next Angry Birds.

The Rotting Cartridge gives Storm in a Teacup a THREE…. out of five.

Dropbox

Ever wish you could access your files from any other computer without flash drives and such? Well I did and this past year a friend of mine introduced me to this amazing and free program called dropbox. Dropbox is essentially an online storage drive that works on the principle of cloud sharing or instantaneous sync of information. Its extremely simple to use and even though you start off with only 250mb of free space you can double that space if you invite a friend or by paying for more space (which I dont think you’ll ever need). Speaking of friends, dropbox is the perfect way to share and edit files by using dropbox’s shared folders. I know from personal experience that being able to quickly share folders with whomever I needed was not only helpful but infinitely easier than email. You can also access your dropbox storage right from your desktop and if you are using a computer that does not have dropbox (which at the moment is pretty much every computer) you can just as easily access your files by going to the dropbox website. A year ago I believed that having a fancy flash drive was considered savvy but now I can honestly say that using online cloud storage such as dropbox is not only a faster way of sharing files between computers but it’s cost effective too (free :). Anyways, to sum everything up: try dropbox RIGHT NOW! I promise you won’t regret it and you might even find yourself using it all the time like I do.

P.S. If you like it tell your friends! Not only will they get to experience the awesomeness that is DropBox but both you and your friend will get a bonus 250mb of space so get everyone you know to try it out.

Site: https://www.dropbox.com/

Fast and Furious 5

Hey guys so this past Sunday the family and I sat down and had a mini movie marathon featuring some big name films you may have heard of. Although most of the other films were great, I decided to review Fast and Furious 5 as it is still in theaters and I know some people weren’t so sure if it were worth checking out.

Fast Five, the latest addition to the Fast and Furious saga, takes place in Rio De Janeiro, Brazil where our two main characters played by Vin Diesel and Paul Walker encounter Reyes, the stereotypical drug/crime lord that dominates the city. In the course of the film, audiences are greeted by many familiar faces and references tot he other films. As a word of warning, there is a decent amount of material in the film that requires audiences to have watched the other films to completely understand certain parts but if you haven’t seen the other films no worries you will still enjoy the film all the same.  To be honest, going into this film I expected it to be like the other four films where fast exotic cars and good looking characters mask an otherwise weak storyline. This was not the case however in Fast and Furious 5 and I was happy to see that even though the cars and people were hot as ever, storyline had clearly gained priority and this definitely established an more engaging film experience. The action is great, the acting (aside from The Rock) is solid, and the story, like I said before, always keeps you interested. All in all, if you were looking for a solid summer film you should definitely check out Fast Five.

P.S. Be sure to stay after the credits. (Especially if you have seen the other films!)