Tuesday, October 18, 2005

My BF2 morning!

Update: 7 October, 2009 - Removed post. It was only a picture of a winning score from a round of Battlefield 2.

Required reading... "Betas should be about testing"

Darniaq has a great blog post up about how beta testing needs to be about testing and how the industry has strayed. From the article;
"However, this can't be the only part of the beta testing. There needs to be a good back end reporting system too. Forums do not cut it. They may work for a few hundred testers, of which maybe 75% of them would read the forums and 50% actually post. However, when the game starts stress testing the servers, the players will generate much more noise than actual signal on the forums. Most of this noise will be rehashing long standing bugs or incomplete features, requiring even other testers to skim posts so much they may miss something relevant."


Update: 10 Nov, 2006 - Edited post and applied labels.

Monday, October 17, 2005

Now I'm an eBay gold seller...

Update: 5 Nov, 2006 - Removed post, but this will be kept as a placeholder for historical value.
This post contained a picture of a conversation where someone in World of Warcraft accused me of being an eBay Gold Seller.

MO4 discussion links and other updates

Update: 9 May, 2009 - Removed post. This will be kept as a placeholder for historical value.
Originally, this post contained links to various reactions to my MO4 article.

Sunday, October 16, 2005

MO4 - Overcomplicated Beta sign ups

Two days and two MOs? You're damn straight.

So what brings us to the topic of beta sign ups? Vanguard's recent announcement of their beta 1! Does everyone see me jumping for joy? My past thoughts on Vanguard:SoH.

Lets start out by pointing out what they did correct with this beta phase. First off they are offering it to community members and not a general sign up for everyone with a net connection. That is the correct way to reward your community. Hopefully they don't just pick Joe Schmoes that signed up just to apply for beta, but I doubt it. Well... that ends the good.

The bad? Where to begin. I guess with what "grinds my gears" the worst. Over complicating the process and giving false hope. Here is a perfect example.
"How will you go about selecting participants?

Once you have submitted your application, your name will be added to a list of potential participants. Each week, we will add the needed number of people from that list. Sometimes, they will be chosen based on our specific needs for testing (for example, we might need more testers that play during a particular time of day) and sometimes, names will be chosen pretty much at random."
So now every new beta application is going to be over stating what hours they play or the person submitting it will try to *guess* the *magic combination* of inputs to produce the highest % chance of getting into beta. Congratulations Sigil; you just flooded your beta application pool with a bunch of false information.

But why even have such a process in the first place? If they honestly think they are going to get any sort of actual *testing* (I use the term loosely) from an over-hyped MMORPG community… they obviously failed basic MMORPG sociology. I could link hundreds of beta leaks and broken NDA contracts, but what would be the point?

What you need to know is the fact that betas are infiltrated by those that want sneak peaks at the game. Definitely not by those that truly wish to test the product. Internal testers and paid testers have proved for years to be able to produce very finished products in the single player market. Apply this to the MMORPG market please! I understand some smaller companies would be unable to fund such testing, but this is Sigil and last time I checked they weren’t short on funds.

Sigil is using this beta as a promotion which is a sad fact. Not only that, but they are overcomplicating the process stealing valuable resources from the game itself. How much work is it to review countless beta applications? I have no solid numbers, but there is no way they can convince me that it doesn’t take away from the game development.

The idea of NDAs is also hard for me to understand. World of Warcraft had no problem without one. Blizzard proved exactly what betas are for… a free pass to view the game. This created a knowledgeable community inside and outside of beta. WoW beta only suffered from too much interest, but Blizzard did a remarkable job of eventually getting 500,000 testers online.

Skip the bullshit Sigil and get to stress testing. Nail down game play, get the game launch ready, and hit the stress test hard. Sigil will be balancing this game as any other MMORPG… over time! If you get the game into a state where it is playable, has a sense of balance, and technically stable… you have a beta. Take all the time it takes to review beta applications and put into reviewing and organizing bug reports.

This isn't about me getting into beta at all, because honestly I have no interest in Vanguard. This is about developers wasting time, resources, and energy on overly complicated beta processes. Make it about the damn game already.