PDA

View Full Version : Volunteers for QA


hclixinarcadia
09/10/2010, 02:05
Dear Wizkids,

if you aren't already, would you consider volunteers to help test out new powers and such?

whenever there are new releases, it seems like there are always a ton of clarifications that have to be made due to something being overlooked.

recent examples are Big Figure from the Watchmen set, Bombastic Bag-Man from WoS and probably several other ones.

Sure, it's actually better to release a product rather than delay it due to over-QA but it seems like a little more effort would have helped prevent having to issue errata and clarifications.

I mentioned this in the other post and I wonder if it's already being done but to QA a new power:

1. break each statement in the power down and for each statement find all kind of scenarios for possible misinterpretation. For example, let's take some random new power such as WoS Vermin's:

RAT ARMY (NON-OPTIONAL): Vermin uses Battle Fury. At the beginning of your turn, you may deal 1 damage to each opposing character that occupies hindering terrain and is within 2 squares of Vermin.

a. Vermin uses Battle Fury - pretty straightforward there.
b. At the beginning of your turn - possible confusion may be on what exactly is done at beginning of turn. This has been discussed with poison and should be treated the same.
c. you may deal 1 damage - questions will arise regarding damage reduction, etc... if this works just like poison then there should be no clarifications needed.
d. to each opposing character that occupies hindering terrain - questions on whether characters on water terrain, smoke markers, debris, and objects will be affected... seems like they should but then again hindering terrain is defined as squares within the green... maybe that's what they mean.... at any rate.... a possible ambiguity here.
e. and is within 2 squares of Vermin - questions may arise on whether the two square radius can go thru walls. Judging from the wording on other similar ones such as the Shield Disruptor and the Opened Hydrant, it should be able to go thru walls.

So, out of that analysis, it looks like "d. to each opposing character that occupies hindering terrain" needs to be clarified. Otherwise everything else looks ok.

2. Test this figure using the different scenarios - probably none needed for this one since the power already works like the other powers and only ambiguities pertaining to terrain need to be addressed.

3. Beta-test this figure using a group of testers... people that actually play the game, preferably ones that think outside the box to formulate what the mortal beings call "cheese" strategies.

4. Implement any fixes/changes and start from step 1 again.

And, that's it. After the beta testing phase is passed, it should be ready for release.

I wouldn't mind volunteering to do any of this. This game is awesome and I wouldn't mind lending a hand.

Quebbster
09/10/2010, 06:45
1. break each statement in the power down and for each statement find all kind of scenarios for possible misinterpretation. For example, let's take some random new power such as WoS Vermin's:

RAT ARMY (NON-OPTIONAL): Vermin uses Battle Fury. At the beginning of your turn, you may deal 1 damage to each opposing character that occupies hindering terrain and is within 2 squares of Vermin.

a. Vermin uses Battle Fury - pretty straightforward there.
b. At the beginning of your turn - possible confusion may be on what exactly is done at beginning of turn. This has been discussed with poison and should be treated the same.
c. you may deal 1 damage - questions will arise regarding damage reduction, etc... if this works just like poison then there should be no clarifications needed.
d. to each opposing character that occupies hindering terrain - questions on whether characters on water terrain, smoke markers, debris, and objects will be affected... seems like they should but then again hindering terrain is defined as squares within the green... maybe that's what they mean.... at any rate.... a possible ambiguity here.
e. and is within 2 squares of Vermin - questions may arise on whether the two square radius can go thru walls. Judging from the wording on other similar ones such as the Shield Disruptor and the Opened Hydrant, it should be able to go thru walls.

So, out of that analysis, it looks like "d. to each opposing character that occupies hindering terrain" needs to be clarified. Otherwise everything else looks ok.
To me, this sounds like a lot of work just to point out that the standard terms of the game work the same way they always do. :)

hclixinarcadia
09/10/2010, 11:31
To me, this sounds like a lot of work just to point out that the standard terms of the game work the same way they always do. :)

lol, thanks for the response Quebster.

and, at this rate, QA'ing everything like that would cause release dates to get delayed over and over.

When I worked for a software company, one of the products took 4 years to release! Why? because the designers kept making changes trying to make everything perfect. No, I didn't work for Blizzard but maybe Starcraft 2 was the same way... took forever to release.

oh and I just realized, that the hindering clause in Vermin's power is the same as Floronic Man's... so even that is nothing new.

While we're at it though, what hindering terrain is referred to there? Water? rubble? objects? or strictly green hindering terrain? What about that orange open grave?

As far as breaking down each statement or phrase goes, ok maybe you just need to zoom in on the special ones that may cause confusion. So, let's take another random character like BB Phillipus:

THE AMAZON GENERAL : Phillipus can use Probability Control, but can only affect attack rolls. If neither that attacking nor any defending characters for a chosen attack roll possess the Amazon keyword, deal Phillipus 1 unavoidable damage after the attack is resolved.

1. scanning thru that I find:
a. but can only affect attack rolls - questions may arise from what exactly are attack rolls but that will be the same discussion as Mystics feedback.

b. If neither that attacking nor any defending characters for a chosen attack roll possess the Amazon keyword, deal Phillipus 1 unavoidable damage after the attack is resolved - easy enough... nothing ambiguous there.

2. no need to test this fig
3. no need to beta test

ok, that didn't work out too well as an example. Let me use Zenhattan #005.

THAT DIDN'T KILL OSTERMAN...: Dr. Manhattan can use Impervious, but on a roll of 3-4, instead of the normal effect, you may choose to reduce the damage dealt to 0 and place Dr. Manhattan in your starting area.

1. scanning thru I find:
"you may choose to reduce the damage dealt to 0 and place Dr. Manhattan in your starting area"

Questions may arise on whether you may choose one or the other or it has to be both... did the designer mean you may choose 0 damage, and you may choose to place blah blah blah or did the designer mean you either do both or neither.

Questions may also arise on things that occur at the end of an attack such as knockback, the maneuver feat, WoS Nightcrawler, 2nd flurry attack, 2nd duo attack. And so, you have different scenarios or use cases for when it is hit and rolls a 3 or 4:

a. Dr. Manhattan is knocked back - oh, damage is 0 therefore no kb... duh
b. Maneuver - occurs after the attack is resolved ... so it looks like it negates Dr. Manhattan's placement... does it?
c. WoS Nightcrawler - also after the power action resolves so same as above.
d. 2nd flurry - looks like Dr. Manhattan isn't there after the first one unless the attacker has maneuver
e. 2nd duo attack - same as above unless the attacker has maneuver or can attack again after Dr. Manhattan is placed in the starting area.

I'm not that familiar with BFCs so there may be something there too.

2. test out an actual battle with these scenarios.
3. beta test with actual people that play.

So, yeah that's a lot of work.

Characters with complicated powers should probably come with a little rule sheet like Colossals which is kinda ridiculous. But how else would you be able to clarify all that in advance?

Maybe, what you have now is the best and most cost effective solution which is put the product out and clarify as need in the PG.

But, what about the perception that the designers don't think things thru or that the product isn't too well QA'd?

Maybe it's a good trade-off: less QA for a timely release... the designers and QA people are invisible anyway... no one knows who they really are. The help/support we get thru the forum(s) is tremendous and timely... a disadvantage for those people who don't have computers... but... uh, hello it's the 21st century...

In conclusion, I guess scenarios just need to be thought out. So figures with new powers like Big Figure are tested thoroughly.