Forum Settings
       
« Previous 1 2
Reply To Thread

Guide - Proper Beta TestingFollow

#1 Nov 23 2010 at 5:45 PM Rating: Excellent
Scholar
35 posts
Edit: Sticky-ing this as it is a good read. - Kaasha

I'm concerned about those who are getting into the VIP Beta as well as the beta test! I've read many different threads where players were suggesting this might be op, that might be op, these classes may be op. They're concerned that the game is going to end up one pairing of classes that they can use to take on everything!

So, for fear that the greater percentage of players in the beta are simply players, I thought I'd write a guide for those who really don't understand exactly what they're getting themselves into.

What is a beta tester?
Exploitation in games is shunned upon, but as a tester, it's your job to break the game. The most efficient way to test is to utilize a wealth of skills and items, mixing things together in an attempt to find combonations that aren't meant to work together.

A good example was the League of Legends invulnerability bug, where popping an invulnerability ultimate and then having somebody heal you during the "resurrection" animation ended in you being invincible.

So, in short, a beta tester needs to be actively looking for bugs, and then reporting them properly to the developers or support forum. (Depending on how they receive their reports) This sounds pretty simple, but many people actually overlook what could be a serious bug.

How does a beta tester find a bug?
Yeah, strange I have to outline this one, but it must be done. However, since there are a multitude of bugs, I'll break them down into 3 classifications.

- Equation Errors -
This is a pretty obvious one. A skill states it does 100 damage, but upon hitting something, it does 160. The skill is a neutral property, and the mob you're hitting has high armor. It should be hitting for LESS than the skill states, yet it's actually hitting for more. why?

Well, those who love algebraic equations, as well as have a knack for spotting minor things like this should take it upon themselves to sit down a bit and ask themselves some questions.

- Is this skill doing more than it should?

- Is there a buff I may have that increases this skill?

- Is there a bug that may be increasing this skill?

- Is this increase a percentage or a flat integer?

In most cases, you won't find your answer, but in some, such as World of Warcraft's Rogue BC bug (Shadow step + ambush meant that the enemy took 400% extra damage, ending in a crit that one shotted plate in most cases. Shadowstep should have only increased the damage of your next hit by 20%, and then ambush increasing your damage by 120%. They became multiplicative and thus forced what should have been a 8k crit into the 15k+)

Yeah, you do have to do a little math to figure these ones out, but doing so will help the developers spot these huge issues and get them resolved quickly. In your report, try to include exact numbers or logs from your combat showing skill use and damage/heal, and then your thoughts on what could be causing the issues (if applicable)

- Environmental Bugs -
These are often hilarious, and come in all shapes and forms. This includes the overall shape of the world, where you should be able to go and where you shouldn't. For example, if you run acrossed the map and find yourself sinking into the ground, this is probably a texture-to-world issue and the map's boundaries aren't corresponding with the map's textures.

Some things you want to look for when testing environmental bugs are;

- Climbing everything you can find and getting to places you shouldn't be able to get to

- Finding corners and other nooks and wedging yourself into them, then repeatedly jumping around and spazzing out to see if you can get outside of the map

- Finding ways to trap the camera and attempt to see through walls

- Finding entities (objects that appear in the world such as trees and buildings) that you can shoot through

- Finding ways to fall through the world

Reporting these is by far the easiest beta testers should come acrossed. Simply posting a video or a couple screen shots of you falling through the map, or jumping through a wall should be sufficient. Also include the location of the area so that the developers can find it and fix it.

- Quests and Monsters -
Everyone has seen at least 1 quest in their lives that has a broken script or a writing issue. Maybe a mob is meant to spawn at a location or a door is meant to open, but it isn't. Maybe the quest suggests you to go to an area that is no where near the proper place. Either way, it's probably a bug in the writing or the scripts and should be reported.

Also, typos are a problem in tests as well as grammatical errors and the like. This is the time for you grammar ****'s to shine! A simple log or screenshot can remedy these in a heart beat.

For testing quest scripts, the procedure is simple:

- Compare the quest notes to what is missing.

- Jot down your coordinates in the area where the script or mob is missing and report it to the forums

- If the quest cannot be completed due to this issue, put it on hold and try another quest for the time being (obviously)

If a quest giver is asking for something but won't accept what you have gathered, be sure to take a screen shot of the NPC as well as reporting the EXACT name of the item you have AND the item they are asking for. It could be a typo on the scripter's end, or an invalid item ID.

How do I report a bug?
Many testers go and find a bug, but in their report leave out quite a lot of data. Thus, their report is faulty and the developers can't find or recreate the issue. It is important that you include every little detail you can remember, with as many relevant screenshots or videos if possible.

Insure that you report your findings in order of how you found them, and break it down into steps if possible

Tester Person with Gun wrote:
I fell through the map at (city name)

Coordinates are 192" 42"

It was between the two barrels next to the tool shop, here are the screenshots
(screenshot1)
(screenshot2)

It only happens if you approach them from the front and jump into the middle of them, there must be a hole in the shape of the world!


That would be a pretty basic example of how to report a bug. It is short, to the point, and simple for the developers to find and recreate themselves.

Why do I have to do all this? I just wanted to play the game...
Closed beta testing isn't about playing or trying the game. It is for the developers to get some extra help on finding all those fun little bugs that break their game. If you are just looking to get a head start, you should wait until the actual release of the game! In a beta, many wipes and character loss will happen, and everything during this time is not final. If you just want to play the game, perhaps you should go buy a game that's actually out!

Without the alpha and CBT/OBT's, the developers are left to attempt to find all these problems themselves, and in most cases, they just don't have the man power to find them all before the game released. Just look at Age of Conan!

Thanks for reading, and perhaps this will give some of you who are new to the beta test scene a little more knowledge on how this all works. I left out a few things that I felt were pretty much common sense (Well crap, all of it is common sense to me, honestly)

Hope to see you all in game climbing everything and attempting to jump outside of the map! I know I will!

Edited, Nov 23rd 2010 6:51pm by Virut

Edited, Nov 29th 2010 2:32pm by Kaasha

Edited, Nov 29th 2010 2:33pm by Kaasha
____________________________
My writings come from a twisted imagination.
My ideas comes from a lifetime of terrifying nightmares.
My inspiration comes from pure madness.
Who said psychosis was a bad thing?
#2 Nov 23 2010 at 6:05 PM Rating: Decent
15 posts
nice guide. that is what we are supposed to do...in theory.

In reality, few people have the patience to go trough all this, most people just want to see how's the game in general.

Also, considering that the tests will be very short, I still think that we are gonna miss plenty of bugs.

Edited, Nov 23rd 2010 7:06pm by Rhypo
____________________________
IGN: Rhypo
Class: Nightblade/Shaman/Paragon
Guild: PI
#3 Nov 23 2010 at 6:28 PM Rating: Decent
16 posts
great information
#4 Nov 23 2010 at 7:04 PM Rating: Decent
Scholar
*
118 posts
Very good post, however this beta test is little more than stress testing and marketing. I suspected it, and it was confirmed today on the Rift Forums.

http://forums.riftgame.com/showthread.php?6254-VIP-Code-Distribution

Quote:
Our beta is for stress testing. And I have said many times that beta is also for marketing. Sure we'd all like to think marketing has nothing to do with it. But it does. There are less than 30k people on this forum right now. That's not enough to support any MMO. So our marketing team is using beta to get us some attention and get more people looking at Rift. That's their job. If they don't get the word out and get sales for the game, none of us get to enjoy Rift.


Quote:
We have chosen to do most of our testing in alpha. It's been going on for some time.
#5 Nov 23 2010 at 7:07 PM Rating: Excellent
Inkie in Disguise
*
239 posts
Great post, Virut!
____________________________
Creepy Girl Extraordinaire
#6 Nov 23 2010 at 7:56 PM Rating: Decent
*
74 posts
Great post. But as they have said in the official community. They are gonna go throught the Beta for stress and marketing. There has been an Alpha where the really closest members of the official community were chosen to give Trion World workers feedback and that stuff.

So, if we're lucky, we're gonna have fun and lagg like **** :D
#7 Nov 23 2010 at 7:59 PM Rating: Decent
Scholar
*
68 posts
Mmmmm lag. I wish I could get in Alpha. I love getting stuck in geometry and falling through the world on purpose. LOL.
____________________________
Because Evil is ****
"Doesn't everyone have a Dark Elf inside their head?!"
#8 Nov 23 2010 at 8:03 PM Rating: Decent
*
74 posts
/agree Before reporting an enviromental bug, u have to "play" with it as much as you can :D Or until a GM catches you -.-
#9 Nov 23 2010 at 8:14 PM Rating: Decent
Scholar
*
135 posts
Stress testing may be the primary function, but finding bugs/design flaws is also a great help to the game in general. Even the minor ones may seem trivial, but every report goes towards making a better game in the short and long term, so don't think its irrelevant. Design and balance may not be the focus of the beta, but its only when you throw massive numbers of people at something that you really start to find out what is working and what isn't. There will be a lot of balancing, wiping, exploiting done as more and more people show up. Its the nature of MMOs.

On a different note, one other important thing to mention regarding finding bugs is finding out if you can recreate it. If you can recreate a bug and know the exact method to create the bug/glitch again, devs can fix it much easier.
____________________________

Currently playing: EQ2(AB)
#10 Nov 23 2010 at 8:23 PM Rating: Decent
9 posts
thanks for the information posted. will be keeping these factors in mind!

-m
#11 Nov 23 2010 at 9:15 PM Rating: Decent
Scholar
*
100 posts
Excellent post. Hopefully people realize that beta testing can be an integral part of a successful launch and not an opportunity to take advantage at the start of the game. Would be sad to see a bunch of complaint posts from people that have access to the beta.
#12 Nov 23 2010 at 9:30 PM Rating: Good
*
66 posts
Granted, part of it is that I would like to get in on the game early, considering most of the time when I've been in on a beta, I haven't really run into hardly any issues. However, I am all for being part of the process of finding bugs and reporting them so it has a smooth release.
____________________________
__________
________________________________________________________

Aelwyn - Bahmi Cleric - Purifier, Sentinel
#13 Nov 23 2010 at 10:03 PM Rating: Decent
Scholar
35 posts
Regardless of stress testing, this game is not perfect. There may be things that are overlooked, so the guide is still relevant! It can still be used as a guideline for those unsure of how to deal with an exploit or bug. (Rather than using it repeatedly to your own advantage.)

Regardless, thank you for your comments and such. :) And thanks, Kaasha, hopefully I've staked my place in this community as a dedicated tester.

Edited, Nov 23rd 2010 11:06pm by Virut
____________________________
My writings come from a twisted imagination.
My ideas comes from a lifetime of terrifying nightmares.
My inspiration comes from pure madness.
Who said psychosis was a bad thing?
#14 Nov 24 2010 at 1:09 AM Rating: Good
**
405 posts
Very informative, keep in mind that this is a huge publicity stunt, so if you play and enjoy and pass that on your doing your job, a great guide none the less... TLDR
#15 Nov 24 2010 at 1:21 AM Rating: Decent
Scholar
Avatar
*
114 posts
Great guide. I do see VIP keys going to people that won't contribute like your guide explains.
#16 Nov 24 2010 at 1:25 AM Rating: Good
**
405 posts
Yeah thats why were all here! this is not a facebook contest or a post first whirlwind, this is a community, build it and be rewarded! Bring friends in, link it to other communities lets do this bros!
#17 Nov 24 2010 at 1:30 AM Rating: Decent
*
102 posts
i understand that 100% of beta testers are black box testers...

how about some of us be white box testers and really get to pick apart game mechanics?

____________________________

undecided
#18 Nov 24 2010 at 12:16 PM Rating: Excellent
Inkie in Disguise
*
239 posts
UncleTony wrote:
i understand that 100% of beta testers are black box testers...

how about some of us be white box testers and really get to pick apart game mechanics?



That's actually a lot of fun too!
____________________________
Creepy Girl Extraordinaire
#19 Nov 24 2010 at 12:49 PM Rating: Decent
*
66 posts
This is a fantastic post. I will certainly be saving this for future beta tests :) Thanks very much!
#20 Nov 24 2010 at 1:17 PM Rating: Decent
Scholar
19 posts
They've stated on the official Rift forums that these "Beta" periods are more for stress testing than actual game testing. The people that they recruited and have been involved in the Alpha stages of the game are the ones they are relying on to "break" the game so they can find and fix bugs. The beta testing that is going to start soon is more of a stress test to see how well their DB's handle the load of users with everybody running around and doing stuff.

Still a great guide though for anybody wanting to take beta testing more serious!
#21 Nov 24 2010 at 1:21 PM Rating: Decent
*
66 posts
Oh yea. Purposly breaking this is a major part of the process- it provides valuable feedback in multiple forms-

-Helps figure out the best, most effective way to get the severs back online
-Helps to determine when maintenance will be most effective (once a week, once a month, etc)
-Helps to gauge how many people one server can handle while not being over crowded, or lagged out

In the end, all of this helps players indirectly as well.
#22 Nov 24 2010 at 7:06 PM Rating: Excellent
Too Über for Title
*
188 posts
Hey Virut,

Great guide, its given me inspiration to add a beta testing guide onto the Rift wiki.. it'll be live soon.

Well Done.
____________________________
"If Its a Must, Its Up to US!" Help Contribute to ZAM Wiki's
"Im Nuts for Rift, Because i'm a Squirrel"
Bohtauri
#23 Nov 29 2010 at 1:50 PM Rating: Decent
*
102 posts
sticky PROPSSSSS
____________________________

undecided
#24 Nov 29 2010 at 4:44 PM Rating: Decent
*
182 posts
Great guide and glad it got a sticky.
____________________________
Member of United By Legend currently a AoC guild.
#25 Nov 29 2010 at 5:45 PM Rating: Good
Avatar
*
113 posts
Seen this list in Wiki and was late to see that it started from this post !! Nice work Virut. It's a great help for new Beta testers or old ones to see if they have forgotten anything. Although Rift got most of each bugs and etc fixed in alpha i don't think they have scanned ALL Telara to fix everything so except from stress test we should all try to go to as many possible places and see if and where bugs exist.

Cya all peeps inside game in 3 days

PS. Can we have a countdown timer in forums or not possible(i'm asking too much huh?) Tried making one :P

Edited, Nov 29th 2010 7:33pm by agriosgeorge
____________________________
-- Currently playing --

LoL
CoD:MW3
Rift
#26 Nov 29 2010 at 9:47 PM Rating: Default
*
102 posts
3 days? i thought it was the 7th
____________________________

undecided
#27 Nov 30 2010 at 4:10 PM Rating: Good
Scholar
32 posts
I really like the guide. I hope that everyone reads this before they start their adventures in Telara ^^
____________________________
Beta character name: Deadlock (if available)
Class: Cleric
Souls: Still undecided
#28 Nov 30 2010 at 4:16 PM Rating: Good
Scholar
17 posts
I laughed at the climb everything part..for some reason I naturally try to jump on stuff when im playing games (thats what she said) to see how high I can get.


-Tera
#29 Nov 30 2010 at 10:44 PM Rating: Excellent
*
52 posts
Awesome guide, Everyone participating in beta should definatly read!
____________________________
Tariuss Antonia Bayle EQ2
#30 Dec 01 2010 at 5:08 AM Rating: Decent
13 posts
Can't forget about testing how dynamic it's going to be! lol great guide I'll definitely be looking for ways to break the game ;D
#31 Dec 01 2010 at 6:41 AM Rating: Good
Scholar
45 posts
*flexes her grammar **** muscles* Thanks for the post - it's a good reminder what our job will be over the coming weekends. The suggestions of how to submit bugs is useful; I'll be consulting it again.
#32 Dec 02 2010 at 1:40 AM Rating: Decent
18 posts
Great post! It is good to inform future beta testers of what testing is really about. It is understandable that some keys will be given to more casual gamers who just want to test the waters of any game. It has been happening for years but posts like these at least make it known of what should be happening during these tests.
#33 Dec 02 2010 at 1:53 PM Rating: Decent
19 posts
As per Virut's quote:

"I'm concerned about those who are getting into the VIP Beta as well as the beta test! I've read many different threads where players were suggesting this might be op, that might be op, these classes may be op. They're concerned that the game is going to end up one pairing of classes that they can use to take on everything!"

I totally agree with Virut, as alot of these players do not understand what it is to be part of a beta test. I'm not an expert by any means but just to get in the game and explore and have fun is not beta testing. This gives less chances of MMO players that really want partipate in the closed betas compared to those that just want a new MMO fix and have fun casually. We need people to give constructive comments in finding real glitches and exploits that need to be addressed before the game goes "gold" and retail.

Thats' why its called a BETA!!!



Edited, Dec 2nd 2010 2:53pm by Psycatic
____________________________
OSB-One Step Beyond
class: TBD
#34 Dec 03 2010 at 7:14 AM Rating: Decent
Scholar
20 posts
Great guide, sadly most "beta testers" just want to get in, and play a free game.
While offcourse we all would like this, its better to have decent beta testers that will actually report bugs/find bugs.
Making the game even better at launch, the guide really helps.
#35 Dec 03 2010 at 9:36 AM Rating: Decent
10 posts
Good guide.

A lot of players who get on beta tests don't even care about reporting bugs they find, nowadays.

Let's make a contest, first player to jump out of the map wins. :p

Edited, Dec 3rd 2010 10:37am by DiNo29
#36 Dec 03 2010 at 4:14 PM Rating: Decent
Scholar
26 posts
Great guide. Regardless of whether the beta testing is for stress testing or not, you can do no harm by trying to find things that are not working as intended. If enough of these are found in the stress tests, this could lead to a longer beta window, but would overall lead to a smoother more polished release.

I think that is something we would all love to see.
#37 Dec 04 2010 at 7:44 PM Rating: Decent
7 posts
been using your guide and placing bug reports and feedback.sadly i only have a normal key.no beta vip key.

hope to continue.

cya ingame once retail hits

gonna miss EQ2 but looking forward to RIFT

Watch out for the RIFT!!!

kind regards

Tiberan
#38 Dec 05 2010 at 4:38 AM Rating: Decent
11 posts
Excellent guide. If I get in in the future, I'll definitely be trying to walljump a bit and access places I shouldn't be able to access. It's all I do when I find myself bored in an MMO. Who knows whether I'm doing it to report bugs or just to be cool...


Don't worry, I'll report it... I think.
#39 Dec 07 2010 at 12:00 PM Rating: Decent
17 posts
aye very good post , only thing i kinda disagree about is beta is about playing the game , you want to play it like normal to make sure everyday bugs have been worked out if not , write em down and pass em along, but same time think people should also go out lookin for bugs trying to find bugs that might have been missed , so these can also be taken care of.
Also think everyone should report a bug they find or spelling error or anything , dont get the mentality oh someone else will report this , just go ahead and do it urself too even if you know someone else has reported this , maybe your description of the bug will be more detailed maybe the other people left something out where you kept it in.
just a lot of things like that you gotta do.
but very smooth launch of the beta , very impressed on how everything went.
#40 Dec 08 2010 at 10:57 AM Rating: Decent
10 posts
people use to accommodate to the game , i was having problem with a guy npc , in theory i would use an item for detect a disguise , but never work , i was in mele range and he answer me if i try to talk , but the item not work i was geting the msg "out of range" .

Eventually another player waiting there prolly for same quest told me "you need be just pushing he ..then work" . rigth i move to be in same place what npc and item work... but this is a bug is need to be requested , if not when game come live many people will be stoped in this quest , ..till anyone post the issue
#41 Dec 09 2010 at 2:24 PM Rating: Decent
3 posts
Love the guide but unfortunately most people want to get into beta to test if they'll buy the game or not. Instead of getting into betas with the thought of making the game the best it could be by finding and reporting bugs.
#42 Dec 10 2010 at 10:57 AM Rating: Decent
3 posts
Ya thanks for the useful information. I will definitelybe using these strategies if I participate in the next Beta, as well as just play the gmae for fun! Because i think the beta tests are also suppose to be fun. People aren't waiting for hours and hours, posting on facebook, twitter, Rift site, Zam... etc... just to jump to the highest point possible :) but you are right that we need to give very informative and often critical information back to RIFT, no time to be shy about it.
#43 Dec 11 2010 at 4:10 PM Rating: Decent
1 post
This is a great post not just for this thread, but for any beta tests, such as the one currently being held for DCUO. thanks.
#44 Dec 11 2010 at 8:54 PM Rating: Decent
45 posts
A reminder to add:

A beta tester is free to communicate w/ others in game. However, it is not appropriate to use testing as an opportunity to proclaim loudly how much better you like WoW, how WoW did X better, lament how games post UO/EQ1 are made for wussies(not the word usually used), complain about how much the games rips off WoW - the original MMO, and so on and so forth. A tester should instead remind themselves that testing is more of an opportunity for them to help the devs make the launch experience as smooth as possible with the side benefit of getting to try a game pre-release. Wasting that time by trolling zone chat is a horrible idea.
#45 Dec 12 2010 at 7:18 AM Rating: Decent
1 post
Great guide, about time someone took the time to remind folks what Beta is. All you needed to see or watch was the chat, or the race to 20 and run around showing off what you were able to aquire. Now all that is neat but not what we were there to do, test, yes? I have beta tested most of the games out now, enjoyed finding bugs, fell through alot of worlds. Only once reached max lvl of the beta. Create differant char's and models, there is the first place to look, found and reported a bug there? Have fun and test :))
#46 Dec 12 2010 at 4:09 PM Rating: Decent
37 posts
^ Great Thread/Post and it is a very good reminder what needs/should be done.

Quote:
Also, typos are a problem in tests as well as grammatical errors and the like. This is the time for you grammar ****'s to shine! A simple log or screenshot can remedy these in a heart beat.


Haha, I'm a spelling ****! :D

Edited, Dec 12th 2010 5:13pm by Celestyn
____________________________
Currently Playing: Aion - (Kera - Cleric, Rains - Ranger and Calysta - Chanter on Zikel)

Previous MMO's: WOW (Previous Hardcore Raider and PvPer), Warhammer (DOK and WE), Guild Wars, LOTR, AOC and EQ.

Other PC Games: Dragon Origins, Mass Effect, Mass Effect 2, Borderlands
#47 Dec 12 2010 at 6:42 PM Rating: Decent
*
62 posts
Celestyn wrote:


Edited, Dec 12th 2010 5:13pm by Celestyn



I wonder what she misspelled? ;o
#48 Dec 13 2010 at 10:16 PM Rating: Decent
12 posts
thanks for the beta testing ins and outs
#49 Dec 13 2010 at 11:24 PM Rating: Decent
26 posts
Thank you for the guide, I will definitely be sure to use it if I get in! :D
#50 Dec 14 2010 at 2:53 PM Rating: Decent
20 posts
Have to agree, great short guide, i actually learned something ;)
____________________________
Former player of alot of mmo's - although, Dark age of camelot will always be in my hearth ;) <3
#51 Dec 14 2010 at 8:09 PM Rating: Decent
9 posts
Thank you for this post. Very good and easy read, and very useful !

:D
« Previous 1 2
Reply To Thread

Colors Smileys Quote OriginalQuote Checked Help

 

Recent Visitors: 22 All times are in CDT
Anonymous Guests (22)