Hey guys,
I use to work for Sony and Sega as a senior tester in the UK, I now live in Japan so I know a little about testing. So to hear wobat say 'do companies really test a game twice', I felt obliged to send my comments and help clear up the subject.
This is just one example...
Say a game is developed by Team 17 but published by Sega for the Sony PlayStation 2, well the game would have been tested by both Team 17 and Sega at the same time, the Sega testers would work in a team of say 6~10 (depending on the title) people. The bugs found by Sega would been written up into a report and sent to Team 17. Team 17 would go through the bug report addressing the worst (100% crashes, Sound corruption, Graphic corruption) bugs or the bugs that might failure the product once submitted to Sony. Team 17's and Sega's testers would then get new code and test it again to see if the bugs had been fixed or to find new bugs that the fixers may have caused. While testing a product you must always be recording the game you're testing, this can be used as evidence of a bug. It could help the dev-team fix the bug (sometimes the programmers can identify the problem just by watching the video) by showing them the exact problem or it could help the tester recreate the bug.
After the Sega test team had finished with the product making sure all the major bugs had been flushed out, SEGA would then submit it to Sony for Approval. The Approval testing is a minium of 100 hours depending on the size of the game.
Sony phase one of testing is to see if the game responds correctly (with the correct messages and Copyright info) while controllers, memory cards etc are removed during different stages of the game. Manual proofing is also done in phase one, making sure all text is spelt correctly and Icons and trademarks are all present. But the most important thing during Phase one testing is TRC (Technical Requirements Criteria), this the game fails any of these requirements the game is failed.
While in phase one of testing the product will also be in phase two, this process is where the testers try and break the game by doing things that normal players wouldn't think off. Full play-throughs are also completed during test, using all character or
vehicle unlocking everything that game has to offer. If any problems are found during these processes the game will be failed and a report sent to the publisher explaining the reason, along with detailed info on how the problems are caused and duplicated. The developed will then have to address the problems in the Sony report, when the developer thinks that they've address the issues and fixed them problems testing starts all over again. This process will repeat until the game is approved by Sony.
There is a lot to testing a game it's a very complicated process...something I think most people are not aware off.
I'd like Virtua Fighter 5 for the PS3.:lol:
Cheers,
DJmizuhara