IS480 Team wiki: 2012T1 6P User Testing
Home | Project Overview | Project Management | Project Documentation | Meeting Minutes | Game Development |
Overview | Game Mechanics | User Testing | UI Screenshots | Graphics Development | Technical Complexity |
Contents
User testers
Conceptualization Testing
Methodologies:
For our prototype testing, we had a total of 20 participants for every user test session. The main age group of the participants fall between the age group of 25 to 34 years old. Users were asked to fill up a consent form before starting the test. There's no fixed structure to the execution of the test; users were not given any test cases. User’s expression and enthusiasm level were observed during the testing, and feedbacks from the users were taken afterwards through post-tests interviews. The feedbacks were then analysed before necessary adjustments were made.
User Testing Consent Form: User_Testing_Consent_Form.pdf
Low-Fi: Game Mechanics (version 1 - 13 to 17 June 2012)
YouTube Link: http://www.youtube.com/watch?v=TUTu3mGpahs
Results and Findings: 6P_lowfi_gamemechanics_v1
Low-Fi: Game Mechanics (version 2 - 21 to 25 June 2012)
YouTube Link: http://www.youtube.com/watch?v=SxE_w_br1fc&feature=plcp
Results and Findings: 6p_lowfi_gamemechanics_v2
Hi-Fi: Game Mechanics (1 to 4 July 2012)
YouTube Link: http://youtu.be/L4XeQ3BILyI
Raw Data: Pre Launch (Raw User Feedback HiFi Prototype)
Results and Findings: 6p_hifi_gamemechanics
Web link: http://wilsonhong.com/FYP/Team_6P_Hi_Fi_Prototype_Package/Default.html
Functional Prototype (Gralch - 13 to 14 July 2012)
YouTube Link: http://www.youtube.com/watch?v=31_BVtM4HBQ
Results and Findings: 6p_functional.1
Pre Launch Testing
Methodologies:
The test is conducted with 20 users, aged between 18 - 25 years old. Each user is then observed on their expression and rated 1 - 5, and asked to rate their "fun" level. Their feedback are then noted and analyzed.
Test Script for User Testing: Test Script
Flash Prototype (Monsters Throw V1 - 20 August 2012)
Web Link: http://wilsonhong.com/FYP/Prototype1.html
Results and Findings: 6p_Monsters Throw V1
User Testing (24 August 2012)
Raw Data: Pre Launch (Raw User Data 24082012)
Analysis: 6p_PreLaunch_2408_Analysis
Flash Prototype (Monsters Throw V2 - 2 September 2012)
Web Link: http://wilsonhong.com/FYP/PrototypeV2.html
Results and Findings: 6p_Monsters Throw V2
User Testing (Stage 1 - 12 to 14 September 2012)
Raw Data: Pre Launch (Raw User Feedback Stage 1)
Analysis: 6p_Gralch_UnlimitedWorldStage1
User Testing (Stage 2 - 12 to 14 September 2012)
Raw Data: Pre Launch (Raw User Feedback Stage 2)
Analysis: 6p_Gralch_UnlimitedWorldStage2
Game Launch Feedback and User Testing
Gralch 1.0 release (Users Feedback and Suggestions - 27 to 28 September 2012)
Methodologies:
The result's and analysis were based from friends and general public feedback(received through Email and Google Play Store).
Objective:
To find out if the current beta version is well received in terms of game appeal and level difficulty, particularly in terms of game control mechanism. From the results of our users concern and feedback, we seek to better improve the game.
Raw Data: Raw User Feedback(Friends) Beta 1.0
Analysis: 6p_Gralch_Beta_User_Analysis(Friends)
Raw Data: Raw User Feedback(Email-Playstore) Beta 1.0
Analysis 6p_Gralch_Beta_User_Analysis(Email_Playstore)
Gralch 1.1 release (Compare 3 different controls - 4 to 6 October 2012)
Objectives:
Test out 3 different controls and find out user's response to them:
- Tap and hold
- Swipe
- Joystick
Justification (from previous user feedback):
- “It is generally observed that Gralch is hard to control and is flying too fast, with 13 users out of 20 saying so. It is also noted that the tap controls were not intuitive enough for them as sometimes they require clicking multiple time.” (friends)
- “12 users out of the 22 thinks the control can be more intuitive (things like tapping too many times, stiffness of controls were noted).” (public – playstore or email feedback)
Steps:
- Approach User Tester + Self Intro
- Asks for their name, age and level of mobile gaming
- Let them play the game and take note of their % of life when they pass checkpoint 1
- If user dies before reaching checkpoint 1, take the % of life to be 0%. At the end of the game, get the user to give a rating for the ease of control.
- Enter the data into the spreadsheet for consolidation.
Results: Media:User_Testing_Controls_Raw_Data_&_Results_(4_to_6_Oct_2012).xlsx
Gralch 1.2 Pre-Release Test
Objectives:
To gather user’s feedback on the new update graphics and obstacles added to the game.
Results: Media: 6P_Raw User Feedback Gralch Beta 1.2.xlsx
Analysis: Media: 6P_Gralch_Beta 1.2.doc
Gralch 1.3 Pre-Release Test
Objectives:
To gather user’s feedback on additional game control and updated gameplay.
Results: Media: 6P_Raw_User_Feedback_Gralch_Beta_1.3.xlsx
Analysis: Media: 6P_Gralch_Beta_1.3.doc
Gralch Extended User Test
Click here to go to page for Extended User Testing.
Functional Testing
Methodologies:
The test is conducted internally within the team. The testers will test the game based of the various scenario and test scripts. The results will then be recorded and analyzed before ratification is made.
Functional Test Scripts: 6P Functional Testing
Results and Findings: 6p_Functional_Testing
Incompatible devices
Since launching of our app to Google Play Store, it has expand our pool of user testers. It allow friends and public to download the app conveniently and this helps us to keep track a list of devices that are incompatible with our app. We are still investigating the incompatibility issues on some android phone and will release an update should we found a fix. Below is the list of incompatible devices found to date:
Reported incompatible devices | Android version | Remarks |
Nexus 7 | 4.1 | Only white screen with songs |
HTC Desire S | 4.0.3 | Stucked at game menu |
Samsung Galaxy Ace | 2.3.5 | Cannot launch app |
Motorola Razr XT910 | 2.3.5 | Cannot launch app (Resolved as of 27 November 2012) |
Sony Xepria Lt15i | 2.3.4 | Load at splash screen then crash already |
HTC Legend | 2.3.3 | Cannot launch app |
LG Optimus | 2.2 | Cannot launch app |
Huawei Ascend Y200 | 2.2 | Cannot launch app |