HeaderSIS.jpg

IS480 Team wiki: 2012T1 6P User Testing

From IS480
Revision as of 22:53, 27 November 2012 by Wilson.hong.2009 (talk | contribs) (→‎Gralch Extended User Test)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search
6pcube.png Home   6pProject overviewicon.pngProject Overview   6pProject managementIcon.png Project Management   Project Docs.png Project Documentation   6pMeeting minutesIcon.png Meeting Minutes   6PGralch.png Game Development


  Overview   Game Mechanics   User Testing   UI Screenshots   Graphics Development   Technical Complexity  


User testers

A compilation of pictures taken during our user testing sessions.


Conceptualization Testing

Methodologies:

For our prototype testing, we had a total of 20 participants for every user test session. The main age group of the participants fall between the age group of 25 to 34 years old. Users were asked to fill up a consent form before starting the test. There's no fixed structure to the execution of the test; users were not given any test cases. User’s expression and enthusiasm level were observed during the testing, and feedbacks from the users were taken afterwards through post-tests interviews. The feedbacks were then analysed before necessary adjustments were made.

User Testing Consent Form: User_Testing_Consent_Form.pdf

Low-Fi: Game Mechanics (version 1 - 13 to 17 June 2012)

YouTube Link: http://www.youtube.com/watch?v=TUTu3mGpahs

Results and Findings: 6P_lowfi_gamemechanics_v1

Low-Fi: Game Mechanics (version 2 - 21 to 25 June 2012)

YouTube Link: http://www.youtube.com/watch?v=SxE_w_br1fc&feature=plcp

Results and Findings: 6p_lowfi_gamemechanics_v2

Hi-Fi: Game Mechanics (1 to 4 July 2012)

YouTube Link: http://youtu.be/L4XeQ3BILyI

Raw Data: Pre Launch (Raw User Feedback HiFi Prototype)
Results and Findings: 6p_hifi_gamemechanics

Web link: http://wilsonhong.com/FYP/Team_6P_Hi_Fi_Prototype_Package/Default.html

Functional Prototype (Gralch - 13 to 14 July 2012)

YouTube Link: http://www.youtube.com/watch?v=31_BVtM4HBQ
Results and Findings: 6p_functional.1

Pre Launch Testing

Methodologies:
The test is conducted with 20 users, aged between 18 - 25 years old. Each user is then observed on their expression and rated 1 - 5, and asked to rate their "fun" level. Their feedback are then noted and analyzed.

Test Script for User Testing: Test Script

Flash Prototype (Monsters Throw V1 - 20 August 2012)

Web Link: http://wilsonhong.com/FYP/Prototype1.html
Results and Findings: 6p_Monsters Throw V1

User Testing (24 August 2012)

Raw Data: Pre Launch (Raw User Data 24082012)
Analysis: 6p_PreLaunch_2408_Analysis

Flash Prototype (Monsters Throw V2 - 2 September 2012)

Web Link: http://wilsonhong.com/FYP/PrototypeV2.html
Results and Findings: 6p_Monsters Throw V2

User Testing (Stage 1 - 12 to 14 September 2012)

Raw Data: Pre Launch (Raw User Feedback Stage 1)
Analysis: 6p_Gralch_UnlimitedWorldStage1

User Testing (Stage 2 - 12 to 14 September 2012)

Raw Data: Pre Launch (Raw User Feedback Stage 2)
Analysis: 6p_Gralch_UnlimitedWorldStage2

Game Launch Feedback and User Testing

Gralch 1.0 release (Users Feedback and Suggestions - 27 to 28 September 2012)

Methodologies:

The result's and analysis were based from friends and general public feedback(received through Email and Google Play Store).


Objective:

To find out if the current beta version is well received in terms of game appeal and level difficulty, particularly in terms of game control mechanism. From the results of our users concern and feedback, we seek to better improve the game.

Raw Data: Raw User Feedback(Friends) Beta 1.0
Analysis: 6p_Gralch_Beta_User_Analysis(Friends)


Raw Data: Raw User Feedback(Email-Playstore) Beta 1.0
Analysis 6p_Gralch_Beta_User_Analysis(Email_Playstore)

Gralch 1.1 release (Compare 3 different controls - 4 to 6 October 2012)

Objectives:

Test out 3 different controls and find out user's response to them:

  • Tap and hold
  • Swipe
  • Joystick


Justification (from previous user feedback):

  • “It is generally observed that Gralch is hard to control and is flying too fast, with 13 users out of 20 saying so. It is also noted that the tap controls were not intuitive enough for them as sometimes they require clicking multiple time.” (friends)
  • “12 users out of the 22 thinks the control can be more intuitive (things like tapping too many times, stiffness of controls were noted).” (public – playstore or email feedback)


Steps:

  • Approach User Tester + Self Intro
  • Asks for their name, age and level of mobile gaming
  • Let them play the game and take note of their % of life when they pass checkpoint 1
  • If user dies before reaching checkpoint 1, take the % of life to be 0%. At the end of the game, get the user to give a rating for the ease of control.
  • Enter the data into the spreadsheet for consolidation.


Results: Media:User_Testing_Controls_Raw_Data_&_Results_(4_to_6_Oct_2012).xlsx

Gralch 1.2 Pre-Release Test

Objectives:

To gather user’s feedback on the new update graphics and obstacles added to the game.


Results: Media: 6P_Raw User Feedback Gralch Beta 1.2.xlsx

Analysis: Media: 6P_Gralch_Beta 1.2.doc

Gralch 1.3 Pre-Release Test

Objectives:

To gather user’s feedback on additional game control and updated gameplay.


Results: Media: 6P_Raw_User_Feedback_Gralch_Beta_1.3.xlsx

Analysis: Media: 6P_Gralch_Beta_1.3.doc

Gralch Extended User Test

Click here to go to page for Extended User Testing.

Functional Testing

Methodologies:

The test is conducted internally within the team. The testers will test the game based of the various scenario and test scripts. The results will then be recorded and analyzed before ratification is made.

Functional Test Scripts: 6P Functional Testing


Results and Findings: 6p_Functional_Testing


Incompatible devices

Since launching of our app to Google Play Store, it has expand our pool of user testers. It allow friends and public to download the app conveniently and this helps us to keep track a list of devices that are incompatible with our app. We are still investigating the incompatibility issues on some android phone and will release an update should we found a fix. Below is the list of incompatible devices found to date:

Reported incompatible devices Android version Remarks
Nexus 7 4.1 Only white screen with songs
HTC Desire S 4.0.3 Stucked at game menu
Samsung Galaxy Ace 2.3.5 Cannot launch app
Motorola Razr XT910 2.3.5 Cannot launch app (Resolved as of 27 November 2012)
Sony Xepria Lt15i 2.3.4 Load at splash screen then crash already
HTC Legend 2.3.3 Cannot launch app
LG Optimus 2.2 Cannot launch app
Huawei Ascend Y200 2.2 Cannot launch app