HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2013T2 LittleTeam ProjectDocumentation Testing"

From IS480
Jump to navigation Jump to search
Line 342: Line 342:
 
===Testing Results===
 
===Testing Results===
 
====Quantitative Results====
 
====Quantitative Results====
 +
====Comparing with Previous UT====
 +
<gallery widths=450px heights=350px perrow=3 mode ="packed">
 +
LittleTeam- UT4- charts1.png
 +
</gallery>
  
 
=='''Internal Testing'''==
 
=='''Internal Testing'''==

Revision as of 16:59, 8 April 2014

LittleTeam Logo.jpg
Home The Team Project Overview Project Management Project Documentation Team Resources Team Reflection


UI/UX Design System Design Testing Administrative

Persona

Primary Persona

IS480 LittleTeam PrimaryPersona.JPG

Secondary Persona

IS480 LittleTeam SecondaryPersona.JPG

User Testing 1

Date: 20 Dec 2013
Location: LittleLives
Participant Group: LittleLives Staff
Participant Size: 8

Testing Documentations

Goals&Tasks&Data Scripts Instructions Observation Forms Questionnaires
Download Download Download Download Link

Testing In Actions

Testing Results

Quantitative Data - Time taken to finish the task
IS480 LittleTeam UT1 -r1.png
Quantitative Data - No. of clicks to finish the task
IS480 LittleTeam UT1 -r2.png
Qualitative Data - Usability Rating
IS480 LittleTeam UT1 -r3.png
Frequently Seen Comments Potential Problems & Improvements
"I could not find where to view my score" The score display is not available and the score board design is not properly aligned.
"The success messages are not obvious enough for the users" Change the font size or color of success messages.
"Accept and Reject buttons are not readable" Change the font size and color of the buttons
"The rules for knowledge are not easy and hard to remember" Will implement 'Help' in later sprint when major functions are done
"The navigation bar in Knowledge Challenge takes up too many spaces and is not professional" Change to hidden navigation bar at bottom
"There are too many unnecessary information in Scoreboard, which makes the overall design very crowded" Limited the information displayed in Scoreboard and shift it to the left of the screen
"I cannot view my status of challenges that I answered previously" Create a new page, which displays "Challenge Status"

User Testing 2

Date: 18 Jan 2014 Location: The Learning Lab (United Square)
Participant Group: Secondary Grade 2 - 4 Students
Participant Size: 12;

Testing Documentations

Goals&Tasks&Data Scripts Instructions - Set 1 Instructions - Set 2 Observation Forms
Download Download Download Download Download

Testing In Actions

Testing Results

Quantitative Results

Qualitative Results

Top Comments Potential Problems & Improvements
"The 3 horizontal lines don’t really clearly inform me of its purpose" Remove the horizontal lines and standardize the menu format
"There should be some instructions on choosing the questions for the knowledge challenge" Add in step-by-step guides for users when sending the challenge
"The landing page of Knowledge challenge is too blank and confusing for the first time user" Change the layout of the landing page of knowledge challenge.
"Very hard to find where to search friend" Standardize the top tool bar and merge the search function in.
Generally the system is hard to use for the first time user. Quite a few unnecessary pages and icons. UI Revamp seems necessary, but need to further discuss with client and supervisor

Comparing with UT1

User Testing 3

Date: 15 Feb 2014 Location: The Learning Lab (United Square)
Participant Group: Primary 5 - 6 Students
Participant Size: 12;
Testing Method: A/B Testing. This to...

  • See the user preference on the side/top tool bar
  • Test the difference between these two options statistically.


2 systems are identical except for...

  • System A has only the side tool bar. Refer to here.
  • System B has only the top tool bar. Refer to here.

Testing Documentations

Goals&Tasks&Data Scripts Instructions Observation Forms
Download Download Download Download

Testing in Actions

Testing Results

Quantitative Results

T-test Analysis

Since two different groups of participants test our System A and System B, therefore we ran the statistical standard T-Test for between subjects.

  • Test: Two-tailed t-test at 95% significance level (α=5%), 2 Sample assuming equal variance
  • Independent Variable: System A vs. System B
  • Dependent Variable: Mean time taken to complete the Ask Question task
    • Let μ0 be the mean time to complete the task using System A(control).
    • Let μ1 be the mean time to complete the task using System B(treatment).


  • Hypotheses:
    • Null Hypothesis h0: μ0=μ1
    • Alternative Hypothesis: h1: μ0≠μ1


  • P-value:
    • As calculated using Excel formula: T.Test(array1,array2,2,3), p≈0.02=2%
    • p < α, then significant, not by chance.
    • Therefore we do reject H0.


  • Conclusion: H0 is not true and thus the mean time taken in completing the tasks is significantly different, not by chance.

Qualitative Results

Top Problems Observed Improvements
Calculation of the percentage of voting shows 101%, 1% which are not logically correct Change the calculation methods in back-end.
When sending collaborative challenge, students tend to select 3 (same as sending individual challenge) instead of 1. The reminding note is not obvious, make the notes more obvious to users
When sending challenge to individual person, user tend to fill in all the fields which are prepared for sending challenge to group only. change the forms format to different tabs format to differentiate"To Another User"/"To another Class"/"To another School"
The categories pictures are not clickable. Make the pictures been able to click.
Left-side bar is seldom used by the users. They tend to go back to home page and click on the modules or top bar Together with the quantitative results and statistical analysis, it is highly suggested to keep the top tool bar instead of the side tool bar


Comparing with UT2

User Testing 4

Date: 4 Apr 2014
Location: Sengkang Public Library
Participant Group: Primary School P5 students
Participant Size: 13;

Testing Documentations

Goals&Tasks&Data Scripts Instructions - Set 1 Instructions - Set 2 Observation Forms
Download Download Download Download Download

Testing in Actions

Testing Results

Quantitative Results

Comparing with Previous UT

Internal Testing

Sprint Test Cases
Sprint 1 Download
Sprint 2 Download
Sprint 3 Download
Sprint 4 Download
Sprint 5 Download
Sprint 6 Download
Sprint 7 Download
Sprint 8 Download
Sprint 9 Download
Sprint 10 Download