HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2013T2 LittleTeam ProjectDocumentation Testing"

From IS480
Jump to navigation Jump to search
Line 202: Line 202:
 
  Image:IS480 LittleTeam UT3 AvgnnCLD.png  
 
  Image:IS480 LittleTeam UT3 AvgnnCLD.png  
 
</gallery>
 
</gallery>
 +
 
====T-test Analysis====
 
====T-test Analysis====
 
<gallery widths=450px heights=350px perrow=3 mode ="packed">
 
<gallery widths=450px heights=350px perrow=3 mode ="packed">

Revision as of 00:09, 26 February 2014

LittleTeam Logo.jpg
Home The Team Project Overview Project Management Project Documentation Team Resources Team Reflection


UI/UX Design System Design Testing Administrative

Persona

Primary Persona

IS480 LittleTeam PrimaryPersona.JPG

Secondary Persona

IS480 LittleTeam SecondaryPersona.JPG

User Testing 1

Date: 20 Dec 2013

Location: LittleLives
Participant Group: LittleLives Staff
Participant Size: 8

Testing Documentations

Goals&Tasks&Data Scripts Instructions Observation Forms Questionnaires
Download Download Download Download Link

Testing In Actions

Testing Results

Quantitative Data - Time taken to finish the task
IS480 LittleTeam UT1 -r1.png
Quantitative Data - No. of clicks to finish the task
IS480 LittleTeam UT1 -r2.png
Qualitative Data - Usability Rating
IS480 LittleTeam UT1 -r3.png
Frequently Seen Comments Potential Problems & Improvements
"I could not find where to view my score" The score display is not available and the score board design is not properly aligned.
"The success messages are not obvious enough for the users" Change the font size or color of success messages.
"Accept and Reject buttons are not readable" Change the font size and color of the buttons
"The rules for knowledge are not easy and hard to remember" Will implement 'Help' in later sprint when major functions are done
"The navigation bar in Knowledge Challenge takes up too many spaces and is not professional" Change to hidden navigation bar at bottom
"There are too many unnecessary information in Scoreboard, which makes the overall design very crowded" Limited the information displayed in Scoreboard and shift it to the left of the screen
"I cannot view my status of challenges that I answered previously" Create a new page, which displays "Challenge Status"

User Testing 2

Date: 18 Jan 2014

Location: The Learning Lab (United Square)
Participant Group: Secondary Grade 2 - 4 Students
Participant Size: 12;

Testing Documentations

Goals&Tasks&Data Scripts Instructions - Set 1 Instructions - Set 2 Observation Forms
Download Download Download Download Download

Testing In Actions

Testing Results

Quantitative Results

Comparing with UT1

User Testing 3

Testing Documentations

Goals&Tasks&Data Scripts Instructions Observation Forms
Download Download Download Download

Testing in Actions

Testing Results

Quantitative Results

T-test Analysis

Since two different groups of participants test our System A and System B, therefore we ran the statistical standard T-Test for between subjects.

  • Test: Two-tailed t-test at 95% significance level (α=5%)
  • Independent Variable: System A vs. System B
  • Dependent Variable: Mean time taken to complete the Ask Question task
    • Let μ0 be the mean time to complete the task using System A(control).
    • Let μ1 be the mean time to complete the task using System B(treatment).


  • Hypotheses:
    • Null Hypothesis h0: μ0≠μ1
    • Alternative Hypothesis: h1: μ0=μ1


  • P-value:
    • As calculated using Excel formula: T.Test(array1,array2,2,3), p≈0.02=4.9%
    • p < α, then significant, not by chance.
    • Therefore we do not reject H0.


  • Conclusion: H0 is true and thus the mean time taken in completing the tasks is significantly different, not by chance.

Comparing with UT2

Internal Testing

Sprint Test Cases
Sprint 1 Download
Sprint 2 Download
Sprint 3 Download
Sprint 4 Download
Sprint 5 Download
Sprint 6 Download
Sprint 7 Download
Sprint 8 Download