Difference between revisions of "IS480 Team wiki: 2013T2 LittleTeam ProjectDocumentation Testing"
Jump to navigation
Jump to search
Qian.ye.2011 (talk | contribs) |
Qian.ye.2011 (talk | contribs) |
||
(4 intermediate revisions by 2 users not shown) | |||
Line 305: | Line 305: | ||
</gallery> | </gallery> | ||
− | ==User Testing 4== | + | =='''User Testing 4'''== |
<div align=left style="padding-right:50px; padding-left:50px;"> | <div align=left style="padding-right:50px; padding-left:50px;"> | ||
<font size=3 color="000099">'''Date''': 4 Apr 2014 <br/> | <font size=3 color="000099">'''Date''': 4 Apr 2014 <br/> | ||
Line 329: | Line 329: | ||
|[[Media:LittleTeam - UT 4 - Instructions&feedback - Set1.docx |Download]] | |[[Media:LittleTeam - UT 4 - Instructions&feedback - Set1.docx |Download]] | ||
|[[Media:LittleTeam - UT 4 - Instructions&feedback - Set1.docx |Download]] | |[[Media:LittleTeam - UT 4 - Instructions&feedback - Set1.docx |Download]] | ||
− | |[[Media:LittleTeam - UT 4 - observation form. | + | |[[Media:LittleTeam - UT 4 - observation form.xlsx|Download]] |
|- | |- | ||
|} | |} | ||
Line 363: | Line 363: | ||
|- | |- | ||
− | |scope="row" style=" text-align: left;"| When the user is in the specific lesson page, the tab of the browser shows " | + | |scope="row" style=" text-align: left;"| When the user is in the specific lesson page, the tab of the browser shows "Knowledge Challenge" instead. |
|scope="row" style=" text-align: left;"| Resolve the minor aesthetic bug. | |scope="row" style=" text-align: left;"| Resolve the minor aesthetic bug. | ||
Line 439: | Line 439: | ||
!scope="row" width="300" style=" text-align: center;"| Sprint 10 | !scope="row" width="300" style=" text-align: center;"| Sprint 10 | ||
|[[Media:IS480 LittleTeam TestCases Sprint10.xlsx|Download]] | |[[Media:IS480 LittleTeam TestCases Sprint10.xlsx|Download]] | ||
+ | |- | ||
+ | |||
+ | |- | ||
+ | !scope="row" width="300" style=" text-align: center;"| Sprint 11 | ||
+ | |[[Media:LittleTeam TestCases Sprint11.xlsx|Download]] | ||
+ | |- | ||
+ | |||
+ | |- | ||
+ | !scope="row" width="300" style=" text-align: center;"| Sprint 12 | ||
+ | |[[Media:LittleTeam TestCases Sprint12.xlsx|Download]] | ||
|- | |- | ||
|} | |} |
Latest revision as of 16:24, 14 April 2014
Home | The Team | Project Overview | Project Management | Project Documentation | Team Resources | Team Reflection |
---|
UI/UX Design | System Design | Testing | Administrative |
---|
Contents
Persona
Primary Persona
Secondary Persona
User Testing 1
Date: 20 Dec 2013
Location: LittleLives
Participant Group: LittleLives Staff
Participant Size: 8
Testing Documentations
Goals&Tasks&Data | Scripts | Instructions | Observation Forms | Questionnaires |
---|---|---|---|---|
Download | Download | Download | Download | Link |
Testing In Actions
Testing Results
Quantitative Data - Time taken to finish the task |
---|
Quantitative Data - No. of clicks to finish the task |
---|
Qualitative Data - Usability Rating |
---|
Frequently Seen Comments | Potential Problems & Improvements |
---|---|
"I could not find where to view my score" | The score display is not available and the score board design is not properly aligned. |
"The success messages are not obvious enough for the users" | Change the font size or color of success messages. |
"Accept and Reject buttons are not readable" | Change the font size and color of the buttons |
"The rules for knowledge are not easy and hard to remember" | Will implement 'Help' in later sprint when major functions are done |
"The navigation bar in Knowledge Challenge takes up too many spaces and is not professional" | Change to hidden navigation bar at bottom |
"There are too many unnecessary information in Scoreboard, which makes the overall design very crowded" | Limited the information displayed in Scoreboard and shift it to the left of the screen |
"I cannot view my status of challenges that I answered previously" | Create a new page, which displays "Challenge Status" |
User Testing 2
Date: 18 Jan 2014
Location: The Learning Lab (United Square)
Participant Group: Secondary Grade 2 - 4 Students
Participant Size: 12;
Testing Documentations
Goals&Tasks&Data | Scripts | Instructions - Set 1 | Instructions - Set 2 | Observation Forms |
---|---|---|---|---|
Download | Download | Download | Download | Download |
Testing In Actions
Testing Results
Quantitative Results
Qualitative Results
Top Comments | Potential Problems & Improvements |
---|---|
"The 3 horizontal lines don’t really clearly inform me of its purpose" | Remove the horizontal lines and standardize the menu format |
"There should be some instructions on choosing the questions for the knowledge challenge" | Add in step-by-step guides for users when sending the challenge |
"The landing page of Knowledge challenge is too blank and confusing for the first time user" | Change the layout of the landing page of knowledge challenge. |
"Very hard to find where to search friend" | Standardize the top tool bar and merge the search function in. |
Generally the system is hard to use for the first time user. Quite a few unnecessary pages and icons. | UI Revamp seems necessary, but need to further discuss with client and supervisor |
Comparing with UT1
User Testing 3
Date: 15 Feb 2014
Location: The Learning Lab (United Square)
Participant Group: Primary 5 - 6 Students
Participant Size: 12;
Testing Method: A/B Testing. This to...
- See the user preference on the side/top tool bar
- Test the difference between these two options statistically.
2 systems are identical except for...
- System A has only the side tool bar. Refer to here.
- System B has only the top tool bar. Refer to here.
Testing Documentations
Goals&Tasks&Data | Scripts | Instructions | Observation Forms |
---|---|---|---|
Download | Download | Download | Download |
Testing in Actions
Testing Results
Quantitative Results
T-test Analysis
Since two different groups of participants test our System A and System B, therefore we ran the statistical standard T-Test for between subjects.
- Test: Two-tailed t-test at 95% significance level (α=5%), 2 Sample assuming equal variance
- Independent Variable: System A vs. System B
- Dependent Variable: Mean time taken to complete the Ask Question task
- Let μ0 be the mean time to complete the task using System A(control).
- Let μ1 be the mean time to complete the task using System B(treatment).
- Hypotheses:
- Null Hypothesis h0: μ0=μ1
- Alternative Hypothesis: h1: μ0≠μ1
- P-value:
- As calculated using Excel formula: T.Test(array1,array2,2,3), p≈0.02=2%
- p < α, then significant, not by chance.
- Therefore we do reject H0.
- Conclusion: H0 is not true and thus the mean time taken in completing the tasks is significantly different, not by chance.
Qualitative Results
Top Problems Observed | Improvements |
---|---|
Calculation of the percentage of voting shows 101%, 1% which are not logically correct | Change the calculation methods in back-end. |
When sending collaborative challenge, students tend to select 3 (same as sending individual challenge) instead of 1. | The reminding note is not obvious, make the notes more obvious to users |
When sending challenge to individual person, user tend to fill in all the fields which are prepared for sending challenge to group only. | change the forms format to different tabs format to differentiate"To Another User"/"To another Class"/"To another School" |
The categories pictures are not clickable. | Make the pictures been able to click. |
Left-side bar is seldom used by the users. They tend to go back to home page and click on the modules or top bar | Together with the quantitative results and statistical analysis, it is highly suggested to keep the top tool bar instead of the side tool bar
|
Comparing with UT2
User Testing 4
Date: 4 Apr 2014
Location: Sengkang Public Library
Participant Group: Primary School P5 students
Participant Size: 13;
Testing Documentations
Goals&Tasks&Data | Scripts | Instructions - Set 1 | Instructions - Set 2 | Observation Forms |
---|---|---|---|---|
Download | Download | Download | Download | Download |
Testing in Actions
Testing Results
Quantitative Results
Qualitative Results
Top Problems Observed | Improvements |
---|---|
When creating a lesson in Little Classroom, the different colours of buttons are distracting for the users. It took them some time to figure out the functionalities of different buttons | Simplify and standardize the buttons in Little Classroom. |
When the user is in the specific lesson page, the tab of the browser shows "Knowledge Challenge" instead. | Resolve the minor aesthetic bug. |
Comparing with UT3
Comparing with Previous UTs
Internal Testing
Sprint | Test Cases |
---|---|
Sprint 1 | Download |
Sprint 2 | Download |
Sprint 3 | Download |
Sprint 4 | Download |
Sprint 5 | Download |
Sprint 6 | Download |
Sprint 7 | Download |
Sprint 8 | Download |
Sprint 9 | Download |
Sprint 10 | Download |
Sprint 11 | Download |
Sprint 12 | Download |