HeaderSIS.jpg

IS480 Team wiki: 2016T2 Team VI User Testing

From IS480
Jump to navigation Jump to search
Team VI Logo.PNG


HOME

 

ABOUT US

 

PROJECT OVERVIEW

 

PROJECT MANAGEMENT

 

DOCUMENTATION

 


Test Cases can be downloaded here.

User Testing 1

Objective:

  • Gather feedback regarding the user interface from existing users
  • Identify usability issues based on observations
  • Improve web application based on user testing results
  • Identify potential bugs that was not found during testing phase

Users: Wong Bing Xiang (Sponsor), Teacher
Venue: Upper Thomson
Date: 26/10/2015
Duration: 25 Minutes / User

Scope of User Testing 1:

  • Respective users to successfully create their own account based on access control rights
  • Branch Manager to successfully create: Parent, Student, Teacher
  • Teacher to successfully mark the attendance based on QR Code
  • Identify usability issues
  • Gain feedback from real users
  • Determine if user interface is intuitive


User Testing 1 Focus Group:

  • Branch Manager
  • Administrator
  • Teacher


User Testing 1 Results
Likes Dislikes
Functionality
  • Easy to Navigate
  • Users found it intuitive and could know exactly where to click
  • Fonts are good
  • Color Scheme could be more colorful
Functionality
  • Easy To Navigate
  • Not enough error catches in the system
  • Error Logs such as "Something Wrong, Please Try Again" are too generic and the user would not be able to know where is the origin of the error!


User Testing 2

Objective:

  • Gather feedback from students in SMU
  • Identify usability issues based on observations
  • Improve web application based on user testing results
  • Identify potential bugs that was not found during testing phase
  • Testing of functionality

Users: 15 SMU Students, 4 IT Consultant, 1 Digital Marketing Consultant
Venue: SMU , FYP Labs, Starbucks at Parkway
Date: 4,5,6 Feb 2016
Duration: 20 Minutes / User

Scope of User Testing 2

  • Branch Manager to successfully create a Parent and Student.
  • Branch Manager to create a schedule, and assign the student into a class
  • Teacher to mark the attendance of a student using the QR code
  • Teacher to create a feedback for the student
  • Parents to edit their own and child's information/li>
  • Parents to successfully receive an SMS, Email when their children has attended lesson
  • Parents to view the feedback given to their children by their teachers


User Testing 2 Focus Group:

  • Branch Manager
  • Parent
  • Teacher


User Testing 2 Results
Likes Dislikes
User Interface
  • Easy to Navigate
  • Users found it intuitive and could know exactly where to click
  • Application is useful for business owner
  • Yellow Colour theme too bright for some users
Functionality
  • Creating of respective users are straightforward
  • Viewing of users are easily accessible by users
  • Creation of schedule is useful and easy for administrator and teacher
  • Marking Attendance with QR code is very interesting
  • SMS and email idea is very parent centric, and parents will be more involved and aware of what is happening in the enrichment enter
  • Editing of parent details are easy
  • Should have a dropdown of NRIC for the administrator to choose from
  • Didn't like how we must create a diagnostic record in order to assign the student to a schedule
  • Results should be in A,B,C format instead of numerical
  • Have to remember the exact schedule event to assign the student to the schedule


AB Testing

AB Testing

Objective:

  • Compare two version of the web portal and identify the preferred version
  • Users to perform the task of viewing the students feedback
  • Improve aesthetics of web application
  • Participants Demographics:
  • 10 Actual Parents from the center
  • Experiment Design :
    Version A Version B
    VersionA.png
    VersionB.png
    Feedback is appended at the bottom after selection of each feedback. Users have to scroll up and down to view the feedback. Feedback is displayed in tabs. Can only view one feedback at a time

    Results For AB Testing can available at: AB Testing Results



User Testing 3

Objective:

  • Gather feedback from live users in Explore & Learn
  • Identify usability issues based on observations
  • Improve web application based on user testing results
  • Identify potential bugs that was not found during testing phase
  • Testing of functionality

Users: 1 Branch Manager, 2 Teachers, 15 Actual Students, 10 Parents
Venue: Explore & Learn Center
Date: 3 & 4 April 2016
Duration: 20 Minutes / User

Scope of User Testing 3

  • Branch Manager to successfully create a Parent and Student.
  • Branch Manager to create a schedule, and assign the student into a class
  • Branch Manager to create a marketing campaign
  • Branch Manager to view analysis of student
  • Student To redeem a gift from the redemption portal
  • Teacher to mark the attendance of a student using the QR code
  • Teacher to create a feedback for the student
  • Parents to edit their own and child's information/li>
  • Parents to successfully receive an SMS, Email when their children has attended lesson
  • Parents to view the feedback given to their children by their teachers
  • Parents to view the performance over time analysis of their children results


User Testing 3 Focus Group:

  • Branch Manager
  • Parent
  • Teacher
  • Students


User Testing 3 Results
  • 4/5 of the Teachers found it easy to mark the attendance
  • 5/5 of the teacher's found it useful to give the children the feedback
  • 15/15 Of the children target audience enjoyed marking attendance with the QR Code
  • 10/15 of the children target audience liked the banking system
  • 13/15 of the children target audience liked the redemption system


Likes Dislikes
User Interface
  • Color Scheme is good
  • Users found it intuitive and could know exactly where to click
  • Pirate Bank Scheme is nice
  • N/A
Functionality
  • Liked the concept of gift redemptions
  • Students are excited about QR Codes to sign in
  • SMS system is useful
  • Parents liked how they know when their student has attended lessons
  • Liked the performance over time analysis chart
  • Students want get the rewards fast and not inclined with banking system
  • Wanted a payment system
  • Dropdown list for students were not user friendly
  • Map analysis should have options for branch manager to choose the filter conditions
  • Heatmap marker not user friendly

|

Changes Made for UT3
Heatmap Function Dropdown list function
Screen Shot 2016-04-09 at 12.29.28 pm.png
Screen Shot 2016-04-09 at 12.29.36 pm.png
Insert display markers for heatmap created auto search function for all existing dropdown lists
Scheduling Colors Select Pop Up
Screen Shot 2016-04-09 at 12.43.41 pm.png
Screen Shot 2016-04-09 at 12.47.18 pm.png
Different Colors represents different classrooms for easy identification Created a onclick function which shows 'selected' when a user selects a schedule