HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2012T2 5 B 1 G Webapp User Tests"

From IS480
Jump to navigation Jump to search
(New page: <div class="center" style="width:auto; margin-left:auto; margin-right:auto; > Image:5B1G_Logo.png</div> <font face="Avenir" > <!--Navigation--> {| style="background-color:none; color...)
 
Line 380: Line 380:
  
 
[[Image:5B1G UT 3 problem.png|580px]]
 
[[Image:5B1G UT 3 problem.png|580px]]
 +
 +
=<div style="width: 100%; filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#009999', endColorstr='#009999'); background: -webkit-gradient(linear, left top, left bottom, from(#009999), to(#009999)); background: -moz-linear-gradient(top, #009999, #009999); padding:3px; margin-top: 15px; line-height: 1.2em; color:white">Webapp User Test 4(Cathay retailers)</div>=
 +
 +
===<div style="width: 100%; filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#00BBBB', endColorstr='#00BBBB'); background: -webkit-gradient(linear, left top, left bottom, from(#00BBBB), to(#00BBBB)); background: -moz-linear-gradient(top, #00BBBB, #00BBBB); padding:3px; margin-top: 15px; line-height: 1.2em; color:white">How We Conducted the UT</div>===
 +
 +
====Objectives====
 +
*To obtain feedback from our retailers with regards to the usability of the retailer admin system with the updated changes from the last user test
 +
 +
====Details: ====
 +
*Participants: 6 retailers
 +
*Venue: The Cathay
 +
*Date: 17th Apr 2013 (Wedneday)
 +
*Duration: 6 hours (each individual: 20-30mins)
 +
 +
====Method====
 +
The retailer admin system was tested using a laptop . Each participant was given the [[media: 5B1G_Web_UT4_Instruction_sheet.pdf| Web UT4 Instruction Sheet]] and asked to circle how easy it was to complete each test case.
 +
 +
====Data collection====
 +
Collecting of qualitative metrics
 +
*Facilitators will observe how the participants use the retail admin system during the testing procedure.
 +
*Upon completion of the web user test, the participant will be asked to give their feedback on the usability of the application.
 +
 +
Collecting of quantitative metrics
 +
* Upon completion of the UT, the participant will be asked to rate, on a scale of 1 to 5, how easy the task is and to give their feedback on the functionality and the usability of the application.
 +
 +
====Features Tested for Retail Admin System====
 +
{| class="wikitable" style="text-align: center; height:25px"
 +
|+
 +
|-
 +
! scope="col"  width="50" style="background:#CCCCCC| S/N
 +
! scope="col" width="250" style="background:#CCCCCC| Feature
 +
|-
 +
!scope="row"  style=" text-align: center;"| 1
 +
| Create a retail account
 +
|-
 +
!scope="row"  style=" text-align: center;"| 2
 +
| Login
 +
|-
 +
!scope="row"  style=" text-align: center;"| 3
 +
| Upload new E-coupon
 +
|-
 +
!scope="row"  style=" text-align: center;"| 4
 +
| Crop new E-coupon
 +
|-
 +
!scope="row"  style=" text-align: center;"| 5
 +
| Edit Pending E-coupon
 +
|-
 +
!scope="row"  style=" text-align: center;"| 6
 +
| Copy E-coupon
 +
|-
 +
!scope="row"  style=" text-align: center;"| 7
 +
| Delete E-coupon
 +
|-
 +
!scope="row"  style=" text-align: center;"| 8
 +
| View Published E-coupon statistics
 +
|-
 +
!scope="row"  style=" text-align: center;"| 9
 +
| View or export BI report
 +
|-
 +
!scope="row"  style=" text-align: center;"| 10
 +
| Delete E-coupon
 +
|-
 +
!scope="row"  style=" text-align: center;"| 11
 +
| Logout
 +
|-
 +
|}
 +
 +
===<div style="width: 100%; filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#00BBBB', endColorstr='#00BBBB'); background: -webkit-gradient(linear, left top, left bottom, from(#00BBBB), to(#00BBBB)); background: -moz-linear-gradient(top, #00BBBB, #00BBBB); padding:3px; margin-top: 15px; line-height: 1.2em; color:white">Results</div>===
 +
 +
====Download the results here: ====
 +
* [[Media:WebUT4_Results.pdf| Web UT4 Compiled Results]]

Revision as of 18:01, 19 April 2013

5B1G Logo.png


Home

Our Team/Sponsors

Project Overview

Project Management

Project Documentation

Usability Documentation

Learning Outcomes


Count Me In User Tests

Webapp User Tests

Prototypes & Mockups

Webapp User Test 1

How We Conducted the UT

Objectives

The main objectives of this user test are:

  • To obtain feedback from our users with regards to the layout and business logic in our application

Details:

  • Participants: 2 retailers
  • Venue: SMU, The Basement Café
  • Date: 22nd Jan 2013 (Tuesday)
  • Duration: 2 hours
  • Environment: “Sit at a table” setting

Method

We conducted the user test using a low-fidelity paper prototype using the mock up designs of the web application and the participants were given the freedom to explore the application by themselves.

Data collection

Collecting of qualitative metrics

  • We will observe how the participants use the application during the testing procedure.
  • Upon completion of the paper prototype, the participant will be asked to give their feedback on usability and business rules behind the application.

Features Tested

S/N Feature
1 Login with an account
2 Upload e-coupons
3 Edit pending e-coupons
4 View published e-coupons
5 View expired e-coupons
6 View Business Intelligence for published and expired e-coupons
7 Logout of application

Gallery

   

5B1G IMG 5073.JPG

5B1G IMG 5074.JPG

5B1G IMG 5075.JPG

IMG 5076.JPG

5B1G IMG 5077.JPG

5B1G IMG 5078.JPG

Results

Results

Download link available here: Web UT Results

Observations

S/N Observation
1 The user did not have any major problems regarding the usability the application
2 They were more concerned about the business logic, they asked about whether they need to upload or select an individual product, because sometimes they offer discounts like “10% off all mains” rather than discount for an individual product
3 Overall, they were quite fascinated by the analytics that the application can produce

Feedback

S/N Feedback
1 “Tagging an e-coupon to a product may not be always applicable, because sometimes we just want to entice people to come and patronize the restaurants, thus we may have a promotion for bulk items”
2 “Maybe you could limit the number of coupons we can give out because sometimes when we conduct an offer, we do not have sufficient stock”

Changes Made

Features Tested

S/N Feedback Change Made
1 “Tagging an e-coupon to a product may not be always applicable, because

sometimes we just want to entice people to come and patronize the restaurants, thus we may have a promotion for bulk items”

The user does not need to tag a product to the coupon. We reduced it to a 1-step upload process instead of a 2-step upload process.
2 ““Maybe you could limit the number of coupons we can give out because

sometimes when we conduct an offer, we do not have sufficient stock”

We included a new field for the retailer to enter the limit on the number of coupons (optional)

Webapp User Test 2

How We Conducted the UT

Objectives

  • To obtain feedback from our users with regards to the usability of the retail admin system
  • To create an application that is user-friendly for retailers

Details:

  • Participants: 10 users
  • Venue: SIS SR 2-4
  • Date: 25th Mar 2013 (Monday)
  • Duration: 4 hours (each individual: 20-30mins)

Method

The actual application was tested this time using a laptop. Each participant was given the Web UT2 Instruction Sheet and asked to circle how easy it was to complete each test case.

Data collection

Collecting of qualitative metrics

  • Facilitators will observe how the participants use the retail admin system during the testing procedure.
  • Upon completion of the web user test, the participant will be asked to give their feedback on the usability of the application.

Collecting of quantitative metrics

  • Upon completion of the UT, the participant will be asked to rate, on a scale of 1 to 5, how easy the task is and to give their feedback on the functionality and the usability of the application.

Features Tested for Retail Admin System

S/N Feature
1 Create a retail account
2 Login
3 Upload new E-coupon
4 Edit Pending E-coupon
5 Copy E-coupon
6 Delete E-coupon
7 View Published E-coupon statistics
8 Logout

Results

Download the results here:

Compiled Problems & Proposed Solutions

5B1G WebUT2 Prob1.png

5B1G WebUT2 Prob2.png

Gallery

   

5B1G WebUT2 1.JPG

5B1G WebUT2 2.JPG

5B1G WebUT2 3.JPG

5B1G WebUT2 4.JPG

5B1G WebUT2 5.JPG

5B1G WebUT2 6.JPG

5B1G WebUT2 7.JPG

5B1G WebUT2 8.JPG

5B1G WebUT2 9.JPG

Webapp User Test 3 (Cathay retailers)

How We Conducted the UT

Objectives

  • To obtain feedback from our retailers with regards to the usability of the retailer admin system
  • To create an application that is user-friendly for retailers

Details:

  • Participants: 6 retailers
  • Venue: The Cathay
  • Date: 10th Apr 2013 (Wedneday)
  • Duration: 6 hours (each individual: 20-30mins)

Method

The retailer admin system was tested using a laptop . Each participant was given the Web UT3 Instruction Sheet and asked to circle how easy it was to complete each test case.

Data collection

Collecting of qualitative metrics

  • Facilitators will observe how the participants use the retail admin system during the testing procedure.
  • Upon completion of the web user test, the participant will be asked to give their feedback on the usability of the application.

Collecting of quantitative metrics

  • Upon completion of the UT, the participant will be asked to rate, on a scale of 1 to 5, how easy the task is and to give their feedback on the functionality and the usability of the application.

Features Tested for Retail Admin System

S/N Feature
1 Create a retail account
2 Login
3 Upload new E-coupon
4 Edit Pending E-coupon
5 Copy E-coupon
6 Delete E-coupon
7 View published E-coupon statistics
8 Delete E-coupon
9 Logout

Results

Download the results here:

Compiled Problems & Proposed Solutions

5B1G UT 3 problem.png

Webapp User Test 4(Cathay retailers)

How We Conducted the UT

Objectives

  • To obtain feedback from our retailers with regards to the usability of the retailer admin system with the updated changes from the last user test

Details:

  • Participants: 6 retailers
  • Venue: The Cathay
  • Date: 17th Apr 2013 (Wedneday)
  • Duration: 6 hours (each individual: 20-30mins)

Method

The retailer admin system was tested using a laptop . Each participant was given the Web UT4 Instruction Sheet and asked to circle how easy it was to complete each test case.

Data collection

Collecting of qualitative metrics

  • Facilitators will observe how the participants use the retail admin system during the testing procedure.
  • Upon completion of the web user test, the participant will be asked to give their feedback on the usability of the application.

Collecting of quantitative metrics

  • Upon completion of the UT, the participant will be asked to rate, on a scale of 1 to 5, how easy the task is and to give their feedback on the functionality and the usability of the application.

Features Tested for Retail Admin System

S/N Feature
1 Create a retail account
2 Login
3 Upload new E-coupon
4 Crop new E-coupon
5 Edit Pending E-coupon
6 Copy E-coupon
7 Delete E-coupon
8 View Published E-coupon statistics
9 View or export BI report
10 Delete E-coupon
11 Logout

Results

Download the results here: