Difference between revisions of "IS480 Team wiki: 2016T1 IPMAN User Testing 2"
Jump to navigation
Jump to search
Line 85: | Line 85: | ||
<div style="font-family: Garamond; font-size:16px"> | <div style="font-family: Garamond; font-size:16px"> | ||
<ul> | <ul> | ||
− | <li> | + | <li>Gather feedback from business development unit for high order functions</li> |
− | <li> | + | <li>Assess usability of marketing module in terms of efficient and effective sending of email campaign</li> |
+ | <li>Evaluate ease of handling exceptional cases during packing process</li> | ||
</ul> | </ul> | ||
</div> | </div> |
Revision as of 23:07, 2 October 2016
Contents
Test Plan
Venue: Hook Coffee Office @ Jalan Besar 191A
Date: 13 September 2016, Tuesday
Time: 7.30pm
Duration: ~30 minutes per user
Number of Participant(s): 3
User Test: Instructions can be found here
Objectives
- Gather feedback from business development unit for high order functions
- Assess usability of marketing module in terms of efficient and effective sending of email campaign
- Evaluate ease of handling exceptional cases during packing process
Scope of UAT 2
- Process orders - Printing of specific user's order label and address
- Edit customer preferences
- View backlog list of orders
- Smart marketing module - Retrieve list from MailChimp
- Smart marketing module - Create new list
- Smart marketing module - Retrieve all campaigns from MailChimp
- Smart marketing module - View individual campaign results
Procedures
Participants are to think aloud as they follow through the instructions given for the user testing. Team IPMAN will be there to record down the participants’ behaviours. Participants are to leave their feedback at the end of their user testing. Team IPMAN will conclude the user testing by asking the participants questions with regards to their behaviours and thought process as they navigate through KOPIKaki platform.
S/N | Goals | Reached? |
---|---|---|
1 | Participants should be able to Add active customers into the mailing list “HAPPY 225 Days” | Goal reached. All participants were able to complete the task. |
2 | Participants should be able to create a mailing list called “Welcome Back! From <Insert Your Name>”. | Goal reached. All participants were able to complete the task. One participant took a little longer to find the button. |
3 | Participants should be able to add active and inactive customers for one month for the list “Welcome Back! From <Insert Your Name>” then send a campaign to them via MailChimp. | Goal reached. All participants were able to complete the task. |
4 | Participants should be able to view the campaign results for “last order less than 90 days ago but more than 30days 11th Sep. | Goal reached. All participants were able to complete the task. |
5 | Participants should be able to Find the customer XYZ and change the preference of Koh Chuqian (Faye) / Wong Wai Tuck (Ernest) coffee type into Ciao Bella and flavour into Caramel. | Goal reached. All participants were able to complete the task. One participant was initially not able to find the navigation button. |
6 | Participants should be able to view the orders that you have not finished packing yesterday. | Goal reached. All participants were able to complete the task. |
7 | Participants should be able to find Keefe Tan and print out his/her address. | Goal reached. All participants were able to complete the task. |
8 | Participants should be able to find Jeremy Ong and print out his/her label. | Goal reached. All participants were able to complete the task. |
Key Findings
Functions | Users’ Behaviour | Changes to be Made |
---|---|---|
User Interface | Participants were confused by how the buttons were named for the mailing list functionality | Ensure that button naming was more intuitive and straightforward |
User Interface | Participants feedback that campaign charts displayed were not ordered according to the marketing funnel | Ensured that email campaign pie charts were ordered in order of the marketing funnel (click rates, open rates, get started rates and actual sales rates) |
User Interface | Participants highlighted they were unable to view the actual numbers without hovering over pie chart | Placed actual numbers for each portion of the pie chart on the legend so that users can view actual numbers without hovering over the pie chart |
User Interface | Participants generally found KOPIKaki application easy to use | - |
Functions | Users’ Comments | Changes to be Made |
---|---|---|
Requirement Refinement | Sponsor requested for individual labels to be downloadable so that they can verify the size of labels before printing | IPMAN development team to relook into logic to enable individual labels to be downloaded before printing occurs |
Overall Results/Comments
- More general common terms can be used to further enhance user experience and make our application more intuitive and user-friendly.
- Clients were pleased with Team IPMAN's progress and commended on the ease of use of our application.
- The list of pre-UAT and post-UAT changes can be found below: