HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki:2018T1 Mockingjay User Testing 1"

From IS480
Jump to navigation Jump to search
 
(12 intermediate revisions by the same user not shown)
Line 79: Line 79:
 
<b>Duration:</b> ~ 20 minutes per user<br/>
 
<b>Duration:</b> ~ 20 minutes per user<br/>
 
<b>Total Number of Participants :</b> 4 <br/>
 
<b>Total Number of Participants :</b> 4 <br/>
<b>User Test:</b> Instructions can be found [https://drive.google.com/open?id=17Dbv4RguMXc-PyrbOD2GlmYdLnqiSLkO here] <br/>
+
<b>User Test:</b> Instructions can be found [https://drive.google.com/drive/folders/17Dbv4RguMXc-PyrbOD2GlmYdLnqiSLkO?usp=sharing here] <br/>
 
</p>
 
</p>
 
</div>
 
</div>
Line 111: Line 111:
 
<div style="font-family: Verdana">
 
<div style="font-family: Verdana">
 
<p>
 
<p>
Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. Team Ducky King will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing. Team Ducky King will conclude the user testing by asking the participants questions with regards to Flow Middleware platform.
+
Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. A member from Mockingjay will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing.
 
</p>
 
</p>
 
</div>
 
</div>
Line 209: Line 209:
 
<b>Duration:</b> ~ 20 minutes per user<br/>
 
<b>Duration:</b> ~ 20 minutes per user<br/>
 
<b>Total Number of Participants :</b> 7 <br/>
 
<b>Total Number of Participants :</b> 7 <br/>
<b>User Test:</b> Instructions can be found [ soon] <br/>
+
<b>User Test:</b> Instructions can be found [https://drive.google.com/drive/folders/1THm7aiUzG14PGpb6I6l1eSIx0mic3NUu?usp=sharing here] <br/>
 
</p>
 
</p>
 
</div>
 
</div>
Line 237: Line 237:
 
</p>
 
</p>
 
</div>
 
</div>
 +
 +
=== Procedures ===
 +
<div style="font-family: Verdana">
 +
<p>
 +
Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. A member from Mockingjay will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing.
 +
</p>
 +
</div>
 +
<center>
 +
{|class="wikitable" style="font-family: Verdana; background-color:#FFFFFF; width: 1000px;" align="center"
 +
|-
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="100pt" | S/N
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="400pt" | Goals
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="500pt" | Reached?
 +
|-
 +
|style="text-align: center;"| 1
 +
|style="text-align: left;"| Participants should be able to add a new supplier into the inventory management system.
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 2
 +
|style="text-align: left;"| Participants should be able to add a new raw bean that is supplied by the supplier.
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 3
 +
|style="text-align: left;"| Participants should be able to add a new coffee equipment that is supplied by the supplier that you had just created.
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 4
 +
|style="text-align: left;"| Participants should be able to edit the contact details of an existing supplier in the system with the test input details..
 +
|style="text-align: left;"| Goal reached. Participant were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 5
 +
|style="text-align: left;"| Participants should be able to delete an existing supplier in the system with the test input details.
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 6
 +
|style="text-align: left;"| Participants should be able to create a new delivery form with the test input details.
 +
|style="text-align: left;"| Goal reached. Participant was able to complete the task.
 +
|-
 +
|style="text-align: center;"| 7
 +
|style="text-align: left;"| Participants should be able to edit the delivery form to input consignment date.
 +
|style="text-align: left;"| Goal reached. Participant was able to complete the task.
 +
|-
 +
|style="text-align: center;"| 8
 +
|style="text-align: left;"| Participants should be able to create a purchasing order form based on the delivery form.
 +
|style="text-align: left;"| Goal reached. Participant was able to complete the task.
 +
|-
 +
|}
 +
</center>
 +
 +
=== Key Findings ===
 +
<center>
 +
{|class="wikitable" style="font-family: Verdana; background-color:#FFFFFF; width: 1000px;" align="center"
 +
|-
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="100pt" | Category
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="400pt" | Users' Comment
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="500pt" | Changes to be made
 +
|-
 +
|style="text-align: center;"| UI/UX
 +
|style="text-align: left;"| Sponsor highlighted to display the price of the bean in the purchasing form.
 +
|style="text-align: left;"| Mockingjay front-end team to display the price for each bean.
 +
|-
 +
|style="text-align: center;"| Cosmetic
 +
|style="text-align: left;"| Sponsor highlighted that some of the terminology used was inaccurate, such as 'Delivery'.
 +
|style="text-align: left;"| Mockingjay front-end team to revise the terminology and make the relevant changes.
 +
|-
 +
|style="text-align: center;"| Cosmetic
 +
|style="text-align: left;"| Sponsor highlighted to combine the different purchase form IDs into one row.
 +
|style="text-align: left;"| Mockingjay front-end team to make this minor edit.
 +
|-
 +
|style="text-align: center;"| Cosmetic
 +
|style="text-align: left;"| Sponsor requested to remove the pop-ups of successful alert.
 +
|style="text-align: left;"| Mockingjay front end team to make this minor edit.
 +
|-
 +
|}
 +
</center>
 +
 +
=== Overall Results/Comments ===
 +
<div style="font-family: Verdana; ">
 +
<p>
 +
<ul>
 +
<li>Sponsor is satisfied with the team's progress</li>
 +
<li>To send him updates through communication channels (Telegram, email)</li>
 +
</ul>
 +
</p>
 +
</div>
 +
 +
== <div style="background: #FF7504; padding: 15px; font-weight: bold; line-height: 0.3em; font-size:18px; font-family:helvetica" ><font color= #FFFFFF>User Test 3</font></div> ==
 +
 +
=== Test Plan ===
 +
<div style="font-family: Verdana;">
 +
<p>
 +
<b>Venue:</b> Hook Coffee Office @ 15-4 Jalan Riang<br/>
 +
<b>Date:</b> 12 November 2018<br/>
 +
<b>Time:</b> 1.00PM<br/>
 +
<b>Duration:</b> ~ 40 minutes per user<br/>
 +
<b>Total Number of Participants :</b> 12 <br/>
 +
<b>User Test:</b> Instructions can be found [https://drive.google.com/drive/folders/17lkag4S-5auRKuq8OHmti_atV9vJnB1P?usp=sharing here] <br/>
 +
</p>
 +
</div>
 +
 +
=== Objectives===
 +
<div style="font-family: Verdana;>
 +
<p>
 +
<ul>
 +
<li>To go through all the functionalities</li>
 +
<li>To do a parallel comparison between the tasks using the existing processes and with the system</li>
 +
<li>To ensure no gaps in the business process</li>
 +
</ul>
 +
</p>
 +
</div>
 +
 +
=== Scope of User Test 3===
 +
<div style="font-family: Verdana;">
 +
<p>
 +
<ul>
 +
<li>Create New Supplier</li>
 +
<li>Generate a Purchase Order Form</li>
 +
<li>View, Edit & Delete Inventory</li>
 +
<li>Add New Raw Bean</li>
 +
<li>Add New Coffee Equipment</li>
 +
<li>Predictive Analysis</li>
 +
<li>Create New Delivery Form</li>
 +
</ul>
 +
</p>
 +
</div>
 +
 +
=== Procedures ===
 +
<div style="font-family: Verdana">
 +
<p>
 +
Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. A member from Mockingjay will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing.
 +
</p>
 +
</div>
 +
<center>
 +
{|class="wikitable" style="font-family: Verdana; background-color:#FFFFFF; width: 1000px;" align="center"
 +
|-
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="100pt" | S/N
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="400pt" | Goals
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="500pt" | Reached?
 +
|-
 +
|style="text-align: center;"| 1
 +
|style="text-align: left;"| Participants should be able to add a new raw bean supplier.
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 2
 +
|style="text-align: left;"|  Participants should be able to generate a new Purchasing Order (PO) form with the newly created supplier.
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 3
 +
|style="text-align: left;"| Participants should be able to view an existing supplier and update its details.
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 4
 +
|style="text-align: left;"| Participants should be able to view overview of beans and inventory levels.
 +
|style="text-align: left;"| Goal reached. Participant were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 5
 +
|style="text-align: left;"| Participants should be able to add a new raw bean.
 +
|style="text-align: left;"| Goal reached. Participants were able to complete the task.
 +
|-
 +
|style="text-align: center;"| 6
 +
|style="text-align: left;"| Participants should be able to add a new blending formula.
 +
|style="text-align: left;"| Goal reached. Participant was able to complete the task.
 +
|-
 +
|style="text-align: center;"| 7
 +
|style="text-align: left;"| Participants should be able to add a new blend bean.
 +
|style="text-align: left;"| Goal reached. Participant was able to complete the task.
 +
|-
 +
|style="text-align: center;"| 8
 +
|style="text-align: left;"| Participants should be able to predict how much coffee beans to roast for upcoming week of an existing raw bean.
 +
|style="text-align: left;"| Goal reached. Participant was able to complete the task.
 +
|-
 +
|style="text-align: center;"| 9
 +
|style="text-align: left;"| Participants should be able to create a new delivery form with specific details.
 +
|style="text-align: left;"| Goal reached. Participant was able to complete the task.
 +
|-
 +
|style="text-align: center;"| 10
 +
|style="text-align: left;"| Participants should be able to update an existing delivery form with specific details.
 +
|style="text-align: left;"| Goal reached. Participant was able to complete the task.
 +
|-
 +
|}
 +
</center>
 +
 +
=== Key Findings ===
 +
<center>
 +
{|class="wikitable" style="font-family: Verdana; background-color:#FFFFFF; width: 1000px;" align="center"
 +
|-
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="100pt" | Category
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="400pt" | Users' Comment
 +
! style="color:#ecf0f1; background-color:#FF7504;" width="500pt" | Changes to be made
 +
|-
 +
|style="text-align: center;"| Usability & Design
 +
|style="text-align: left;"| For the PO form remove the receiver's signature in the PDF.
 +
|style="text-align: left;"| Mockingjay team to modify the design of the PO form to remove the portion of the receiver's signature and add a computer-generated signature authentication.
 +
|-
 +
|style="text-align: center;"| Design
 +
|style="text-align: left;"| Sponsor highlighted to display two columns in the PO form - one column is the quantity of bags, one column is how many kg in a bag.
 +
|style="text-align: left;"| Mockingjay team to make the relevant changes.
 +
|-
 +
|style="text-align: center;"| Technicality
 +
|style="text-align: left;"| Sponsor highlighted that for blend bean component, it may be whole bean, not just ground beans.
 +
|style="text-align: left;"| Mockingjay back-end team to add whole beans for blend beans, on top of ground beans.
 +
|-
 +
|style="text-align: center;"| Technicality
 +
|style="text-align: left;"| Sponsor requested to automatically deduct the amount of coffee beans from the original amount, not blend amount.
 +
|style="text-align: left;"| Mockingjay back-team to make the relevant changes.
 +
|-
 +
|}
 +
</center>

Latest revision as of 00:36, 20 November 2018

Logo new.png


Mockingjay home.png   HOME

 

Mockingjay aboutus.png   ABOUT US

 

Mockingjay diagram.png   PROJECT OVERVIEW

 

Mockingjay project.png   PROJECT MANAGEMENT

 

Mockingjay documentation.png   DOCUMENTATION


 



User Test 1

Test Plan

Venue: Hook Coffee Office @ 15-4 Jalan Riang
Date: 7 August 2018
Time: 2.00PM
Duration: ~ 20 minutes per user
Total Number of Participants : 4
User Test: Instructions can be found here

Objectives

  • To give the participants an idea of the system and its purpose
  • To identify any usability improvements
  • To identify missing functionality

Scope of User Test 1

  • Login
  • View Inventory of Raw Beans
  • Edit Inventory of Raw Beans
  • Add Raw Bean
  • Create New Coffee Blend
  • View Overview of Coffee Beans and products in a report

Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. A member from Mockingjay will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing.

S/N Goals Reached?
1 Participants should be able to log into the system as their specified role. Goal reached. Participants were able to complete the task.
2 Participants should be able to view the current inventory of a specified raw coffee bean. Goal reached. Participants were able to complete the task.
3 Participants should be able to edit a specified raw coffee bean. Goal reached. Participants were able to complete the task.
4 Participants should be able to add a new raw coffee bean. Goal reached. Participant were able to complete the task.
5 Participants should be able to create a new coffee blend. Goal reached. Participants were able to complete the task.
6 Participants should be able to view an overview of the beans and inventory levels Goal reached. Participant was able to complete the task.

Key Findings

Category Users' Comment Changes to be made
Technical Refinement Sponsor highlighted to add a new inventory - pods. Mockingjay back-end team to add Pods as a new inventory.
Technical Refinement Sponsor highlighted to add “Semi-Finished” Products under inventory. Mockingjay back-end team to add Semi-Finished as a new inventory.
Technical Refinement Sponsor requested to automatically calculate the weight inputs of the coffee packaging instead of manually inputting them. Mockingjay back-end team to automatically calculate and display the weight of the coffee packaging automatically.
Technical Refinement Sponsor requested to make the coffee inventory amounts editable. Mockingjay development team to enable editable functionality to allow sponsor to edit the inventory.
Technical Refinement Sponsor requested to have a filter function of the inventory so that he is able to view historical data easily. Mockingjay front-end team to implement filter function of past data.
Technical Refinement Sponsor requested to have a "Quick Access" in the homepage which is made up of the different forms to be easily accessed from the homepage. Mockingjay front-end team to design a shortcuts section so that client can easily access the different .
Cosmetic Refinement Sponsor requested to replace the 'donut' charts with bar charts so that the sponsor can clearly see the inventory levels. Mockingjay front-end team to display bar charts instead.

Overall Results/Comments

  • Sponsor is satisfied with the team's progress
  • To revise business logic and flow again
  • To send him updates through communication channels (Telegram, email)
  • To make minor cosmetic improvements

User Test 2

Test Plan

Venue: Hook Coffee Office @ 15-4 Jalan Riang
Date: 22 September 2018
Time: 2.00PM
Duration: ~ 20 minutes per user
Total Number of Participants : 7
User Test: Instructions can be found here

Objectives

  • To test the remaining modules and functionalities
  • To identify any gaps in the business process
  • To identify any missing functionality

Scope of User Test 2

  • Predictive Analysis
  • Create New Supplier
  • Add New Raw Bean
  • Add New Coffee Equipment
  • Create New Delivery Form
  • Create Purchase Order Form

Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. A member from Mockingjay will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing.

S/N Goals Reached?
1 Participants should be able to add a new supplier into the inventory management system. Goal reached. Participants were able to complete the task.
2 Participants should be able to add a new raw bean that is supplied by the supplier. Goal reached. Participants were able to complete the task.
3 Participants should be able to add a new coffee equipment that is supplied by the supplier that you had just created. Goal reached. Participants were able to complete the task.
4 Participants should be able to edit the contact details of an existing supplier in the system with the test input details.. Goal reached. Participant were able to complete the task.
5 Participants should be able to delete an existing supplier in the system with the test input details. Goal reached. Participants were able to complete the task.
6 Participants should be able to create a new delivery form with the test input details. Goal reached. Participant was able to complete the task.
7 Participants should be able to edit the delivery form to input consignment date. Goal reached. Participant was able to complete the task.
8 Participants should be able to create a purchasing order form based on the delivery form. Goal reached. Participant was able to complete the task.

Key Findings

Category Users' Comment Changes to be made
UI/UX Sponsor highlighted to display the price of the bean in the purchasing form. Mockingjay front-end team to display the price for each bean.
Cosmetic Sponsor highlighted that some of the terminology used was inaccurate, such as 'Delivery'. Mockingjay front-end team to revise the terminology and make the relevant changes.
Cosmetic Sponsor highlighted to combine the different purchase form IDs into one row. Mockingjay front-end team to make this minor edit.
Cosmetic Sponsor requested to remove the pop-ups of successful alert. Mockingjay front end team to make this minor edit.

Overall Results/Comments

  • Sponsor is satisfied with the team's progress
  • To send him updates through communication channels (Telegram, email)

User Test 3

Test Plan

Venue: Hook Coffee Office @ 15-4 Jalan Riang
Date: 12 November 2018
Time: 1.00PM
Duration: ~ 40 minutes per user
Total Number of Participants : 12
User Test: Instructions can be found here

Objectives

  • To go through all the functionalities
  • To do a parallel comparison between the tasks using the existing processes and with the system
  • To ensure no gaps in the business process

Scope of User Test 3

  • Create New Supplier
  • Generate a Purchase Order Form
  • View, Edit & Delete Inventory
  • Add New Raw Bean
  • Add New Coffee Equipment
  • Predictive Analysis
  • Create New Delivery Form

Procedures

Participants are given a consent form to sign prior to the testing. Once signed, they will be given the test instructions, and they are to think aloud and ask questions as they follow through the instructions given for the user testing. A member from Mockingjay will be there to record down the participants’ comments. Participants will complete a post-test questionnaire at the end of their user testing.

S/N Goals Reached?
1 Participants should be able to add a new raw bean supplier. Goal reached. Participants were able to complete the task.
2 Participants should be able to generate a new Purchasing Order (PO) form with the newly created supplier. Goal reached. Participants were able to complete the task.
3 Participants should be able to view an existing supplier and update its details. Goal reached. Participants were able to complete the task.
4 Participants should be able to view overview of beans and inventory levels. Goal reached. Participant were able to complete the task.
5 Participants should be able to add a new raw bean. Goal reached. Participants were able to complete the task.
6 Participants should be able to add a new blending formula. Goal reached. Participant was able to complete the task.
7 Participants should be able to add a new blend bean. Goal reached. Participant was able to complete the task.
8 Participants should be able to predict how much coffee beans to roast for upcoming week of an existing raw bean. Goal reached. Participant was able to complete the task.
9 Participants should be able to create a new delivery form with specific details. Goal reached. Participant was able to complete the task.
10 Participants should be able to update an existing delivery form with specific details. Goal reached. Participant was able to complete the task.

Key Findings

Category Users' Comment Changes to be made
Usability & Design For the PO form remove the receiver's signature in the PDF. Mockingjay team to modify the design of the PO form to remove the portion of the receiver's signature and add a computer-generated signature authentication.
Design Sponsor highlighted to display two columns in the PO form - one column is the quantity of bags, one column is how many kg in a bag. Mockingjay team to make the relevant changes.
Technicality Sponsor highlighted that for blend bean component, it may be whole bean, not just ground beans. Mockingjay back-end team to add whole beans for blend beans, on top of ground beans.
Technicality Sponsor requested to automatically deduct the amount of coffee beans from the original amount, not blend amount. Mockingjay back-team to make the relevant changes.