Difference between revisions of "IS480 Team wiki: 2016T1 PolyVision UT2"
(Created page with "<!--Logo--> 500px|center|INSIGHT<br /> <!--Navigation Bar--> {|style="background-color:#ffffff; color:#000000" width="100%" cellspacing="0" cellpadd...") |
|||
(18 intermediate revisions by the same user not shown) | |||
Line 20: | Line 20: | ||
|}<br/> | |}<br/> | ||
+ | <!-- Start of content --> | ||
<center>[[File:Polyvision-User-testing2.png|850px|center|INSIGHT Timeline]]</center> | <center>[[File:Polyvision-User-testing2.png|850px|center|INSIGHT Timeline]]</center> | ||
+ | |||
+ | ==User Testing Plan== | ||
+ | ===Session 1 (DBS VGP users)=== | ||
+ | <b>Date: </b>13 Sep 2016<br> | ||
+ | <b>Venue: </b>Marina Bay Financial Centre Tower 3, Level 43<br> | ||
+ | <b>Users: </b>2 users, DBS VGP users<br> | ||
+ | <b>Duration: </b>4PM - 5PM<br> | ||
+ | <b>Scope: </b>Account module, company management module, file upload module, deal management module<br> | ||
+ | |||
+ | ===Session 2 & 3 (SMU students)=== | ||
+ | <b>Date: </b>15 Sep & 16 Sep 2016<br> | ||
+ | <b>Venue: </b>SOE SR 2-4 & SOE SR 2-8<br> | ||
+ | <b>Users: </b>36 users, SMU students<br> | ||
+ | <b>Duration: </b>12PM - 6PM, ~ 1 hour / user<br> | ||
+ | <b>Scope: </b>Account module, company management module, file upload module, deal management module<br> | ||
+ | <br> | ||
+ | <i>*The first group of users we invited to test our platform are users from DBS VGP, as they are the main users of the platform. On top of users from DBS VGP, we have decided to invite another group of users, they are regular users outside of DBS VGP. However, these users do not have knowledge on what the platform is about which might affect the test results. In order to bridge the gap, scenarios are created in our tasks for a better understanding of our platform.</i> | ||
+ | |||
+ | ==User Testing Goals== | ||
+ | To examine the viability of our platform INSIGHT and point out design or conceptual flaws with our system.<br> | ||
+ | |||
+ | <b>Some specific goals we are measuring are:</b> | ||
+ | <center> | ||
+ | {| class="wikitable" style="text-align: center; height:50px; width:1050px" | ||
+ | |+ | ||
+ | |- | ||
+ | ! scope="col" style="background:#c60026; color:#ffffff"| Goal | ||
+ | ! scope="col" style="background:#c60026; color:#ffffff"| Data Collected | ||
+ | |- | ||
+ | |||
+ | | User should be able to create a new company easily | ||
+ | |<li>Time taken to create a new company (quantitative, question)</li> | ||
+ | <li>User's comments (qualitative, question)</li> | ||
+ | |- | ||
+ | |||
+ | | User should be able to upload files easily internally | ||
+ | |<li>Time taken to upload files internally (quantitative, question)</li> | ||
+ | <li>User's comments (qualitative, question)</li> | ||
+ | |- | ||
+ | |||
+ | | User should be able to upload files easily externally | ||
+ | |<li>Time taken to upload files externally (quantitative, question)</li> | ||
+ | <li>User's comments (qualitative, question)</li> | ||
+ | |- | ||
+ | |||
+ | | User should be able to create a new deal easily | ||
+ | |<li>Time taken to create a new deal (quantitative, question)</li> | ||
+ | <li>User's comments (qualitative, question)</li> | ||
+ | |- | ||
+ | |||
+ | | User should be able to find a deal easily | ||
+ | |<li>Time taken to find a deal (quantitative, question)</li> | ||
+ | <li>User's comments (qualitative, question)</li> | ||
+ | |- | ||
+ | |} | ||
+ | </center> | ||
+ | |||
+ | ==User Testing Documents== | ||
+ | [[Media:Polyvision-UAT2.pdf|UAT2 Study Tasks]] | ||
+ | |||
+ | ==Study Results== | ||
+ | ===Goal Achieved?=== | ||
+ | <center> | ||
+ | {| class="wikitable" style="text-align: center; height:50px; width:1050px" | ||
+ | |+ | ||
+ | |- | ||
+ | ! scope="col" style="background:#c60026; color:#ffffff"| Goal | ||
+ | ! scope="col" style="background:#c60026; color:#ffffff"| Target (mins) | ||
+ | ! scope="col" style="background:#c60026; color:#ffffff"| DBS VGP Average (mins) | ||
+ | ! scope="col" style="background:#c60026; color:#ffffff"| SMU Average (mins) | ||
+ | ! scope="col" style="background:#c60026; color:#ffffff"| Goal Achieved? | ||
+ | |- | ||
+ | |||
+ | | User should be able to create a new company easily | ||
+ | |3.75 | ||
+ | |2.5 | ||
+ | |3.17 | ||
+ | | style="background:#ffff66; color:black" | Goal reached. | ||
+ | |- | ||
+ | |||
+ | | User should be able to upload files easily internally | ||
+ | |1.5 | ||
+ | |1 | ||
+ | |3.11 | ||
+ | | style="background:#ff6666; color:black" | Goal not reached. | ||
+ | |- | ||
+ | |||
+ | | User should be able to upload files easily externally | ||
+ | |1.5 | ||
+ | |1 | ||
+ | |1.98 | ||
+ | | style="background:#ff6666; color:black" | Goal not reached. | ||
+ | |- | ||
+ | |||
+ | | User should be able to create a new deal easily | ||
+ | |3 | ||
+ | |2 | ||
+ | |2.93 | ||
+ | | style="background:#ffff66; color:black" | Goal reached. | ||
+ | |- | ||
+ | |||
+ | | User should be able to find a deal easily | ||
+ | |4.5 | ||
+ | |3 | ||
+ | |4.43 | ||
+ | | style="background:#ffff66; color:black" | Goal reached. | ||
+ | |- | ||
+ | |||
+ | |} | ||
+ | </center><br/> | ||
+ | |||
+ | ===Key Findings & Changes Implemented=== | ||
+ | <center> | ||
+ | {| class="wikitable" style="text-align: center; height:50px; width:1050px" | ||
+ | |+ | ||
+ | |- | ||
+ | ! scope="col" width="110px" style="background:#c60026; color:#ffffff"| Function | ||
+ | ! scope="col" style="background:#c60026; color:#ffffff"| Feedback | ||
+ | ! scope="col" width="110px" style="background:#c60026; color:#ffffff"| Implemented? | ||
+ | ! scope="col" style="background:#c60026; color:#ffffff"| Changes Implemented | ||
+ | |- | ||
+ | |||
+ | |rowspan="2"| Account Module | ||
+ | |Participants find the "reset" button at the account activation page confusing. The word "reset" makes them think that clicking the button will clear the values in the field. | ||
+ | |Yes | ||
+ | |Change the name of the button from "reset" to "activate". | ||
+ | |- | ||
+ | |||
+ | |Participants had difficulties finding the profile and logout button because of the colors used for the buttons and where it is located. | ||
+ | |Yes | ||
+ | |Put the buttons at a location that is more obvious and easily accessible. | ||
+ | |- | ||
+ | |||
+ | |rowspan="3"| Deal Management Module | ||
+ | |Participants finds it tedious to search for a particular deal because they have to click in to every single deal of the company to find the particular deal note. | ||
+ | |Yes | ||
+ | |Show the number of deal notes when displaying list of deals or have a search function. | ||
+ | |- | ||
+ | |||
+ | |Some participants did not realise that they can view more about the deal by hovering and clicking into the deal item. | ||
+ | |Yes | ||
+ | |Create a larger color contrast on hover. | ||
+ | |- | ||
+ | |||
+ | |Participants finds it hard to read a deal's request amount especially when the amount is very huge. | ||
+ | |Yes | ||
+ | |Include comma seperators when displaying deal's request amount. | ||
+ | |- | ||
+ | |||
+ | | Notification Module | ||
+ | |Some participants feel there are too many email notifications received and they feel flooded by them. | ||
+ | |No | ||
+ | |Send a summary email per day instead of sending email every now and then. | ||
+ | |- | ||
+ | |||
+ | | All Modules | ||
+ | |Participants had difficulty identifying the add button because it is not obvious that it is a add button and the color of the button blends in with the table. | ||
+ | |Yes | ||
+ | |Revise the button to make the intentions more obvious. | ||
+ | |- | ||
+ | |||
+ | |rowspan="2"| Others | ||
+ | |Some participants who used browsers other than Chrome (e.g. Safari, FireFox, Internet Explorer) was unable to view the list of deals properly. There were some alignment issues too. | ||
+ | |Yes | ||
+ | |Make our application compatible with commonly used browsers such as Safari and Internet Explorer. | ||
+ | |- | ||
+ | |||
+ | |Participants tend to want to click in from the dashboard to view more details of what's displayed on the tiles. | ||
+ | |Yes | ||
+ | |Allow click in from tiles to view more details. | ||
+ | |- | ||
+ | |} | ||
+ | </center><br/> |
Latest revision as of 17:05, 20 November 2016
Home | About Us | Project Overview | Project Management | Project Documentation |
Contents
User Testing Plan
Session 1 (DBS VGP users)
Date: 13 Sep 2016
Venue: Marina Bay Financial Centre Tower 3, Level 43
Users: 2 users, DBS VGP users
Duration: 4PM - 5PM
Scope: Account module, company management module, file upload module, deal management module
Session 2 & 3 (SMU students)
Date: 15 Sep & 16 Sep 2016
Venue: SOE SR 2-4 & SOE SR 2-8
Users: 36 users, SMU students
Duration: 12PM - 6PM, ~ 1 hour / user
Scope: Account module, company management module, file upload module, deal management module
*The first group of users we invited to test our platform are users from DBS VGP, as they are the main users of the platform. On top of users from DBS VGP, we have decided to invite another group of users, they are regular users outside of DBS VGP. However, these users do not have knowledge on what the platform is about which might affect the test results. In order to bridge the gap, scenarios are created in our tasks for a better understanding of our platform.
User Testing Goals
To examine the viability of our platform INSIGHT and point out design or conceptual flaws with our system.
Some specific goals we are measuring are:
Goal | Data Collected |
---|---|
User should be able to create a new company easily | |
User should be able to upload files easily internally | |
User should be able to upload files easily externally | |
User should be able to create a new deal easily | |
User should be able to find a deal easily |
User Testing Documents
Study Results
Goal Achieved?
Goal | Target (mins) | DBS VGP Average (mins) | SMU Average (mins) | Goal Achieved? |
---|---|---|---|---|
User should be able to create a new company easily | 3.75 | 2.5 | 3.17 | Goal reached. |
User should be able to upload files easily internally | 1.5 | 1 | 3.11 | Goal not reached. |
User should be able to upload files easily externally | 1.5 | 1 | 1.98 | Goal not reached. |
User should be able to create a new deal easily | 3 | 2 | 2.93 | Goal reached. |
User should be able to find a deal easily | 4.5 | 3 | 4.43 | Goal reached. |
Key Findings & Changes Implemented
Function | Feedback | Implemented? | Changes Implemented |
---|---|---|---|
Account Module | Participants find the "reset" button at the account activation page confusing. The word "reset" makes them think that clicking the button will clear the values in the field. | Yes | Change the name of the button from "reset" to "activate". |
Participants had difficulties finding the profile and logout button because of the colors used for the buttons and where it is located. | Yes | Put the buttons at a location that is more obvious and easily accessible. | |
Deal Management Module | Participants finds it tedious to search for a particular deal because they have to click in to every single deal of the company to find the particular deal note. | Yes | Show the number of deal notes when displaying list of deals or have a search function. |
Some participants did not realise that they can view more about the deal by hovering and clicking into the deal item. | Yes | Create a larger color contrast on hover. | |
Participants finds it hard to read a deal's request amount especially when the amount is very huge. | Yes | Include comma seperators when displaying deal's request amount. | |
Notification Module | Some participants feel there are too many email notifications received and they feel flooded by them. | No | Send a summary email per day instead of sending email every now and then. |
All Modules | Participants had difficulty identifying the add button because it is not obvious that it is a add button and the color of the button blends in with the table. | Yes | Revise the button to make the intentions more obvious. |
Others | Some participants who used browsers other than Chrome (e.g. Safari, FireFox, Internet Explorer) was unable to view the list of deals properly. There were some alignment issues too. | Yes | Make our application compatible with commonly used browsers such as Safari and Internet Explorer. |
Participants tend to want to click in from the dashboard to view more details of what's displayed on the tiles. | Yes | Allow click in from tiles to view more details. |