HeaderSIS.jpg

IS480 Team wiki: 2017T2 All Stack Documentation UAT

From IS480
Jump to navigation Jump to search
AllStackTeamlogo2.png

AllStack Home.png

AllStack About Us.png

AllStack Project Overview.png

AllStack ProjectManagement.png

AllStack Project Documentation Selected.png

User Testing

UAT

UT 1


Test Plan

Venue: Gushcloud HQ @ 60 Anson Road
Date: 12 December 2017
Time: 1.30PM - 4:30PM
Duration: 15 minutes per participant
Number of Participants: 4
User Test: Click here for test instructions


Objectives

  • Allow users to verify the core functionalities (Uploading contracts and classifying them) of this web application are correct
  • To gather feedback on the charts used for visualization
  • To observe users' behaviour when using CtMS to extract key information from the contracts
  • To improve CtMS based on user feedback


Scope of UT 1

  • Upload Single Contract
  • Identification of Contract Type
  • Identification of Key Clauses
  • Identification of Entities and Contract Details
  • Auto/Manual-tagging of Contracts
  • Search for Contract
  • View Widgets on Dashboard


Procedures

Participants will be given a study consent to sign before commencing the testing. Once signed, they will be given a pre-test questionnaire and the instructions for user testing, where they will fill up the questionnaire and start the user testing. Team All Stack will be there to help with technical issues as well as to observe the users. Upon completion of testing, users will complete a post-test questionnaire, providing their feedbacks.

S/N Goals Reached?
1 Users should be able to upload contract Goal reached. Users were able to complete the task
2 Users should be able to view contract details Goal reached. Users were able to complete the task.
3 Users should be able to search for contracts Goal reached. Users were able to complete the task
4 Users should be able to view insights from dashboard (widgets only) Goal reached. Users were able to complete the task


Key Findings

Functions User's Comments Changes to Be Made
Function Refinement Users requested to add an “Others” contract type for other miscellaneous contract types All Stack will add in an “Others” contract type for those contracts uploaded that is not NDA, Employee or Talent contract
Function Refinement Users requested for an email notification providing them with weekly summary of the contracts they have All Stack will be implementing a notification module in future iterations
Function Refinement Users requested for a way to cancel the upload when it’s taking too long to upload All Stack will add a cancel button or timeout the page when the upload takes too long
Function Refinement Users requested for a way to view the number of exclusive and non-exclusive contracts All Stack will add a widget in the dashboard showing the values respectively
Function Refinement Users requested for a dynamic chart where they can select certain tags and the chart’s data changes accordingly All Stack will add in a chart with a dropdown list of tags for users to select and the chart will change accordingly


Overall Results/Comments

  • Sponsor is satisfied with the team’s progress and achievements


UT 2


Test Plan

Venue: Gushcloud HQ @ 10 Central Exchange Green
Date: 6 February 2018
Time: 4.30PM – 6.15PM
Duration: 15 minutes per participant
Number of Participants: 4
User Test: Click here for test instructions


Objectives

  • Allow users to verify the core functionalities
  • Gather feedback on accuracy of contract type detection
  • To gather feedback on functionalities developed
  • Detect usability issues when using application


Scope of UT 2

  • Upload Zipped File of Contracts
  • Verify Key Contract Details from Batch Upload
  • Search for Contracts
  • Edit Contracts’ Details
  • Reupload New Version of Existing Contracts
  • View Version Control Log for Contracts
  • Change Access Rights of Users
  • View Expiring Contracts from Dashboard


Procedures

Participants will be given a study consent to sign before commencing the testing. Once signed, they will be given a pre-test questionnaire and the instructions for user testing, where they will fill up the questionnaire and start the user testing. Team All Stack will be there to help with technical issues as well as to observe the users. Upon completion of testing, users will complete a post-test questionnaire, providing their feedbacks.

S/N Goals Reached?
1 Users (as admin) should be able to edit access rights of other employees Goal reached. Users were able to complete the task
2 Users should be able to upload a zipped file of contracts Goal reached. Users were able to complete the task.
3 Users should be able to edit existing contracts and view the version log Goal reached. Users were able to complete the task
4 Users should be able to easily navigate between pages to perform tasks Goal reached. Users were able to complete the task without need for clarifications
5 Contract type detected should be at least 75% accurate Goal reached. 21 out of 24 contracts (87.5%) uploaded were accurate


Key Findings

Functions User's Comments Changes to Be Made
Function Refinement Users requested to add more names for parties involved upon uploading of contract All Stack will modify the system to facilitate displaying multiple names for users to add as parties involved in the verifying contract details page
Function Refinement Users requested for more tags to be identified by the system upon uploading of contract All Stack will add in the list of tags (will be provided by users) to facilitate the identification of tags
Functions User's Behaviour Changes to Be Made
User Interface Users were confused about editing contracts because upon clicking the edit icon from search results page, they didn’t know that they were required to click “Edit” again to enter edit mode (All Stack did this to ensure users would not accidentally make unwanted edits) All Stack will edit the font colours for all the text fields (to make it lighter when in disabled mode) and additionally add in a notification to alert users when they are in edit/view mode


Overall Results/Comments

  • Sponsor is satisfied with changes made based on UT 1’s feedbacks
  • Sponsor is happy with the team’s progress and achievements
UT 3


Test Plan

Venue: SMU SIS
Date: 18 March 2018
Time: Various Timings
Duration: 15 minutes per participant
Number of Participants: 20
User Test: Click here for test instructions


Objectives

  • Allow non-gushcloud employees to give feedback on the usability when using CtMS
  • To observe the user's behaviour when using CtMS
  • To improve CtMS based on user's feedbacks


Scope of UT 3

  • Upload Single Contract
  • Upload Zipped File of Contracts
  • Verify Key Contract Details from Batch Upload
  • Search for Contracts
  • Edit Contracts’ Details
  • View Version Control Log for Contracts


Procedures

Participants will be given the instructions for user testing, where they will read the scenarios provided and start the user testing. Team All Stack will be there to help with technical issues as well as to observe the users. Throughout the testing, users will provide their feedbacks either on the study tasks instructions or verbally and Team All Stack will document it.

S/N Goals Reached?
1 Uploading a single contract Goal reached. Users were able to complete the task
2 Uploading a batch of contracts Goal reached. Users were able to complete the task.
3 Searching for a contract Goal reached. Users were able to complete the task
4 Edit contract (with version control) Goal reached. Users were able to complete the task


Key Findings

Functions User's Feedback/Suggestions Changes to Be Made
Function Refinement Should have a delete function to delete the entire batch upload All Stack will be implementing this in iteration 10
Function Refinement Should have a forget password function All Stack will be implementing this in iteration 10
Function Refinement Should include filter in search for users to only see contracts they have uploaded All Stack will be implementing this in iteration 10
Functions User's Feedback/Suggestions Changes to Be Made
User Interface Buttons can be more standardised throughout the application All Stack will go through all the pages and ensure the buttons are of the same size and colour
User Interface Upon successful upload, success notification should reflect the contract name All Stack will include the contract name in the notification
User Interface Upload dropbox can be bigger AAll Stack will increase the size of the dropbox
User Interface Upon confirming a contract in batch upload, should be reflected as completed instead of forcing users to remember which ones have been edited All Stack will implement colour coding of the contract’s row after it has been successfully confirmed
User Interface Batch File’s status should be explained (ie similar to Access Control info matrix) All Stack will include the info button explaining the batch upload status
User Interface Should make search bar more obvious All Stack will add in a “Search” header before the search bar
User Interface Removal of project name in search filters not intuitive enough All Stack will add in a message “Click to delete” upon hovering over the selected project name in the dropdown list
User Interface Pagination a little too big All Stack will reduce the size of the pagination
User Interface Edit and Confirm buttons should be placed at the top and bottom of edit contract page so users don’t need to scroll back up to click the buttons All Stack will implement a back to top floating button so that it would be easier for users to go back to the top to confirm the contract
User Interface Should include a button for users to delete all tags/clauses at once All Stack will implement the delete buttons
User Interface Table in version control log looks a little unorganised as words run under the bullet point All Stack will edit the table format such that the words would not run under the bullet points
User Interface “Create Account” link looks a little like warning as font is red All Stack will change the link font colours to a dark shade of blue to match CtMS colour theme


Overall Results/Comments

  • Users were generally very happy and satisfied with the application
  • Some positive feedbacks mentioned were:
  • Navigation of CtMS was an ease, simple and clear UI
  • Colour scheme used is pleasing to the eye
  • CtMS is very fast and responsive
  • Auto detection of contract details is very useful
  • Dashboard is intuitive, and colour scheme used is nice and pleasing
  • Expiry of token is a good feature implemented for security
UAT 1


Test Plan

Venue: Gushcloud HQ @ 10 Central Exchange Green
Date: 23 March 2018
Time: 4.00PM – 5.00 PM
Duration: 15 minutes per participant
Number of Participants: 3
User Test: Click here for test instructions


Objectives

  • Allow users to verify all the core functionalities of this web application
  • To gather feedback


Scope of UAT 1

  • All the functionalities


Procedures

Participants will be given the instructions for user testing, where they will read the scenarios provided and start the user testing. Team All Stack will be there to help with technical issues as well as to observe the users. Throughout the testing, users will provide their feedbacks verbally and Team All Stack will document it.

S/N Goals Reached?
1 Users should be able to upload a single contract Goal reached. Users were able to complete the task
2 Users should be able to upload a zipped file of contracts Goal reached. Users were able to complete the task.
3 Users should be able to search for a contract using the search filters Goal reached. Users were able to complete the task
4 Users should be able to edit existing contracts and view the version log Goal reached. Users were able to complete the task


Key Findings

Functions User's Comments Changes to Be Made
Function Refinement Users feedbacked that it would probably be easier/faster for users to have various links on the dashboard page (home page) to view lists of contracts categorised based on the type of contract and project names of the contracts All Stack will add in 2 data tables (1 for contract type, 1 for project names) in the dashboard where users can click to further view a list of the contracts in that category
Function Refinement Users feedbacked that it would be useful if all the widgets were clickable (ie like expiring contracts widget) All Stack will link all the widgets to a list of contracts in that category


Overall Results/Comments

  • Sponsor and key users are generally satisfied and happy with all the functionalities
  • Sponsor is happy with the team’s progress and achievements