HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2018T1 Five Stones User Testing UAT3"

From IS480
Jump to navigation Jump to search
(UAT3 main content update v1.0 - Results)
(UAT3 main content update v1.1 - User behavior)
Line 183: Line 183:
 
|-
 
|-
 
|}
 
|}
 +
 +
==User Behavior==
 +
{| class="wikitable" style="font-family: Helvetica; background-color:#FFFFFF; width: 750px;" align="center"
 +
|-
 +
 +
! style="color: #FFFFFF; background-color:#334156;" width="10pt" | S/N
 +
! style="color: #FFFFFF; background-color:#334156;" width="120pt" | Module/Function
 +
! style="color: #FFFFFF; background-color:#334156;" width="160pt" | User Behavior
 +
! style="color: #FFFFFF; background-color:#334156;" width="160pt" | Changes to be made
 +
|-
 +
 +
|style="text-align: center;"| 1
 +
|style="text-align: left;"| Overall UI design
 +
|style="text-align: left;"| The “triple line” shown on the user interface is misleading. User clicked on the button thinking that it is like a menu drop down
 +
|style="text-align: left;"| Remove the icon on the user interface main page to reflect that the button represents collapsible instead of menu drop down
 +
 +
|-
 +
 +
|style="text-align: center;"| 2
 +
|style="text-align: left;"| Developer / Creating a datasource
 +
|style="text-align: left;"| Developer users doing the test are able to understand what is required from them. All developer users do not require assistance to complete the testing
 +
|style="text-align: left;"| NIL
 +
 +
|-
 +
 +
|style="text-align: center;"| 3
 +
|style="text-align: left;"| Report Customization
 +
|style="text-align: left;"| Users were able to create a simple business report using the report template quickly without any assistance
 +
|style="text-align: left;"| NIL
 +
 +
|-
 +
 +
|style="text-align: center;"| 4
 +
|style="text-align: left;"| Exporting / Export as PPT
 +
|style="text-align: left;"| Users did not have issues navigating to the correct position of the web application to find the button required to export the report template as PPT
 +
|style="text-align: left;"| NIL
 +
 +
|-
 +
 +
|style="text-align: center;"| 5
 +
|style="text-align: left;"| Exporting / Export as PDF
 +
|style="text-align: left;"| Users did not have issues navigating to the correct position of the web application to find the button required to export the report template as PDF
 +
|style="text-align: left;"| NIL
 +
 +
|-
 +
 +
|style="text-align: center;"| 6
 +
|style="text-align: left;"| Slideshow
 +
|style="text-align: left;"| User did not notice the “Exit Slide Show” button and does not know that there the button exists to exit the slide show
 +
|style="text-align: left;"| Improve colour scheme and the button highlighting to make it obvious for users
 +
 +
|-
 +
 +
|style="text-align: center;"| 7
 +
|style="text-align: left;"| Communications / Email
 +
|style="text-align: left;"| User went on to click on the “Attached” button thinking that the report template needs to be attached
 +
 +
(i.e. User did not realize that the files are already attached)
 +
 +
|style="text-align: left;"| Increase the font for the pre-attached report templates to highlight to users that the chosen report template has been attached
 +
 +
|-
 +
|}
 +
 +
==User Comments==

Revision as of 00:42, 15 November 2018

Logo 1.3.png


ClebsHome.png HOME

ClebsAboutUS.png ABOUT US

ClebsProjectOverview.png PROJECT OVERVIEW

ClebsProjectManagement.png PROJECT MANAGEMENT

ClebsDocumentation.png DOCUMENTATION

Persona & Scenarios Prototypes Meeting Minutes Diagrams User Testing Deliverables


5Stones UAT1.PNG 5Stones UAT2.PNG 5Stones UAT3.PNG


UAT 3 Test Plan

Venue: SingPost Centre, Coffee Bean
Date: 11 November 2018, Sunday
Time: 5 pm
Number of Participant(s): 4
Target Audience: Sponsor’s clients (Developers)

Objectives

  • To test core developed functionalities to gather feedback and gain deeper insights (i.e. Login, Creation of reports & exporting functions such as Powerpoint of PDF format)
  • To identify potential usability issues from users while using the web application
  • To gather comments following changes to UAT 2 for further improvements
  • To improve SCube web application’s overall User Interface (UI) and User Experience (UX)

Scope

  1. Account Module
    • Login/Logout
  2. Dashboard Module
    • Displaying business reports with basic graphs
  3. Report Components module
    • Draggable components (i.e. text, header, image, charts, video)
  4. Report Customization Module
    • User-customizable options for component properties (e.g. formatting of text and charts)
  5. Importing module
    • Process different data types from multiple data sources
  6. Chart Population Module
    • Loading data into charts
    • Integrate retrieved data sources to allow customization of report components and properties
  7. Report Descriptive Analytics Module
    • Display descriptive information of report (i.e. Summary Statistics on charts)
  8. Exporting Module
    • Exporting created report to PPT format
    • Exporting created report to PDF format
  9. Slideshow Module
    • View saved report as a slideshow in the browser
  10. Communications Module
    • Support emailing of exported report to client’s email
  11. Report Preview Module
    • Preview the report with component values according to URL parameter
    • Generate PDF based on preview

Procedure

  1. Participants will be provided with the link to the web application
  2. A set of task instructions will be will be handed out to participants
  3. Participants are encouraged to think aloud when they do the testing
  4. Participants will be given minimal assistance during the test so that user behavior can be observed by the team
  5. There will be a scribe assigned by the team to record down user behaviors, comments and feedback from the participants
  6. Participants will help the team fill in the post-UAT feedback form

Results

S/N Goals Achieved? % of participants able to complete the task
1 Participants should be able to login and logout Yes Pass. 100% successful
2 Participants should be able to create a data source and select the data configurations without any guidance from the facilitator Yes Pass. 100% successful
3 Participants should be able to create a report template based on the default template or using a new blank template Yes Pass. 100% successful
4 Participants should be able to create and customize charts (i.e. Bar and Line charts) on the dashboard Yes Pass. 100% successful
5 Participants should be able to see basic summary statistics when they create a chart (i.e. Both bar & line chart inclusive) Yes Pass. 100% successful
6 Participants should be able to export the created report template as PPT and PDF format respectively Yes Pass. 100% successful
7 Participants should be able to view the created report template as a slideshow on the browser Yes Pass. 100% successful
8 Participants should be able to be to send out the created report template through in-build email function Yes Pass. 100% successful
9 Participants should be able to open up a selected report template in PDF format by using a given URL link Yes Pass. 100% successful

User Behavior

S/N Module/Function User Behavior Changes to be made
1 Overall UI design The “triple line” shown on the user interface is misleading. User clicked on the button thinking that it is like a menu drop down Remove the icon on the user interface main page to reflect that the button represents collapsible instead of menu drop down
2 Developer / Creating a datasource Developer users doing the test are able to understand what is required from them. All developer users do not require assistance to complete the testing NIL
3 Report Customization Users were able to create a simple business report using the report template quickly without any assistance NIL
4 Exporting / Export as PPT Users did not have issues navigating to the correct position of the web application to find the button required to export the report template as PPT NIL
5 Exporting / Export as PDF Users did not have issues navigating to the correct position of the web application to find the button required to export the report template as PDF NIL
6 Slideshow User did not notice the “Exit Slide Show” button and does not know that there the button exists to exit the slide show Improve colour scheme and the button highlighting to make it obvious for users
7 Communications / Email User went on to click on the “Attached” button thinking that the report template needs to be attached

(i.e. User did not realize that the files are already attached)

Increase the font for the pre-attached report templates to highlight to users that the chosen report template has been attached

User Comments