Difference between revisions of "IS480 Team wiki: 2018T1 Five Stones User Testing UAT3"
Jump to navigation
Jump to search
Hyyeo.2016 (talk | contribs) (UAT3 main content update v1.0 - Results) |
Hyyeo.2016 (talk | contribs) (UAT3 main content update v1.1 - User behavior) |
||
Line 183: | Line 183: | ||
|- | |- | ||
|} | |} | ||
+ | |||
+ | ==User Behavior== | ||
+ | {| class="wikitable" style="font-family: Helvetica; background-color:#FFFFFF; width: 750px;" align="center" | ||
+ | |- | ||
+ | |||
+ | ! style="color: #FFFFFF; background-color:#334156;" width="10pt" | S/N | ||
+ | ! style="color: #FFFFFF; background-color:#334156;" width="120pt" | Module/Function | ||
+ | ! style="color: #FFFFFF; background-color:#334156;" width="160pt" | User Behavior | ||
+ | ! style="color: #FFFFFF; background-color:#334156;" width="160pt" | Changes to be made | ||
+ | |- | ||
+ | |||
+ | |style="text-align: center;"| 1 | ||
+ | |style="text-align: left;"| Overall UI design | ||
+ | |style="text-align: left;"| The “triple line” shown on the user interface is misleading. User clicked on the button thinking that it is like a menu drop down | ||
+ | |style="text-align: left;"| Remove the icon on the user interface main page to reflect that the button represents collapsible instead of menu drop down | ||
+ | |||
+ | |- | ||
+ | |||
+ | |style="text-align: center;"| 2 | ||
+ | |style="text-align: left;"| Developer / Creating a datasource | ||
+ | |style="text-align: left;"| Developer users doing the test are able to understand what is required from them. All developer users do not require assistance to complete the testing | ||
+ | |style="text-align: left;"| NIL | ||
+ | |||
+ | |- | ||
+ | |||
+ | |style="text-align: center;"| 3 | ||
+ | |style="text-align: left;"| Report Customization | ||
+ | |style="text-align: left;"| Users were able to create a simple business report using the report template quickly without any assistance | ||
+ | |style="text-align: left;"| NIL | ||
+ | |||
+ | |- | ||
+ | |||
+ | |style="text-align: center;"| 4 | ||
+ | |style="text-align: left;"| Exporting / Export as PPT | ||
+ | |style="text-align: left;"| Users did not have issues navigating to the correct position of the web application to find the button required to export the report template as PPT | ||
+ | |style="text-align: left;"| NIL | ||
+ | |||
+ | |- | ||
+ | |||
+ | |style="text-align: center;"| 5 | ||
+ | |style="text-align: left;"| Exporting / Export as PDF | ||
+ | |style="text-align: left;"| Users did not have issues navigating to the correct position of the web application to find the button required to export the report template as PDF | ||
+ | |style="text-align: left;"| NIL | ||
+ | |||
+ | |- | ||
+ | |||
+ | |style="text-align: center;"| 6 | ||
+ | |style="text-align: left;"| Slideshow | ||
+ | |style="text-align: left;"| User did not notice the “Exit Slide Show” button and does not know that there the button exists to exit the slide show | ||
+ | |style="text-align: left;"| Improve colour scheme and the button highlighting to make it obvious for users | ||
+ | |||
+ | |- | ||
+ | |||
+ | |style="text-align: center;"| 7 | ||
+ | |style="text-align: left;"| Communications / Email | ||
+ | |style="text-align: left;"| User went on to click on the “Attached” button thinking that the report template needs to be attached | ||
+ | |||
+ | (i.e. User did not realize that the files are already attached) | ||
+ | |||
+ | |style="text-align: left;"| Increase the font for the pre-attached report templates to highlight to users that the chosen report template has been attached | ||
+ | |||
+ | |- | ||
+ | |} | ||
+ | |||
+ | ==User Comments== |
Revision as of 00:42, 15 November 2018
HOME |
Persona & Scenarios | Prototypes | Meeting Minutes | Diagrams | User Testing | Deliverables |
Contents
UAT 3 Test Plan
Venue: SingPost Centre, Coffee Bean
Date: 11 November 2018, Sunday
Time: 5 pm
Number of Participant(s): 4
Target Audience: Sponsor’s clients (Developers)
Objectives
- To test core developed functionalities to gather feedback and gain deeper insights (i.e. Login, Creation of reports & exporting functions such as Powerpoint of PDF format)
- To identify potential usability issues from users while using the web application
- To gather comments following changes to UAT 2 for further improvements
- To improve SCube web application’s overall User Interface (UI) and User Experience (UX)
Scope
- Account Module
- Login/Logout
- Dashboard Module
- Displaying business reports with basic graphs
- Report Components module
- Draggable components (i.e. text, header, image, charts, video)
- Report Customization Module
- User-customizable options for component properties (e.g. formatting of text and charts)
- Importing module
- Process different data types from multiple data sources
- Chart Population Module
- Loading data into charts
- Integrate retrieved data sources to allow customization of report components and properties
- Report Descriptive Analytics Module
- Display descriptive information of report (i.e. Summary Statistics on charts)
- Exporting Module
- Exporting created report to PPT format
- Exporting created report to PDF format
- Slideshow Module
- View saved report as a slideshow in the browser
- Communications Module
- Support emailing of exported report to client’s email
- Report Preview Module
- Preview the report with component values according to URL parameter
- Generate PDF based on preview
Procedure
- Participants will be provided with the link to the web application
- A set of task instructions will be will be handed out to participants
- Participants are encouraged to think aloud when they do the testing
- Participants will be given minimal assistance during the test so that user behavior can be observed by the team
- There will be a scribe assigned by the team to record down user behaviors, comments and feedback from the participants
- Participants will help the team fill in the post-UAT feedback form
Results
S/N | Goals | Achieved? | % of participants able to complete the task |
---|---|---|---|
1 | Participants should be able to login and logout | Yes | Pass. 100% successful |
2 | Participants should be able to create a data source and select the data configurations without any guidance from the facilitator | Yes | Pass. 100% successful |
3 | Participants should be able to create a report template based on the default template or using a new blank template | Yes | Pass. 100% successful |
4 | Participants should be able to create and customize charts (i.e. Bar and Line charts) on the dashboard | Yes | Pass. 100% successful |
5 | Participants should be able to see basic summary statistics when they create a chart (i.e. Both bar & line chart inclusive) | Yes | Pass. 100% successful |
6 | Participants should be able to export the created report template as PPT and PDF format respectively | Yes | Pass. 100% successful |
7 | Participants should be able to view the created report template as a slideshow on the browser | Yes | Pass. 100% successful |
8 | Participants should be able to be to send out the created report template through in-build email function | Yes | Pass. 100% successful |
9 | Participants should be able to open up a selected report template in PDF format by using a given URL link | Yes | Pass. 100% successful |
User Behavior
S/N | Module/Function | User Behavior | Changes to be made |
---|---|---|---|
1 | Overall UI design | The “triple line” shown on the user interface is misleading. User clicked on the button thinking that it is like a menu drop down | Remove the icon on the user interface main page to reflect that the button represents collapsible instead of menu drop down |
2 | Developer / Creating a datasource | Developer users doing the test are able to understand what is required from them. All developer users do not require assistance to complete the testing | NIL |
3 | Report Customization | Users were able to create a simple business report using the report template quickly without any assistance | NIL |
4 | Exporting / Export as PPT | Users did not have issues navigating to the correct position of the web application to find the button required to export the report template as PPT | NIL |
5 | Exporting / Export as PDF | Users did not have issues navigating to the correct position of the web application to find the button required to export the report template as PDF | NIL |
6 | Slideshow | User did not notice the “Exit Slide Show” button and does not know that there the button exists to exit the slide show | Improve colour scheme and the button highlighting to make it obvious for users |
7 | Communications / Email | User went on to click on the “Attached” button thinking that the report template needs to be attached
(i.e. User did not realize that the files are already attached) |
Increase the font for the pre-attached report templates to highlight to users that the chosen report template has been attached |