HeaderSIS.jpg

IS480 Team wiki: 2017T2 Appsolute Usability Testing 4

From IS480
Jump to navigation Jump to search
Appsolute.jpg

Appsolute Home.png   HOME

Appsolute AboutUs.png   ABOUT US

Appsolute ProjectOverview.png   PROJECT OVERVIEW

Appsolute management.png   PROJECT MANAGEMENT

Appsolute documentation.png   DOCUMENTATION

PERSONAS & SCENARIO DIAGRAMS TESTING MEETING MINUTES PROJECT PRESENTATIONS

Appsolute UT1 color.png Appsolute UAT2.png Appsolute UAT3.png Appsolute UAT4 color.png Appsolute UAT5.png

Usability Testing 4

Venue: SMU School of Information Systems Dean’s Meeting Room
Date: 1st February 2017, Wednesday
Time: 1:00 pm - 2:00 pm
Duration: ~1 hour
Number of Participant(s): 5
User Test: Instructions Here

Goals & Data

  • Goal 1: Determine if it is easy for the users (admin/students) to navigate the different pages in the application.
    • On a scale of 1 to 10 (difficult to easy), how easy it is to navigate the different pages in the application? (Target: average 7 or higher)
  • Goal 2: Determine if it is easy for the users (admin) to (Create/Edit/Delete) asset forms using the application.
    • On a scale of 1 to 10 (difficult to easy), how easy it is to (Create/Edit/Delete) asset forms using the application (Target: average 7 or higher)
  • Goal 3: Determine if it is easy for the users (admin) to manage (Download) team data using the application.
    • On a scale of 1 to 10 (difficult to easy), how easy it is to manage (Download) team data using the application? (Target: average 7 or higher)
  • Goal 4: Determine if it is easy for the users (admin) to manage (Team Data Submission) for teams to submit team data using the application.
    • On a scale of 1 to 10 (difficult to easy), how easy it is to manage (Team Data Submission) for teams to submit team data using the application? (Target: average 7 or higher)
  • Goal 5: Determine if it is easy for the users (student) to manage (Add/Edit) team data using the application.
    • On a scale of 1 to 10 (difficult to easy), how easy it is to manage Add/Edit) team data using the application? (Target: average 7 or higher)

Scope of UT 4
Admin/Student

  • Navigation Access Pages

Admin

  • Create Team Data Asset Form
  • Edit Team Data Asset Form
  • View Team Data Asset Form
  • Delete Team Data Asset Form
  • Create Submission Date for Team Data Asset Form
  • Download Assets in Zip folder

Student

  • Add Team Data
  • Edit Team Data
  • Image upload with validation

Participants

Since the testing are mainly for administrators to feedback on how sufficient the functions are available for create/view/delete and download assets form, we have invited 5 participants who will be the admin and student for the application.

User Demographics

  • Teaching Faculty (Professor Benjamin, Fiona, Hosanna)
  • System Support Team (Elvin and Aaron)


Key Findings

Goal 1: Determine if it is easy for the users (admin/students) to navigate the different pages in the application. On a scale of 1 to 10 (difficult to easy), how easy it is to navigate the different pages in the application? (Target: average 7 or higher)

Results:

In average rating of 7.6, 2 out of 5 users with a rating of 7 each, faced slight difficulties navigating to different page as they are used to the previous settings.


UAT 4 Result 1.JPG
What we have learnt:

From here we have learned that even though having all links on navigation is neater and easier for user to find it easily, however it is not always the case as 2 out of 5 users faced difficulties navigating to different pages as they have to roll over to each of the navigation to find the right page. Regarding this issue, the project sponsors have agreed upon the classification of the navigation pages thus no amendments are made here.


Goal 2: Determine if it is easy for the users (admin) to (Create/Edit/Delete) asset forms using the application. On a scale of 1 to 10 (difficult to easy), how easy it is to (Create/Edit/Delete) asset forms using the application (Target: average 7 or higher).

Create Asset Forms
Results:

  • In average rating of 8.4, users think that the asset forms are easy to create.
  • 3 out of 5 users have a rating of 8 over 10 thinks that creating team asset is easy but there are still room for improvement on the User interface, such as shifting ‘Asset Management’ dropdown to under ‘MetaData’ in the navigation bar.

UAT 4 Result 2.JPG
What we have learnt:

3 out of 5 users are confused by the classification of navigation pages as adding form fields page should be classified under ‘Team’ in the navigation dropdown. The users have a hard time finding add form field page in the application. From here we learned that it is very important when it comes to naming convention as it will determine how efficient can a user find the right page for the right information. Therefore, we came to understand the confusion users have faced and we have renamed ‘Asset Management’ to ‘Manage Field’ and had shifted it to be under Metadata‘s dropdown.


Editing Asset Forms
Results:

  • In average rating of 8.8, users think that the asset forms are easy to edit.
  • 2 out of 5 users have a rating of 8 over 10 thinks that editing team asset is easy but there are still room for improvement on the user interface, such as indicating a sample formatting value for the input fields.

UAT 4 Result 2 1.JPG
What we have learnt:

2 out of 5 users does not know the right formatting to input when editing asset form fields. Due to that, there is a possibility that incorrect input values will cause improper displaying of fields values in team information. From here we have learned that if there is a standard format that we would want the user to follow, then it will be good to include a note to avoid confusion. Hence, to ensure that user follows the right formatting, we have added a tool-tips on the input fields when user’s mouse is rolled over.


Deleting Asset Forms
Results:

  • In average rating of 9.4, users think that the asset forms are easy to delete.
  • None of the user have feedback on task improvement.

UAT 4 Result 2 2.JPG

Goal 3: Determine if it is easy for the users (admin) to manage (Download) team data using the application. On a scale of 1 to 10 (difficult to easy), how easy it is to manage (Download) team data using the application? (Target: average 7 or higher).

Results:

  • In average rating of 9.8, users think that team data is easy to download.
  • 1 out of 5 users think that there is still room for improvement on the functionality such as, removing deleted images in the folder so that when user download the zip folder, the deleted images will not be found.

UAT 4 Result 3.JPG
What we have learnt:

1 out of 5 users think that there is a slight confusion of having deleted images name to appear in the excel file when he/she downloaded the zip folder. The user had a false impression that the delete button in the image caption page does not work properly. From here we have learned that the mental model a user had when it comes to deletion of stuff is that once it is removed the image should no longer appear. However, our team fails to recognize that and to prevent further confusion and false impression made, we have changed the way we handle images once it is being removed. The images will not be shown in the folder after user has deleted it.


Goal 4: Determine if it is easy for the users (admin) to manage (Team Data Submission) for teams to submit team data using the application. On a scale of 1 to 10 (difficult to easy), how easy it is to manage (Team Data Submission) for teams to submit team data using the application? (Target: average 7 or higher).

Results:

  • In average rating of 8.4, users think that it is easy to manage team data submission.
  • 4 out of 5 users think that there are still room for improvement on user interface and information display. Users currently faced difficulties viewing the entire data table and unable to finalized all team at once.

UAT 4 Result 4.JPG
What we have learnt:

4 out of 5 users could not see all the table fields at one glance and users find it hard to scroll left and right because once the user scroll to the end, he/she does not know what does that particular row/column is referring to. From here, we learned that when there are a lot of information that is needed to be displayed on the table and scrolling will cause the header to be hidden when scrolling to the end, therefore fixed header must be applied. This will allow user to match the data/content to the right header regardless of the scrolling.


Goal 5: Determine if it is easy for the users (student) to manage (Add/Edit) team data using the application. On a scale of 1 to 10 (difficult to easy), how easy it is to manage Add/Edit) team data using the application? (Target: average 7 or higher).

Add Team Data
Results:

  • In average rating of 9.4, users think that it is easy to add team data into the system.
  • 3 out of 5 users think that there are still room for improvement on User interface. Currently, users are unable see the preview images when uploaded successfully.

UAT 4 Result 5 1.JPG
What we have learnt:

3 out of 5 users were unsure of which images they have browse does not meet the dimension requirement. The upload button will just disabled if 2 out of 3 images user select does not meet the dimension requirement. From here we realized that it is very important to flag out the error immediately so that user will not have to trial and error to see which images does not meet the requirement. In order to ensure that user are aware of which images are wrong so that they can resize it and re-upload it, we have display the error on the page and display images for preview for those that are within the requirement.


Edit Team Data
Results:

  • In average rating of 8.8, users think that it is easy to edit team data into the system.
  • 3 out of 5 users think that there are still room for improvement on User interface. Currently, users are not prompt with confirmation when deleting images.

UAT 4 Result 5 2.JPG
What we have learnt:

3 out of 5 users’ images have been deleted when they accidentally click on ‘delete’ button on the image. We have learned that it is always good to prompt user that they have clicked on something before proceeding to do the action especially for deletion of items. This is because at times user might accidentally clicked on the wrong button and if there is no prompting then they might have to redo or revert the task again. Hence, to prevent any accidental image deletion, we have added a modal pop-up confirmation when user delete image(s).

Feedbacks and Raw Data

List of feedbacks and raw data: Click here