HeaderSIS.jpg

IS480 Team wiki: 2013T2 Invenio Usability Test

From IS480
Revision as of 12:21, 10 April 2014 by Pearlyn.neo.2010 (talk | contribs) (→‎Internal Testing)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

We define ownage.

Home Our Team Project Overview Project Management Project Documentation Learning Outcomes
Use Cases Diagrams Usability Test Minutes


Internal Testing

Our team has conducted internal testing using regression testing at the end of each iteration.
Please refer to the following for our test plan and test cases:

1. Internal Test Plan
  1. Download
2. Internal Test Cases & Results
  1. Download

Usability Test 1

Date & Venue

Date: 24 Jan 2014
Time: 2PM-3PM
Venue: NXP Semiconductors Singapore Pte. Ltd. 1 Fusionopolis Walk, #12-01/02 South Tower, Solaris, Singapore 138628

Participants

No. of Participants: 6
Participant Profile:

  • Administrator
  • General Employee 1
  • General Employee 2
  • Supervisor
  • Auditor
  • Maintenance Crew
Invenio ut1 pic1.JPG
Invenio ut1 pic2.JPG
Invenio ut1 pic3.JPG
Invenio ut1 pic4.JPG
Invenio ut1 pic6.JPG
Invenio ut1 pic5.JPG

Scope of Test

Inveniofunctions2.png

Testing Method

We have designed different scenarios in a series of tasks, for the participants to follow during User Test 1. They would be required to figure out how to complete the set of tasks allocated to them. Facilitators would be beside them to observe and record the actions that the users have made in order to complete the tasks assigned.

Upon completion of their respective tasks, the participants would be provided with a link to a questionnaire with regard to the participants' experiences of using the system. It would also allow users to express their feedback and any other issues faced during the testing process.

Test Results

What do you like about the application?

  • Easy to add a maintenance schedule
  • Makes life easier
  • Simple interface
  • Easy to log in
  • Functional and something new for the industry
  • Main page very clear


What do you dislike about the application?

  • Device pop up registry success, but tag is invalid
  • Web console login trouble when user is already logged in Android app
  • Long information keyed into registration process
  • Too many histories stored in phone


What are some of the issues you faced while performing the tasks?

  • Server unstable
  • Had to wait for server to start
  • Cannot use web console when Android app is logged into same account


How can we improve this application to give you a better / user experience?

  • Make the display clearer
  • Login screen should show soft keyboard automatically
  • Upload personal photo
  • Allow user to key in tag ID if cannot read tag
  • Read tag > remarks should display "" instead of null
  • Make the UI nicer


Click here for our response plan: [Response Plan]

Invenio ut1 graph1.png Invenio ut1 graph2.png Invenio ut1 graph3.png Invenio ut1 graph4.png Invenio ut1 graph6.png

Documentation

1. Test Plan
  1. User Test 1 - Test Plan
2. Scenario Task Lists
  1. Administrator Tasks
  2. General Employee 1 Tasks
  3. General Employee 2 Tasks
  4. Supervisor Tasks
  5. Auditor Tasks
  6. Maintenance Crew Tasks
3. Qualtrics Survey Questions
  1. Survey Link: http://bit.ly/inveniotest
  2. Survey Raw Result: Raw Results
4. Participant Informed Consent Form
  1. Consent Form

Usability Test 2

Date & Venue

Date: 7 February 2014
Time: 3.30PM - 4.30PM
'Venue: Singapore Management University, SOA GSR 3.7"

Participants

No. of Participants: 2
Participant Profile:

  • Administrator
  • General Employee 1
  • General Employee 2
  • Supervisor
  • Auditor
  • Maintenance Crew
Invenio ut2 pic1.JPG
Invenio ut2 pic2.JPG.JPG
Invenio ut2 pic3.JPG
Invenio ut2 pic4.JPG


Scope of Test

For User Test 2, we have added in 2 new functions to test - Search for Asset and Export Asset Reports. Invenio functions3.png

Testing Method

We have designed different scenarios in a series of tasks, for the participants to follow during User Test 2. They would be required to figure out how to complete the set of tasks allocated to them. Facilitators would be beside them to observe and record the actions that the users have made in order to complete the tasks assigned.

Upon completion of their respective tasks, the participants would be provided with a link to a questionnaire with regard to the participants' experiences of using the system. It would also allow users to express their feedback and any other issues faced during the testing process.

Test Results

What do you like about the application?

  • Registration process is easy to use because the fields I need are already available in the app
  • Auditing process is creative and useful


What do you dislike about the application?

  • Show DD/MM/YYYY format for date instead of MM/YYYY
  • Red colour highlight for "Loan Asset" is not intuitive - change to other colours


What are some of the issues (if any) you faced while performing the tasks

  • Maintenance role does not have a reminder function
  • Cancel button in web app not linked properly


How can we improve this application to give you a better user experience?

  • Remind me of maintenance due date or loan due date a few days before the actual day
  • Ensure that the logo can be changed to other logos used in other organizations


Click here for our response plan: [Response Plan]
Invenio ut2 graph1.png Invenio ut2 graph2.png Invenio ut2 graph3.png Invenio ut2 graph4.png Invenio ut2 graph5.png

Documentation

1. Test Plan
  1. User Test 2 - Test Plan
2. Scenario Task Lists
  1. Administrator Tasks
  2. General Employee 1 Tasks
  3. General Employee 2 Tasks
  4. Supervisor Tasks
  5. Auditor Tasks
  6. Maintenance Crew Tasks
3. Qualtrics Survey Questions
  1. Survey Link: http://bit.ly/inveniotest
  2. Survey Raw Result: Raw Data
4. Participant Informed Consent Form
  1. Consent Form


Final User Test

Date & Venue

Date: 7 March 2014 - 31 March 2014
Venue: Universals Filtrations Pte. Ltd

Participants

No. of Participants: 5
Participant Profile:

  • General Manager
  • Technician
  • Regional Manager
  • Project Manager
  • Admin Assistant
Invenio IMG 3278.JPG
Invenio IMG 3542.JPG
Invenio IMG 3541.JPG
Invenio IMG 3273.JPG


Scope of Test

The version that was deployed for midterm was used for this User Test.
The following functionalities would be covered during the user test: Finalut scope.png

Testing Method

The participants of this user test would be provided with a list of tasks to complete based on different scenarios. The would be following and using the list of tasks as a guide and complete the different scenarios. The testers would continue to make use of the Android application and the web application for a duration of 2 weeks.

At the end of the user test, all participants would be given a web link to complete a questionnaire with regard to their experiences of using the Android app and the web console. This serves as a channel for the testers to provide useful feedback on any usability issues that they have faced during the user test, or any improvements that they wish to see in the future for the Android app and the web console.

Test Results

What do you like about the application?

  • I like that the phone is able to help me read a certain piece of information very quickly and I also like it that this app helps me save a lot of time
  • I enjoyed the process of loaning an asset, it helps save a lot of time and makes my work easier
  • The app is very enjoyable to use and it was easy to navigate.
  • This application was easy to use and helps us save a lot of time
  • I really like this app a lot. I can forsee that it will help make a lot of processes in the company easier and it will help us save a lot of time


What do you dislike about the application?

  • The colour can be made more attractive
  • Nothing much, it was easy to use and I understood how to use it almost immediately
  • Maybe change the colour scheme, make it more exciting


What are some of the issues (if any) you faced while performing the tasks

  • Sometimes the app will lag, but its minor
  • No issues


How can we improve this application to give you a better user experience?

  • It will be good to have a history record to see who made what changes, especially for the admin to keep track
  • Maybe can allow us to take our own photos in the app
  • One suggestion is that maybe you can think of a way to create a new database. We have many branches and some of these branches use different databases, is it possible to not let them be mixed?
  • Maybe you can explore more into inventory management, our company needs that more
  • I can see this app being used more for inventory compared to asset management, as we have a lot of inventory to manage. Maybe you can explore that in the future


Click here for our response plan: [Response Plan]
Ut3 1.png Ut3 2.png Ut3 3.png Ut3 4.png Ut3 5.png Ut3 compiledresults.png Ut3 avgtime.png Ut3 frequency.png Ut3 timesavings.png

Documentation

1. Test Plan
  1. Final User Test - Test Plan
2. Scenario Task Lists
  1. Administrator Tasks
  2. General Employee 1 Tasks
  3. General Employee 2 Tasks
  4. Supervisor Tasks
  5. Auditor Tasks
  6. Maintenance Crew Tasks
3. Qualtrics Survey Questions
  1. Survey Link: http://bit.ly/inveniotest
  2. Survey Raw Result: Raw Data
4. Participant Informed Consent Form
  1. Consent Form