Difference between revisions of "IS480 Team wiki: 2013T2 Invenio Usability Test"
(21 intermediate revisions by 2 users not shown) | |||
Line 29: | Line 29: | ||
|scope="row" width="330" style="text-align: left; background: #eeeeee"| | |scope="row" width="330" style="text-align: left; background: #eeeeee"| | ||
:1. '''Internal Test Plan''' | :1. '''Internal Test Plan''' | ||
− | :#[https://wiki.smu.edu.sg/is480/img_auth.php/ | + | :#[https://wiki.smu.edu.sg/is480/img_auth.php/e/e0/Internal_Test_Plan.docx Download] <br> |
:2. '''Internal Test Cases & Results''' | :2. '''Internal Test Cases & Results''' | ||
− | :#[https://wiki.smu.edu.sg/is480/img_auth.php/e/ | + | :#[https://wiki.smu.edu.sg/is480/img_auth.php/e/e5/Internal_Test_Cases_%26_Results.xlsx Download] <br> |
|} | |} | ||
Line 125: | Line 125: | ||
:3. '''Qualtrics Survey Questions'''<br> | :3. '''Qualtrics Survey Questions'''<br> | ||
:#Survey Link: http://bit.ly/inveniotest <br> | :#Survey Link: http://bit.ly/inveniotest <br> | ||
− | :#Survey Raw Result:<br> | + | :#Survey Raw Result: [https://wiki.smu.edu.sg/is480/img_auth.php/c/c7/FYP_Usability_Test_1.xlsx Raw Results]<br> |
:4. '''Participant Informed Consent Form'''<br> | :4. '''Participant Informed Consent Form'''<br> | ||
:#[https://wiki.smu.edu.sg/is480/img_auth.php/0/0d/Invenio_consentform.docx Consent Form] | :#[https://wiki.smu.edu.sg/is480/img_auth.php/0/0d/Invenio_consentform.docx Consent Form] | ||
|} | |} | ||
− | |||
===<div style="background: #333399; padding: 10px; font-weight: bold; line-height: 0.3em"><font color= #FFFFF>Usability Test 2</font></div>=== | ===<div style="background: #333399; padding: 10px; font-weight: bold; line-height: 0.3em"><font color= #FFFFF>Usability Test 2</font></div>=== | ||
Line 137: | Line 136: | ||
'''Date: 7 February 2014'''<br> | '''Date: 7 February 2014'''<br> | ||
'''Time: 3.30PM - 4.30PM'''<br> | '''Time: 3.30PM - 4.30PM'''<br> | ||
− | '''Venue: | + | '''Venue: Singapore Management University, SOA GSR 3.7"''<br> |
− | |||
|} | |} | ||
Line 152: | Line 150: | ||
* Auditor | * Auditor | ||
* Maintenance Crew<br/> | * Maintenance Crew<br/> | ||
+ | [[Image:Invenio_ut2_pic1.JPG|450px|left]][[Image:Invenio_ut2_pic2.JPG.JPG|450px]] | ||
+ | [[Image:Invenio_ut2_pic3.JPG|450px|left]][[Image:Invenio_ut2_pic4.JPG|450px]] | ||
+ | |} | ||
+ | <br/> | ||
===Scope of Test=== | ===Scope of Test=== | ||
For User Test 2, we have added in 2 new functions to test - Search for Asset and Export Asset Reports. | For User Test 2, we have added in 2 new functions to test - Search for Asset and Export Asset Reports. | ||
Line 166: | Line 168: | ||
===Test Results=== | ===Test Results=== | ||
+ | {| style="border: 1px solid darkgray; text-align: center;font-siz:14px; height:50px" | ||
+ | |scope="row" width="1000" style="text-align: left; background: #eeeeee"| | ||
+ | <b>What do you like about the application?</b> | ||
+ | *Registration process is easy to use because the fields I need are already available in the app | ||
+ | *Auditing process is creative and useful | ||
+ | <br/> | ||
+ | <b>What do you dislike about the application?</b> | ||
+ | *Show DD/MM/YYYY format for date instead of MM/YYYY | ||
+ | *Red colour highlight for "Loan Asset" is not intuitive - change to other colours | ||
+ | <br/> | ||
+ | <b>What are some of the issues (if any) you faced while performing the tasks</b> | ||
+ | *Maintenance role does not have a reminder function | ||
+ | *Cancel button in web app not linked properly | ||
+ | <br/> | ||
+ | <b>How can we improve this application to give you a better user experience?</b> | ||
+ | *Remind me of maintenance due date or loan due date a few days before the actual day | ||
+ | *Ensure that the logo can be changed to other logos used in other organizations | ||
+ | <br/> | ||
+ | Click here for our response plan: [[https://wiki.smu.edu.sg/is480/img_auth.php/8/80/Invenio_ut2_response_plan.xlsx Response Plan]] | ||
+ | <br/> | ||
+ | [[Image: Invenio_ut2_graph1.png | 450px]] [[Image: Invenio_ut2_graph2.png | 450px]] | ||
+ | [[Image: Invenio_ut2_graph3.png | 450px]] [[Image: Invenio_ut2_graph4.png | 450px]] | ||
+ | [[Image: Invenio_ut2_graph5.png | 450px]] | ||
+ | |} | ||
===Documentation=== | ===Documentation=== | ||
Line 181: | Line 207: | ||
:3. '''Qualtrics Survey Questions'''<br> | :3. '''Qualtrics Survey Questions'''<br> | ||
:#Survey Link: http://bit.ly/inveniotest <br> | :#Survey Link: http://bit.ly/inveniotest <br> | ||
− | :#Survey Raw Result:<br> | + | :#Survey Raw Result: [https://wiki.smu.edu.sg/is480/img_auth.php/1/1f/FYP_Usability_Test_2.xls Raw Data] <br> |
+ | :4. '''Participant Informed Consent Form'''<br> | ||
+ | :#[https://wiki.smu.edu.sg/is480/img_auth.php/0/0d/Invenio_consentform.docx Consent Form] | ||
+ | |} | ||
+ | |||
+ | |||
+ | ===<div style="background: #333399; padding: 10px; font-weight: bold; line-height: 0.3em"><font color= #FFFFF>Final User Test</font></div>=== | ||
+ | ===Date & Venue=== | ||
+ | {| style="border: 1px solid darkgray; text-align: center;font-siz:14px; height:50px" | ||
+ | |scope="row" width="1000" style="text-align: left; background: #eeeeee"| | ||
+ | '''Date: 7 March 2014 - 31 March 2014'''<br> | ||
+ | '''Venue: Universals Filtrations Pte. Ltd'''<br> | ||
+ | |} | ||
+ | |||
+ | ===Participants=== | ||
+ | {| style="border: 1px solid darkgray; text-align: center;font-siz:14px; height:50px" | ||
+ | |scope="row" width="1000" style="text-align: left; background: #eeeeee"| | ||
+ | '''No. of Participants: 5'''<br> | ||
+ | '''Participant Profile:'''<br> | ||
+ | * General Manager | ||
+ | * Technician | ||
+ | * Regional Manager | ||
+ | * Project Manager | ||
+ | * Admin Assistant<br/> | ||
+ | [[Image:invenio_IMG_3278.JPG|450px|left]][[Image:invenio_IMG_3542.JPG|300px]] | ||
+ | [[Image:invenio_IMG_3541.JPG|300px|left]][[Image:invenio_IMG_3273.JPG|300px]] | ||
+ | |||
+ | <br/> | ||
+ | ===Scope of Test=== | ||
+ | The version that was deployed for midterm was used for this User Test. <br> | ||
+ | The following functionalities would be covered during the user test: | ||
+ | [[Image: Finalut_scope.png | 800px]] | ||
+ | |||
+ | ===Testing Method=== | ||
+ | {| style="border: 1px solid darkgray; text-align: center;font-siz:14px; height:50px" | ||
+ | |scope="row" width="1000" style="text-align: left; background: #eeeeee"| | ||
+ | The participants of this user test would be provided with a list of tasks to complete based on different scenarios. The would be following and using the list of tasks as a guide and complete the different scenarios. The testers would continue to make use of the Android application and the web application for a duration of 2 weeks.<br/><br/> | ||
+ | At the end of the user test, all participants would be given a web link to complete a questionnaire with regard to their experiences of using the Android app and the web console. This serves as a channel for the testers to provide useful feedback on any usability issues that they have faced during the user test, or any improvements that they wish to see in the future for the Android app and the web console. | ||
+ | |||
+ | |} | ||
+ | |||
+ | ===Test Results=== | ||
+ | {| style="border: 1px solid darkgray; text-align: center;font-siz:14px; height:50px" | ||
+ | |scope="row" width="1000" style="text-align: left; background: #eeeeee"| | ||
+ | <b>What do you like about the application?</b> | ||
+ | *I like that the phone is able to help me read a certain piece of information very quickly and I also like it that this app helps me save a lot of time | ||
+ | *I enjoyed the process of loaning an asset, it helps save a lot of time and makes my work easier | ||
+ | *The app is very enjoyable to use and it was easy to navigate. | ||
+ | *This application was easy to use and helps us save a lot of time | ||
+ | *I really like this app a lot. I can forsee that it will help make a lot of processes in the company easier and it will help us save a lot of time | ||
+ | <br/> | ||
+ | <b>What do you dislike about the application?</b> | ||
+ | *The colour can be made more attractive | ||
+ | *Nothing much, it was easy to use and I understood how to use it almost immediately | ||
+ | *Maybe change the colour scheme, make it more exciting | ||
+ | <br/> | ||
+ | <b>What are some of the issues (if any) you faced while performing the tasks</b> | ||
+ | *Sometimes the app will lag, but its minor | ||
+ | *No issues | ||
+ | <br/> | ||
+ | <b>How can we improve this application to give you a better user experience?</b> | ||
+ | *It will be good to have a history record to see who made what changes, especially for the admin to keep track | ||
+ | *Maybe can allow us to take our own photos in the app | ||
+ | *One suggestion is that maybe you can think of a way to create a new database. We have many branches and some of these branches use different databases, is it possible to not let them be mixed? | ||
+ | *Maybe you can explore more into inventory management, our company needs that more | ||
+ | *I can see this app being used more for inventory compared to asset management, as we have a lot of inventory to manage. Maybe you can explore that in the future | ||
+ | <br/> | ||
+ | Click here for our response plan: [[https://wiki.smu.edu.sg/is480/img_auth.php/2/2a/Final_UT_Response_Plan.xlsx Response Plan]] | ||
+ | <br/> | ||
+ | [[Image: Ut3_1.png | 450px]] [[Image: Ut3_2.png | 450px]] | ||
+ | [[Image: Ut3_3.png | 450px]] [[Image: Ut3_4.png | 450px]] | ||
+ | [[Image: Ut3_5.png | 450px]] [[Image: Ut3_compiledresults.png | 450px]] | ||
+ | [[Image: Ut3_avgtime.png | 450px]] [[Image: Ut3_frequency.png | 450px]] | ||
+ | [[Image: Ut3_timesavings.png | 450px]] | ||
+ | |} | ||
+ | |||
+ | ===Documentation=== | ||
+ | {| style="border: 1px solid darkgray; text-align: center;font-siz:14px; height:50px" | ||
+ | |scope="row" width="330" style="text-align: left; background: #eeeeee"| | ||
+ | :1. '''Test Plan''' | ||
+ | :#[https://wiki.smu.edu.sg/is480/img_auth.php/b/b1/Final_UT_Test_Plan.docx Final User Test - Test Plan] <br> | ||
+ | :2. '''Scenario Task Lists''' | ||
+ | :#[https://wiki.smu.edu.sg/is480/img_auth.php/1/13/Invenio_ut2_admintask.docx Administrator Tasks] <br> | ||
+ | :#[https://wiki.smu.edu.sg/is480/img_auth.php/a/a3/Invenio_gen1task.docx General Employee 1 Tasks] <br> | ||
+ | :#[https://wiki.smu.edu.sg/is480/img_auth.php/f/f5/Invenio_gen2task.docx General Employee 2 Tasks] <br> | ||
+ | :#[https://wiki.smu.edu.sg/is480/img_auth.php/b/bf/Invenio_suptask.docx Supervisor Tasks] <br> | ||
+ | :#[https://wiki.smu.edu.sg/is480/img_auth.php/5/53/Invenio_auditortask.docx Auditor Tasks] <br> | ||
+ | :#[https://wiki.smu.edu.sg/is480/img_auth.php/b/b8/Invenio_maintenancetask.docx Maintenance Crew Tasks] <br> | ||
+ | :3. '''Qualtrics Survey Questions'''<br> | ||
+ | :#Survey Link: http://bit.ly/inveniotest <br> | ||
+ | :#Survey Raw Result: [https://wiki.smu.edu.sg/is480/img_auth.php/3/3c/Invenio_-_Final_UT_%28Responses%29.xlsx Raw Data] <br> | ||
:4. '''Participant Informed Consent Form'''<br> | :4. '''Participant Informed Consent Form'''<br> | ||
:#[https://wiki.smu.edu.sg/is480/img_auth.php/0/0d/Invenio_consentform.docx Consent Form] | :#[https://wiki.smu.edu.sg/is480/img_auth.php/0/0d/Invenio_consentform.docx Consent Form] | ||
|} | |} |
Latest revision as of 12:21, 10 April 2014
Home | Our Team | Project Overview | Project Management | Project Documentation | Learning Outcomes |
Use Cases | Diagrams | Usability Test | Minutes |
Contents
- 1 Internal Testing
- 2 Usability Test 1
- 3 Date & Venue
- 4 Participants
- 5 Scope of Test
- 6 Testing Method
- 7 Test Results
- 8 Documentation
- 9 Usability Test 2
- 10 Date & Venue
- 11 Participants
- 12 Scope of Test
- 13 Testing Method
- 14 Test Results
- 15 Documentation
- 16 Final User Test
- 17 Date & Venue
- 18 Participants
- 19 Scope of Test
- 20 Testing Method
- 21 Test Results
- 22 Documentation
Internal Testing
Our team has conducted internal testing using regression testing at the end of each iteration.
Please refer to the following for our test plan and test cases:
Usability Test 1
Date & Venue
Date: 24 Jan 2014 |
Participants
No. of Participants: 6
|
Scope of Test
Testing Method
We have designed different scenarios in a series of tasks, for the participants to follow during User Test 1. They would be required to figure out how to complete the set of tasks allocated to them. Facilitators would be beside them to observe and record the actions that the users have made in order to complete the tasks assigned. |
Test Results
What do you like about the application?
What are some of the issues you faced while performing the tasks?
How can we improve this application to give you a better / user experience?
|
Documentation
|
Usability Test 2
Date & Venue
Date: 7 February 2014 |
Participants
No. of Participants: 2
|
Scope of Test
For User Test 2, we have added in 2 new functions to test - Search for Asset and Export Asset Reports.
Testing Method
We have designed different scenarios in a series of tasks, for the participants to follow during User Test 2. They would be required to figure out how to complete the set of tasks allocated to them. Facilitators would be beside them to observe and record the actions that the users have made in order to complete the tasks assigned. |
Test Results
What do you like about the application?
|
Documentation
|
Final User Test
Date & Venue
Date: 7 March 2014 - 31 March 2014 |
Participants
No. of Participants: 5
Scope of TestThe version that was deployed for midterm was used for this User Test. Testing Method
Test Results
Documentation
|