Heuristic Evaluation
Note: This was done on our system coded in JSP.
Date: 22 October 2013
Purpose: To test if our system is intuitive enough to be used by people who have not used procurement systems before.
Results from HE
Data
|
Pilot Participant
|
Participant 1
|
Participant 2
|
Participant 3
|
Participants
|
|
|
|
|
Name
|
Shanaaz
|
Derrick
|
Meizhen
|
Joel
|
Age
|
23
|
22
|
22
|
27
|
Location
|
SIS Level 4
|
SIS Level 4
|
SIS Level 4
|
SIS Level 4
|
Web Browser
|
Google Chrome
|
Google Chrome
|
Google Chrome
|
Google Chrome
|
Quantitative Data
|
Prior experience with Procurement systems)
|
No
|
No
|
No
|
No
|
Ease of editing a project (Scale of 1 - 5 [highest])
|
5
|
4
|
5
|
5
|
Ease of searching for a project (Scale of 1 - 5 [highest])
|
5
|
3
|
4
|
5
|
Ease of learning & using the interface (Scale of 1 - 5 [highest])
|
5
|
4
|
5
|
4
|
Ease of navigating around the system (Scale of 1 - 5 [highest])
|
5
|
3
|
4
|
4
|
Able to quickly find information needed (Scale of 1 - 5 [highest])
|
5
|
4
|
3
|
3
|
Pathway for Manage Projects (Scale of [not completed] 0 - 2 [easily completed])
|
2
|
2
|
1
|
2
|
Pathway for Search Projects (Scale of [not completed] 0 - 2 [easily completed])
|
2
|
1
|
2
|
2
|
Pathway for Edit Project - Procurement Staff (Scale of [not completed] 0 - 2 [easily completed])
|
2
|
1
|
2
|
2
|
Pathway for Edit Project - Functional Owner (Scale of [not completed] 0 - 2 [easily completed])
|
2
|
2
|
2
|
2
|
Time taken to complete Manage Projects
|
2 min
|
25 sec
|
1 min
|
1 min
|
Time taken to complete Search Projects
|
1 min
|
3 min 30 sec
|
1 min
|
2 min
|
Time taken to complete Edit Project (Procurement Staff)
|
1 min
|
2 min
|
1 min
|
1 min
|
Time taken to complete Edit Project (Functional Owner)
|
2 min
|
3 min
|
1 min
|
1 min
|
Number of times participants asked for help
|
1
|
2
|
2
|
2
|
Number of bugs found in system
|
0
|
0
|
1
|
0
|
Qualitative Data
|
What does the participant think is required for a procurement workflow management system?
|
Good user interface and experience that is understood by all the departments involved.
|
Probably a centralised platform so that whoever is in-charge can manage the procurements
|
I am not too sure about how a procurement workflow management system is like.
|
Knowing the total number of projects on hand. Knowing important deadlines. Knowing who are the people involved.
|
Anything the participant like about our system?
|
I like the simple UI and easy navigation through the pages.
|
The UI looks rather professional.
|
Simple and easy to navigate. Not too much of information on one page.
|
The layout.
|
Anything the participant dislike about our system?
|
Not that I can think of at the moment. It was pretty easy and sleek.
|
Personal opinion is that there's too many information loaded on one page.
|
-
|
No help function.
|
Anything to be changed to provide an improved user experience?
|
1. It would be better if the search results appear on top of the User's current projects. 2. When I change the assigned user and save, I would like to see a confirmation message.
|
Maybe to provide those "changes have been saved" notifications.
|
1. If there is more than one table to be shown in a page, probably could use a different color for each table so that it is easier to identify and would not look as if there are too much of information in a page. 2. Color contrast can be improved.
|
Add a help function.
|
Changes to be made
- Instead of displaying search results under Other Projects section (where users still have to scroll down), we will place the Search Results in the same tab as the Search fields.
- We will include a help function to aid new users in navigating around the system.
- "Save Edits" button in the project details page will be placed both at the top and bottom of the page.
User Testing 1
Note: This is the first testing we have done with on our system coded with ASP.NET.
Date: 29 November 2013
Time: 5pm-6pm
User: Tam Chee Hong
Location: Skype (Screen sharing with our client as we are still using internal IP)
Browser: Google Chrome
Role: Procurement staff
Purpose: Evaluate usability of functions: Home page, Search project, View & Edit Project Details
Results from UT 1
|
Header text |
Header text
|
Example |
Example |
Example
|
Example |
Example |
Example
|
Example |
Example |
Example
|
User Testing 2
Will be conducted after acceptance.