Difference between revisions of "IS480 Team wiki: 2012T2 Team Prime Usability Tests"
Xc.shen.2009 (talk | contribs) (→Scope) |
|||
(16 intermediate revisions by 3 users not shown) | |||
Line 55: | Line 55: | ||
|} | |} | ||
<br> | <br> | ||
− | ====<font color="# | + | ====<font color="#794721">Scope</font>==== |
The table below shows a list of features that were tested for our first user test. The features target parents (representing registered users of Swimix) and swimming instructors.<br> | The table below shows a list of features that were tested for our first user test. The features target parents (representing registered users of Swimix) and swimming instructors.<br> | ||
{|class="wikitable" style="text-align: center;" | {|class="wikitable" style="text-align: center;" | ||
|+ | |+ | ||
|- | |- | ||
− | ! scope="col" width="50" style="background-color:# | + | ! scope="col" width="50" style="background-color:#794721"| <font color="#ffffff">No.</font> |
− | ! scope="col" width="300" style="background-color:# | + | ! scope="col" width="300" style="background-color:#794721"| <font color="#ffffff">Features</font> |
− | ! scope="col" width="100" style="background-color:# | + | ! scope="col" width="100" style="background-color:#794721"| <font color="#ffffff">Reg. User</font> |
− | ! scope="col" width="100" style="background-color:# | + | ! scope="col" width="100" style="background-color:#794721"| <font color="#ffffff">Instructor</font> |
|- | |- | ||
Line 81: | Line 81: | ||
|style="text-align: center"|Update User Profile<br> | |style="text-align: center"|Update User Profile<br> | ||
|✓ | |✓ | ||
− | | | + | |N/A |
|- | |- | ||
! scope="row" style="background-color:#F5f5f5"|<font color="#222222">4</font> | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">4</font> | ||
|style="text-align: center"|Update Instructor Profile<br> | |style="text-align: center"|Update Instructor Profile<br> | ||
− | | | + | |N/A |
|✓ | |✓ | ||
Line 93: | Line 93: | ||
|style="text-align: center"|Search for Class<br> | |style="text-align: center"|Search for Class<br> | ||
|✓ | |✓ | ||
− | | | + | |N/A |
|- | |- | ||
Line 99: | Line 99: | ||
|style="text-align: center"|Search for Instructor <br> | |style="text-align: center"|Search for Instructor <br> | ||
|✓ | |✓ | ||
− | | | + | |N/A |
|- | |- | ||
! scope="row" style="background-color:#F5f5f5"|<font color="#222222">7</font> | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">7</font> | ||
|style="text-align: center"|Create and Remove Lesson Slot<br> | |style="text-align: center"|Create and Remove Lesson Slot<br> | ||
− | | | + | |N/A |
|✓ | |✓ | ||
Line 110: | Line 110: | ||
! scope="row" style="background-color:#F5f5f5"|<font color="#222222">8</font> | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">8</font> | ||
|style="text-align: center"|Create and Remove Student Details<br> | |style="text-align: center"|Create and Remove Student Details<br> | ||
− | | | + | |N/A |
|✓ | |✓ | ||
|} | |} | ||
Line 121: | Line 121: | ||
#A total of '''2 swimming instructors''' participated in the user test in the role of an '''Instructor'''. | #A total of '''2 swimming instructors''' participated in the user test in the role of an '''Instructor'''. | ||
|} | |} | ||
+ | <br> | ||
− | ====<font color="# | + | ====<font color="#794721">Testing Methodology</font>==== |
{| cellpadding="10" style="border: 3px solid #222222; text-align: center; height:50px" | {| cellpadding="10" style="border: 3px solid #222222; text-align: center; height:50px" | ||
|scope="row" width="1000" style="text-align: left; background: #FFFFFB"| | |scope="row" width="1000" style="text-align: left; background: #FFFFFB"| | ||
Line 135: | Line 136: | ||
<br> | <br> | ||
− | ====<font color="# | + | ====<font color="#794721">Registered Users</font>==== |
<br> | <br> | ||
− | + | [[Image:UserFeedback1.png]]<br> | |
+ | :'''Solution: '''Place Login and Register in the same area and allow switching by tabs.<br> | ||
+ | |||
+ | [[Image:UserFeedback2.png]]<br> | ||
+ | :'''Solution: '''Change the View link to a button so users know that they can click on it to view the instructor’s profile<br> | ||
+ | |||
{| cellpadding="10" style="border: 3px solid #222222; text-align: center; height:50px" | {| cellpadding="10" style="border: 3px solid #222222; text-align: center; height:50px" | ||
|scope="row" width="1000" style="text-align: left; background: #FFFFFB"| | |scope="row" width="1000" style="text-align: left; background: #FFFFFB"| | ||
'''CONCLUSION'''<br> | '''CONCLUSION'''<br> | ||
− | + | Base on the user feedbacks, we found out that users are mostly receptive to the idea of a swim related search portal. The top 2 favourite functions identified by the users were the Manage Search function and the Manage Notification function. They commented that the search function was easy to use and could be very useful to them. The notification function is also something they felt that is lacking right now which causes them to make wasted trip to the swimming pool only to find that the lesson was cancelled. | |
+ | The function that has the highest amount of users indicating that they are unlikely to use is the Instructor Review feature. They explained that they would not want to go through the trouble to register an account just to write a review for the instructors. However, they wouldn’t mind writing one if there is a simpler and more convenient alternative. | ||
+ | One tester commented that he prefer to register with the instructor in person instead of looking at the instructor’s photo on the computer screen because by doing so, he could infer the instructor’s character and personalities. | ||
+ | One of the possible solutions was to include a short introduction video clip of each instructor so that users are able to gauge on themselves through the video. | ||
+ | In conclusion, many users expressed that they portal is user-friendly and would be very useful to them. | ||
+ | |||
<br><br> | <br><br> | ||
'''For a more detailed version of the user feedback and the team's response plan:''' | '''For a more detailed version of the user feedback and the team's response plan:''' | ||
Line 151: | Line 162: | ||
<br> | <br> | ||
− | ====<font color="# | + | ====<font color="#794721">Instructors</font>==== |
+ | |||
+ | [[Image:InstructorFeedback1.png]]<br> | ||
+ | :'''Solution: ''' | ||
+ | :Use radio buttons instead of dropdown list.<br><br> | ||
+ | |||
+ | [[Image:InstructorFeedback2.png]]<br> | ||
+ | :'''Solution: ''' | ||
+ | :Display only the student name and contact number. | ||
+ | :Instructors can choose to click on the student's name to view the rest of their information.<br><br><br> | ||
− | |||
{| cellpadding="10" style="border: 3px solid #222222; text-align: center; height:50px" | {| cellpadding="10" style="border: 3px solid #222222; text-align: center; height:50px" | ||
|scope="row" width="1000" style="text-align: left; background: #FFFFFB"| | |scope="row" width="1000" style="text-align: left; background: #FFFFFB"| | ||
'''CONCLUSION'''<br> | '''CONCLUSION'''<br> | ||
− | + | It was hard for us to get instructors to test our system for us because they is usually busy all the time while they are at the pool. They will either be teaching a class, or be on duty as a security guard. Thus, we only manage to get 2 instructors testers during their lunch break period when it is too hot to conduct a swim class. | |
+ | Both instructors found the portal user friendly and they did not face any problem using the portal. The provided us with mostly aesthetics feedback of the portal eg. Student list too cluttered, login button too small. One important point which they commented was that they are always on the go. Thus, they prefer to use the system on their smartphone rather than in front of the computer. | ||
+ | <br> | ||
+ | '''For a more detailed version of the instructor feedback and the proposed changes:''' | ||
+ | #[https://docs.google.com/spreadsheet/ccc?key=0Ajh7vaXFbPqLdFNLdTRTNmtMeHdfUmMxMHN6TXJCZ1E#gid=4 <span style="color:#222222">Individual Instructor Feedback (Instructors)]</span> | ||
+ | #[https://docs.google.com/spreadsheet/ccc?key=0Ajh7vaXFbPqLdFNLdTRTNmtMeHdfUmMxMHN6TXJCZ1E#gid=2 <span style="color:#222222">Response Plan to Feedback (Instructors)]</span> | ||
|} | |} | ||
<br> | <br> | ||
− | ====<font color="# | + | |
+ | ====<font color="#794721">UT1 Supporting Documents</font>==== | ||
{|class="wikitable" style="color:#222222" | {|class="wikitable" style="color:#222222" | ||
|+ | |+ | ||
|- | |- | ||
− | ! scope="col" width="150" style="background-color:# | + | ! scope="col" width="150" style="background-color:#794721"| <font color="#ffffff">Phase</font> |
− | ! scope="col" width="300" style="background-color:# | + | ! scope="col" width="300" style="background-color:#794721"| <font color="#ffffff">Supporting Documents</font> |
|- | |- | ||
− | ! scope="row" style="background-color:# | + | ! scope="row" style="background-color:#FFFFFB"|<font color="#222222">Before Testing</font> |
| | | | ||
:1. [https://docs.google.com/document/d/1rDWL0l9kAKOBZLOz8PW1jfouBJ7jY0wwSyrxm3ULiAU/edit <span style="color:#FC6B2A">'''Execution Plan''']</span> | :1. [https://docs.google.com/document/d/1rDWL0l9kAKOBZLOz8PW1jfouBJ7jY0wwSyrxm3ULiAU/edit <span style="color:#FC6B2A">'''Execution Plan''']</span> | ||
|- | |- | ||
− | ! scope="row" style="background-color:# | + | ! scope="row" style="background-color:#FFFFFB"|<font color="#222222">During Testing</font> |
| | | | ||
:1. '''Scenario Task Lists''' | :1. '''Scenario Task Lists''' | ||
Line 185: | Line 210: | ||
|- | |- | ||
− | ! scope="row" style="background-color:# | + | ! scope="row" style="background-color:#FFFFFB"|<font color="#222222">After Testing</font> |
| | | | ||
:1. '''User Feedback''' | :1. '''User Feedback''' | ||
− | ::i) [https://docs.google.com/ | + | ::i) [https://docs.google.com/spreadsheet/ccc?key=0Ajh7vaXFbPqLdFNLdTRTNmtMeHdfUmMxMHN6TXJCZ1E#gid=3 <span style="color:#FC6B2A;">From Registered Users]</span> |
− | ::ii) [https://docs.google.com/ | + | ::ii) [https://docs.google.com/spreadsheet/ccc?key=0Ajh7vaXFbPqLdFNLdTRTNmtMeHdfUmMxMHN6TXJCZ1E#gid=4 <span style="color:#FC6B2A;">From Instructors]</span> |
:2. '''Qualtrics Survey Reports''' | :2. '''Qualtrics Survey Reports''' | ||
::i) [http://smusg.asia.qualtrics.com/SE/?SID=SV_eYaCNaS5iyDo5mJ <span style="color:#FC6B2A">Registered Users]</span> | ::i) [http://smusg.asia.qualtrics.com/SE/?SID=SV_eYaCNaS5iyDo5mJ <span style="color:#FC6B2A">Registered Users]</span> | ||
::ii) [http://smusg.asia.qualtrics.com/SE/?SID=SV_eDaokfSN0W1fct7<span style="color:#FC6B2A;">Instructors]</span> | ::ii) [http://smusg.asia.qualtrics.com/SE/?SID=SV_eDaokfSN0W1fct7<span style="color:#FC6B2A;">Instructors]</span> | ||
:3. '''Proposed Changes to Feedback''' | :3. '''Proposed Changes to Feedback''' | ||
− | ::i) [https:// | + | ::i) [https://docs.google.com/spreadsheet/ccc?key=0Ajh7vaXFbPqLdFNLdTRTNmtMeHdfUmMxMHN6TXJCZ1E#gid=0 <span style="color:#FC6B2A">For Registered Users]</span> |
− | ::ii) [https:// | + | ::ii) [https://docs.google.com/spreadsheet/ccc?key=0Ajh7vaXFbPqLdFNLdTRTNmtMeHdfUmMxMHN6TXJCZ1E#gid=2 <span style="color:#FC6B2A;">For Instructors]</span> |
+ | |} | ||
+ | |||
+ | ==<font color="#FC6B2A">'''User Test 2'''</font>== | ||
+ | ====<font color="#794721">Objectives</font>==== | ||
+ | {| cellpadding="10" style="border: 3px solid #222222; text-align: center; height:50px" | ||
+ | |scope="row" width="1000" style="text-align: left; background: #FFFFFB"| | ||
+ | '''OBJECTIVES:'''<br> | ||
+ | #To obtain feedback from our users with regards to the features in our application so as to improve its usability | ||
+ | #To ensure that the features developed matches the expectations of the real users (parents & instructors) | ||
+ | |} | ||
+ | <br> | ||
+ | ====<font color="#794721">Scope</font>==== | ||
+ | The table below shows a list of features that were tested for our first user test. The features target parents (representing registered users of Swimix) and swimming instructors.<br> | ||
+ | {|class="wikitable" style="text-align: center;" | ||
+ | |+ | ||
+ | |- | ||
+ | ! scope="col" width="50" style="background-color:#794721"| <font color="#ffffff">No.</font> | ||
+ | ! scope="col" width="300" style="background-color:#794721"| <font color="#ffffff">Features</font> | ||
+ | ! scope="col" width="100" style="background-color:#794721"| <font color="#ffffff">Reg. User</font> | ||
+ | ! scope="col" width="100" style="background-color:#794721"| <font color="#ffffff">Instructor</font> | ||
+ | |- | ||
+ | |||
+ | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">1</font> | ||
+ | |style="text-align: center"|Register / Log in / Log out<br> | ||
+ | |✓ | ||
+ | |✓ | ||
+ | |||
+ | |- | ||
+ | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">2</font> | ||
+ | |style="text-align: center"|Search for Class / Instructor<br> | ||
+ | |✓ | ||
+ | |N/A | ||
+ | |||
+ | |- | ||
+ | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">3</font> | ||
+ | |style="text-align: center"|Pay for Class<br> | ||
+ | |✓ | ||
+ | |N/A | ||
+ | |||
+ | |- | ||
+ | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">4</font> | ||
+ | |style="text-align: center"|Send Mass Notification to Students<br> | ||
+ | |N/A | ||
+ | |✓ | ||
+ | |||
+ | |- | ||
+ | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">5</font> | ||
+ | |style="text-align: center"|Send Evaluation Survey to Students<br> | ||
+ | |N/A | ||
+ | |✓ | ||
+ | |||
+ | |- | ||
+ | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">6</font> | ||
+ | |style="text-align: center"|Evaluate Instructor <br> | ||
+ | |✓ | ||
+ | |N/A | ||
+ | |||
+ | |- | ||
+ | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">7</font> | ||
+ | |style="text-align: center"|Add New Lesson Slot<br> | ||
+ | |N/A | ||
+ | |✓ | ||
+ | |||
+ | |- | ||
+ | ! scope="row" style="background-color:#F5f5f5"|<font color="#222222">8</font> | ||
+ | |style="text-align: center"|Add Student to Lesson Slot<br> | ||
+ | |N/A | ||
+ | |✓ | ||
+ | |} | ||
+ | |||
+ | ====<font color="#794721">Testing Methodology</font>==== | ||
+ | {| cellpadding="10" style="border: 3px solid #222222; text-align: center; height:50px" | ||
+ | |scope="row" width="1000" style="text-align: left; background: #FFFFFB"| | ||
+ | '''Collecting of Qualitative Metrics'''<br> | ||
+ | #Participants are encouraged to think aloud their thought process as they are performing each task. For example, we would encourage them to say whatever they are looking at, thinking, doing, and feeling as they go about the task. This enables us as the observer to better understand each participant’s thought processs and see first-hand the process of him/her completing the task. | ||
+ | #Facilitators will observe for usability issues during the testing procedure by recording down what participants say. The test sessions will also be video-recorded on Screen Flow so that we can go back and refer to what participants did and how they reacted. | ||
+ | #In addition, after participants have completed the user test, they will be asked to do a satisfaction level survey that will aid in the collection of qualitative metrics.<br><br> | ||
+ | '''Collecting of Quantitative Metrics'''<br> | ||
+ | #The amount of time taken to complete each task | ||
+ | #The number of clicks taken for each task | ||
+ | |} | ||
+ | <br> | ||
+ | |||
+ | ====<font color="#794721">Registered Users</font>==== | ||
+ | <font color="#FC6B2A">'''FEEDBACK:'''</font><br><br> | ||
+ | [[Image:Prime_UT2Feedback2.png]]<br> | ||
+ | :'''Solution: ''' | ||
+ | :Replace “Please Select” with “No Preference”, and remove the unnecessary “Zone” search option.<br><br> | ||
+ | |||
+ | [[Image:Prime_UT2Feedback3.png]]<br> | ||
+ | :'''Solution:''' | ||
+ | :Replace “ Use a different color for the instructor’s name and bold it. <br><br> | ||
+ | |||
+ | [[Image:Prime_UT2Feedback4.png]]<br> | ||
+ | :'''Solution: ''' | ||
+ | : Include a popup message to inform unregistered users to login first before making payment.<br><br> | ||
+ | |||
+ | ====<font color="#794721">Instructors</font>==== | ||
+ | <font color="#FC6B2A">'''FEEDBACK:'''</font><br> | ||
+ | [[Image:Prime_UT2Feedback1.png]]<br> | ||
+ | :'''Solution: ''' | ||
+ | :Replace the photos with useful information on how the system works. <br><br> | ||
+ | |||
+ | ====<font color="#794721">UT2 Supporting Documents</font>==== | ||
+ | {|class="wikitable" style="color:#222222" | ||
+ | |+ | ||
+ | |- | ||
+ | ! scope="col" width="150" style="background-color:#794721"| <font color="#ffffff">Phase</font> | ||
+ | ! scope="col" width="300" style="background-color:#794721"| <font color="#ffffff">Supporting Documents</font> | ||
+ | |- | ||
+ | |||
+ | ! scope="row" style="background-color:#FFFFFB"|<font color="#222222">Before Testing</font> | ||
+ | | | ||
+ | :1. [https://docs.google.com/document/d/1xNeLGyzfHjWFYcsQfChWEjVnDxmyRnpeHqg8IL-KcuM/edit <span style="color:#FC6B2A">'''Execution Plan''']</span> | ||
+ | |- | ||
+ | |||
+ | ! scope="row" style="background-color:#FFFFFB"|<font color="#222222">During Testing</font> | ||
+ | | | ||
+ | :1. '''Task Lists''' | ||
+ | ::i) [https://docs.google.com/document/d/1T0tgCDvz8cjJ0fJSP4ZpcX32Zyq5kJmXh6hyG-WOlro/edit <span style="color:#FC6B2A;">For Registered Users]</span> | ||
+ | ::ii) [https://docs.google.com/document/d/1O1vSQVf2gZbYB-pGLUc3z_Ext9J6yzgCKo447FJ6S9w/edit <span style="color:#FC6B2A;">For Instructors]</span> | ||
+ | :2. '''Qualtrics Surveys''' | ||
+ | ::i) [http://smusg.asia.qualtrics.com/SE/?SID=SV_b2uqf3VdT9Txmhn <span style="color:#FC6B2A">For Registered Users]</span> | ||
+ | ::ii) [http://smusg.asia.qualtrics.com/SE/?SID=SV_elkDiTUF4sZ8ldb <span style="color:#FC6B2A;">For Instructors]</span> | ||
+ | :3. [https://docs.google.com/document/d/1wZJp3T95bXgk9FmWkA1I6XfjSNBYoAI0zHmcPf6YQ78/edit <span style="color:#FC6B2A">'''Facilitator Script'''</span>] | ||
+ | |||
+ | |- | ||
+ | ! scope="row" style="background-color:#FFFFFB"|<font color="#222222">After Testing</font> | ||
+ | | | ||
+ | :1. '''User Feedback''' | ||
+ | ::i) [https://docs.google.com/spreadsheet/ccc?key=0AmZnvFmI-HxRdENpcnp0TFMtZ0hUUlBha2NkVTIzaEE#gid=3 <span style="color:#FC6B2A;">From Registered Users]</span> | ||
+ | ::ii) [https://docs.google.com/spreadsheet/ccc?key=0AmZnvFmI-HxRdENpcnp0TFMtZ0hUUlBha2NkVTIzaEE#gid=6 <span style="color:#FC6B2A;">From Instructors]</span> | ||
+ | :2. '''Qualtrics Surveys''' | ||
+ | ::i) [http://smusg.asia.qualtrics.com/SE/?SID=SV_b2uqf3VdT9Txmhn <span style="color:#FC6B2A">Registered Users]</span> | ||
+ | ::ii) [http://smusg.asia.qualtrics.com/SE/?SID=SV_elkDiTUF4sZ8ldb <span style="color:#FC6B2A;">Instructors]</span> | ||
+ | :3. '''Proposed Changes to Feedback''' | ||
+ | ::i) [https://docs.google.com/spreadsheet/ccc?key=0AmZnvFmI-HxRdENpcnp0TFMtZ0hUUlBha2NkVTIzaEE#gid=0 <span style="color:#FC6B2A">For Registered Users]</span> | ||
+ | ::ii) [https://docs.google.com/spreadsheet/ccc?key=0AmZnvFmI-HxRdENpcnp0TFMtZ0hUUlBha2NkVTIzaEE#gid=5 <span style="color:#FC6B2A;">For Instructors]</span> | ||
|} | |} |
Latest revision as of 17:47, 21 April 2013
HOME | PROJECT OVERVIEW | PROJECT MANAGEMENT | DOCUMENTATION |
Contents
User Test 1
Objectives
OBJECTIVES:
|
Scope
The table below shows a list of features that were tested for our first user test. The features target parents (representing registered users of Swimix) and swimming instructors.
No. | Features | Reg. User | Instructor |
---|---|---|---|
1 | Register / Log in / Log out |
✓ | ✓ |
2 | Change Password |
✓ | ✓ |
3 | Update User Profile |
✓ | N/A |
4 | Update Instructor Profile |
N/A | ✓ |
5 | Search for Class |
✓ | N/A |
6 | Search for Instructor |
✓ | N/A |
7 | Create and Remove Lesson Slot |
N/A | ✓ |
8 | Create and Remove Student Details |
N/A | ✓ |
THE SESSION
|
Testing Methodology
Collecting of Qualitative Metrics
Collecting of Quantitative Metrics
|
Registered Users
- Solution: Place Login and Register in the same area and allow switching by tabs.
- Solution: Change the View link to a button so users know that they can click on it to view the instructor’s profile
CONCLUSION
|
Instructors
- Solution:
- Use radio buttons instead of dropdown list.
- Solution:
- Display only the student name and contact number.
- Instructors can choose to click on the student's name to view the rest of their information.
CONCLUSION
|
UT1 Supporting Documents
Phase | Supporting Documents |
---|---|
Before Testing | |
During Testing |
|
After Testing |
|
User Test 2
Objectives
OBJECTIVES:
|
Scope
The table below shows a list of features that were tested for our first user test. The features target parents (representing registered users of Swimix) and swimming instructors.
No. | Features | Reg. User | Instructor |
---|---|---|---|
1 | Register / Log in / Log out |
✓ | ✓ |
2 | Search for Class / Instructor |
✓ | N/A |
3 | Pay for Class |
✓ | N/A |
4 | Send Mass Notification to Students |
N/A | ✓ |
5 | Send Evaluation Survey to Students |
N/A | ✓ |
6 | Evaluate Instructor |
✓ | N/A |
7 | Add New Lesson Slot |
N/A | ✓ |
8 | Add Student to Lesson Slot |
N/A | ✓ |
Testing Methodology
Collecting of Qualitative Metrics
Collecting of Quantitative Metrics
|
Registered Users
- Solution:
- Replace “Please Select” with “No Preference”, and remove the unnecessary “Zone” search option.
- Solution:
- Replace “ Use a different color for the instructor’s name and bold it.
- Solution:
- Include a popup message to inform unregistered users to login first before making payment.
Instructors
- Solution:
- Replace the photos with useful information on how the system works.
UT2 Supporting Documents
Phase | Supporting Documents |
---|---|
Before Testing | |
During Testing |
|
After Testing |
|