Difference between revisions of "IS480 Team wiki: 2011T2 Imateam User Testing"
Line 199: | Line 199: | ||
**Usability ratings of each individual function<br><br> | **Usability ratings of each individual function<br><br> | ||
'''Results Analysis'''<br><br> | '''Results Analysis'''<br><br> | ||
+ | Results were analyzed then categorized according to the user roles because each role had different test cases to perform. | ||
+ | |||
+ | We derived at the following information from the data that we collected: | ||
+ | *Average passed/failed test cases percentage (for Admin, Organizer, Speaker, Attendee roles) | ||
+ | *Completion rate of each task (most often failed test case and the no. of times it failed) | ||
+ | *Function Usability Ratings<br><br> | ||
+ | [[Image:Clickdl-brown.png]] [[Media:UTResults.pptx|<span style="color: #000000; padding: 10px 15px 0 15px; font-size: 14px;">Click to download our results analysis</span>]] | ||
+ | |- | ||
+ | | colspan="2" class="radius_bottom" style="background:#7e786f; border:2px solid #7e786f" |<div style="font-size:0">[[image:pix.gif|15px]]</div> | ||
+ | |||
+ | |} | ||
+ | |||
+ | <div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2011T2_Imateam_User_Testing#Top|Back to Top]]</u></font></div> | ||
+ | |||
+ | <div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2011T2_Imateam_User_Testing#Top|Back to Top]]</u></font></div> | ||
+ | =='''Changes Made'''== | ||
+ | ===<div style="color: #ffffff; font-size:0%">Data Collected</div>=== | ||
+ | {| border="0" cellspacing="0" cellpadding="0" width="100%" | ||
+ | | style="background-color:#000000;" width="0" | | ||
+ | {| style="width="30%"; font-size:95%; text-align: justify;" padding:-2px; background:ffffff" cellpadding="0" cellspacing="0" | ||
+ | | rowspan="1" width="30%" colspan="2" height="37px" valign="top" style="background:#dfd8ce; border:2px solid #7e786f; border-bottom:0; padding:0; padding-right:1em; margin:0; -moz-border-radius-topright:1em" | <div style="margin-top: -20px; padding-left:3px"></div><div style="padding-left:10px; margin-top:20px; font-size:130%"><font color="#000000">Changes</font></div> | ||
+ | |} | ||
+ | | style="border-bottom:2px solid #7e786f; background:#ffffff;" width="8" | | ||
+ | | style="border-bottom:2px solid #7e786f; background:#ffffff;" width="100%"| | ||
+ | |} | ||
+ | {| style="width:100%; margin-bottom:.5em; font-size:100%; text-align: justify;" padding:-2px; background:FFFFFF" cellpadding="0" cellspacing="0" | ||
+ | | rowspan="1" width="100%" colspan="2" valign="top" style="background:#dfd8ce; border:2px solid #7e786f; border-bottom:0; border-top:0; padding:0; margin:0" | | ||
+ | <div style="padding:10px; text-align: justify;"> | ||
+ | <font color="#000000"><font size ="2px"> | ||
+ | '''Design'''<br><br> | ||
+ | Change colour/look of conference tabs<br> | ||
+ | Put more visual and familiar icons for links<br> | ||
+ | Indicated which page users are on currently<br> | ||
+ | New layout for Conference Page<br> | ||
+ | Reduced number of tabs<br> | ||
+ | Remove “Conference” from the tab names<br> | ||
+ | Created clear navigation for users to create notes<br> | ||
+ | Added new tab for Sponsors<br> | ||
+ | Changed the link to Feedback form | ||
+ | <br><br> | ||
+ | '''Functions'''<br><br> | ||
Results were analyzed then categorized according to the user roles because each role had different test cases to perform. | Results were analyzed then categorized according to the user roles because each role had different test cases to perform. | ||
Revision as of 18:23, 20 February 2012
"Lack of documentation is becoming a problem for acceptance."
Home | Team / Stakeholders | Project Overview | Project Documentation | Project Management | Resource & Reference | LOMS & Reflections |
Diagrams | Prototypes | Minutes of Meeting | User Testing Materials | Presentation Materials |
Contents
User Testing (Midterm) Methodology
Participants
|
Participants A pilot test will be conducted internally before the actual test begins. We will select a total for 30 participants for the actual user test: The participants' responsibilities will be to attempt to complete a set of representative task scenarios presented to them in as efficient and timely a manner as possible, and to provide feedback regarding the usability and acceptability of the user interface. The participants will be directed to provide honest opinions regarding the usability of the application, and to participate in post-session subjective questionnaires and debriefing. The best candidates to be engaged are: | |
Procedure
|
Participants will be divided down into 3 categories. These categories are namely IMAPAC staff, SMU professors and fellow students. IMAPAC staff will take on the role of Admin users. Our user tests will be held at Seminar Room 2-2 in Singapore Management University over 2 days. A computer with the web application will be loaded in the testing environment. The facilitator(s) seated in the same room will monitor the participant’s interaction with the web application. Note takers and data logger will monitor the sessions in a corner of the room to record quantitative and qualitative data. The test sessions will be photographed.
The debrief session will be taken very seriously as it allows participants to convey their exact feelings about the web application. After the debrief session, the testers will thank the participants for their involvement. | |
Materials/Documents
|
The following materials have been developed for record and evaluation purposes. Consent Form User Manual Questionnaires Test Cases | |
User Testing (Midterm) Analysis
Data Collected
|
Data Collected
Results Analysis We derived at the following information from the data that we collected:
| |
Changes Made
Data Collected
|
Design We derived at the following information from the data that we collected:
| |