Difference between revisions of "IS480 Team wiki: 2012T1 Timber Werkz UsabilityTest"
(8 intermediate revisions by 2 users not shown) | |||
Line 64: | Line 64: | ||
{| cellpadding="9" style="border: 1px solid darkgray; text-align: center; height:50px" | {| cellpadding="9" style="border: 1px solid darkgray; text-align: center; height:50px" | ||
|scope="row" width="1000" style="text-align: left; background: #FFF8C6"| | |scope="row" width="1000" style="text-align: left; background: #FFF8C6"| | ||
− | '''1. Determine that the usage of the features in the [http://casting3.hopto.org application] are consistent to the expectations of the users (acting as of Casting Managers & Artistes)'''<br><br> | + | '''1. Determine that the usage of the features in the [http://dev-casting3.hopto.org/ application] are consistent to the expectations of the users (acting as of Casting Managers & Artistes)'''<br><br> |
'''2. Obtain feedback from users such as to improve the usability (learnability, efficiency, errors, satisfaction) and aesthetics of our application''' | '''2. Obtain feedback from users such as to improve the usability (learnability, efficiency, errors, satisfaction) and aesthetics of our application''' | ||
|} | |} | ||
Line 355: | Line 355: | ||
{| cellpadding="9" style="border: 1px solid darkgray; text-align: center; height:50px" | {| cellpadding="9" style="border: 1px solid darkgray; text-align: center; height:50px" | ||
|scope="row" width="1000" style="text-align: left; background: #FFF8C6"| | |scope="row" width="1000" style="text-align: left; background: #FFF8C6"| | ||
− | '''1. Determine that the usage of the features in the [http://casting3.hopto.org application] are consistent to the expectations of <ins><font color="#D00000 ">real</font></ins> users (Casting Managers & Artistes)'''<br><br> | + | '''1. Determine that the usage of the features in the [http://dev-casting3.hopto.org/ application] are consistent to the expectations of <ins><font color="#D00000 ">real</font></ins> users (Casting Managers & Artistes)'''<br><br> |
'''2. Obtain feedback from users such as to improve the usability (learnability, efficiency, errors, satisfaction) and aesthetics of our application''' | '''2. Obtain feedback from users such as to improve the usability (learnability, efficiency, errors, satisfaction) and aesthetics of our application''' | ||
|}<br> | |}<br> | ||
− | |||
===<font color="#4D268F">Scope of Test</font>=== | ===<font color="#4D268F">Scope of Test</font>=== | ||
Line 494: | Line 493: | ||
<div style = "text-align:right; padding: 0px 30px 0px 45px;">[[IS480_Team_wiki:_2012T1_Timber_Werkz_UsabilityTest#Top|Back to Top]]</div> | <div style = "text-align:right; padding: 0px 30px 0px 45px;">[[IS480_Team_wiki:_2012T1_Timber_Werkz_UsabilityTest#Top|Back to Top]]</div> | ||
− | ===<font color="#4D268F">Actual and results</font>=== | + | ===<font color="#4D268F">Actual test and results</font>=== |
However, as there wasn't any ongoing casting calls at the point where we carried out Usability Test 2, we decided to proceed with only a lab test and leave the field test for later. With Oak3's help and support, we gathered artistes with the following profiles: <br/> | However, as there wasn't any ongoing casting calls at the point where we carried out Usability Test 2, we decided to proceed with only a lab test and leave the field test for later. With Oak3's help and support, we gathered artistes with the following profiles: <br/> | ||
<br> | <br> | ||
Line 505: | Line 504: | ||
{| cellpadding="9" style="border: 1px solid darkgray; text-align: center; height:50px" | {| cellpadding="9" style="border: 1px solid darkgray; text-align: center; height:50px" | ||
|scope="row" width="900" style="text-align: left; background: #FFF8C6"| | |scope="row" width="900" style="text-align: left; background: #FFF8C6"| | ||
− | ''' | + | '''Collecting qualitative metrics (Lab Test)'''<br> |
:Users are encouraged to think out loud while accomplishing each task so as to better allow the facilitators to record down accurate observations and significant details of the testers’ thought processes. Facilitators will also be observing for errors (e.g. false clicks) and navigation issues. Upon completion of all the tasks, the tester will be presented a questionnaire in which he will be asked what he dislikes / likes about the application and their satisfaction level of the application. | :Users are encouraged to think out loud while accomplishing each task so as to better allow the facilitators to record down accurate observations and significant details of the testers’ thought processes. Facilitators will also be observing for errors (e.g. false clicks) and navigation issues. Upon completion of all the tasks, the tester will be presented a questionnaire in which he will be asked what he dislikes / likes about the application and their satisfaction level of the application. | ||
[[Image:1351780541_27-Edit Text.png|right]]<br> | [[Image:1351780541_27-Edit Text.png|right]]<br> | ||
Line 512: | Line 511: | ||
:The testing process will also be recorded via video using '''[http://www.telestream.net/screenflow/overview.htm Screenflow]''' and will complement the facilitators’ observations. Facilitators are to record the timing in which a note-worthy observation (e.g. body language response) occurred. | :The testing process will also be recorded via video using '''[http://www.telestream.net/screenflow/overview.htm Screenflow]''' and will complement the facilitators’ observations. Facilitators are to record the timing in which a note-worthy observation (e.g. body language response) occurred. | ||
− | |||
− | |||
− | |||
|}<br> | |}<br> | ||
Line 529: | Line 525: | ||
|style="text-align: left;"| | |style="text-align: left;"| | ||
:1. '''[https://docs.google.com/document/d/1SMrs7RGpbMa0RRNFAC8Nqsa0OfPPfd28ejGwAu83ckM/edit UT2 Plan]''' | :1. '''[https://docs.google.com/document/d/1SMrs7RGpbMa0RRNFAC8Nqsa0OfPPfd28ejGwAu83ckM/edit UT2 Plan]''' | ||
− | :2. '''[https://docs.google.com/spreadsheet/ccc?key=0AgWbd4V2n6c-dHY4clprVjZ4UTNucVZsVW9rN1UwWXc#gid=0 Artiste Observed Feedback]''' | + | :2. '''[https://docs.google.com/spreadsheet/ccc?key=0AgWbd4V2n6c-dHY4clprVjZ4UTNucVZsVW9rN1UwWXc#gid=0 Artiste Observed Feedback and Response Plan]''' |
<!--:3. '''[https://docs.google.com/document/d/1mJJ0f2Jb_arU57sMEQZKS-TtE8pNITMYi7eNEVYM8sc/edit Artiste Survey Template]'''--> | <!--:3. '''[https://docs.google.com/document/d/1mJJ0f2Jb_arU57sMEQZKS-TtE8pNITMYi7eNEVYM8sc/edit Artiste Survey Template]'''--> | ||
− | :3. '''[http://edu.surveygizmo.com/s3/1065819/Artiste-Feedback Artiste Survey | + | :3. '''[http://edu.surveygizmo.com/s3/1065819/Artiste-Feedback Artiste Survey Link]''' |
:4. '''[https://docs.google.com/file/d/0BzUq1d4sV8JQRkxVRVBpeDV1SGM/edit Artiste Survey Results Report]''' | :4. '''[https://docs.google.com/file/d/0BzUq1d4sV8JQRkxVRVBpeDV1SGM/edit Artiste Survey Results Report]''' | ||
+ | :5. '''[https://docs.google.com/spreadsheet/ccc?key=0AhS1AYvg7B7DdGF1OGxGelQ2bzljOWhTZUZ5U0p6X1E#gid=1 Casting Manager Observed Feedback and Response Plan]''' | ||
+ | :6. '''[https://docs.google.com/document/d/1pvLflUVvNzhR8btjHcYnIhJ_2d0rQ8Dt4OSX10usboE/edit Casting Manager Task List]''' | ||
+ | :7. '''[https://docs.google.com/document/d/1PDfg0I8LtbgCiJJCG7jk5KG63q0_iyc6eTOdnjQ0N5g/edit Artiste Task List]''' | ||
+ | |} | ||
+ | <br> | ||
− | | | + | ===<font color="#4D268F">Extract of Solutions to Most Common Feedback</font>=== |
+ | [[Image:UT21.png|900px]]<br><br><br> | ||
+ | [[Image:TW_UT22.png|900px]] | ||
<div style = "text-align:right; padding: 0px 30px 0px 45px;">[[IS480_Team_wiki:_2012T1_Timber_Werkz_UsabilityTest#Top|Back to Top]]</div> | <div style = "text-align:right; padding: 0px 30px 0px 45px;">[[IS480_Team_wiki:_2012T1_Timber_Werkz_UsabilityTest#Top|Back to Top]]</div> |
Latest revision as of 23:50, 28 November 2012
HOME | PROJECT OVERVIEW | PROJECT MANAGEMENT | DOCUMENTATION |
<< MID-TERM WIKI << FINAL WIKI
Usability Test 1
Objectives
Scope of TestSession 1 (Casting Managers)
Session 2 (Artistes)Session 2 was conducted from 9 - 14 Sept 2012
Testing Methodology
Supporting Documents UT1
|
Usability Test 2
Objectives
Scope of TestThe scope of the test has been expanded from Usability Test 1 to include 6 more features:
Plan for Usability Test 2
initially, we planned to have both a lab test and field test for Usability Test 2. The lab test will be a more controlled one, whereby we could sit beside the users and observe their usage of our system. The field test, however, will be carried out at the actual environment (e.g. artistes at their homes and casting managers at their offices) to determine if they are capable of using the system at their own comfort without our guidance and interference. Also, we wanted to carry out a pilot test before the actual test to verify if our planned test goes according to our expectations, and to make any necessary changes before the actual test. The following chart shows our original plan for Usability Test 2: Actual test and resultsHowever, as there wasn't any ongoing casting calls at the point where we carried out Usability Test 2, we decided to proceed with only a lab test and leave the field test for later. With Oak3's help and support, we gathered artistes with the following profiles:
Testing Methodology
Supporting Documents UT2
Extract of Solutions to Most Common Feedback |
Field Test
Objectives
Field Test Details & Outcome
As of the submission date of this wiki page (28 Nov), the field test is ongoing and results have yet to be collated. The results will be later concluded in the following links: Feedback Links:
|