HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2012T1 One-hit Wonder Final Wiki Usability Study"

From IS480
Jump to navigation Jump to search
Line 31: Line 31:
  
 
==<div style="background: #000000; padding: 5px; font-weight: bold; font-size:80%; color:#ffffff;">Usability Study: User Testing 2</div>==
 
==<div style="background: #000000; padding: 5px; font-weight: bold; font-size:80%; color:#ffffff;">Usability Study: User Testing 2</div>==
===<font color="#ffffff">Usability Study Recap</font>===
+
<!--Sub Navigation-->===<font color="#ffffff">Usability Study Recap</font>===
<!--Sub Navigation-->
 
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">Usability Study Recap</font>
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">Usability Study Recap</font>
Line 88: Line 87:
 
<div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2012T1_One-hit_Wonder_Final_Wiki_Usability_Study#Top|Back to Top]]</u></font></div>
 
<div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2012T1_One-hit_Wonder_Final_Wiki_Usability_Study#Top|Back to Top]]</u></font></div>
  
===<font color="#ffffff">UT2 Objective</font>===
+
<!--Sub Navigation-->===<font color="#ffffff">UT2 Objective</font>===
<!--Sub Navigation-->
 
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">UT2 Objective</font>
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">UT2 Objective</font>
Line 145: Line 143:
 
<div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2012T1_One-hit_Wonder_Final_Wiki_Usability_Study#Top|Back to Top]]</u></font></div>
 
<div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2012T1_One-hit_Wonder_Final_Wiki_Usability_Study#Top|Back to Top]]</u></font></div>
  
===<font color="#ffffff">Procedure</font>===
+
<!--Sub Navigation-->===<font color="#ffffff">Procedure</font>===
<!--Sub Navigation-->
 
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">Procedure</font>
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">Procedure</font>
Line 176: Line 173:
 
<div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2012T1_One-hit_Wonder_Final_Wiki_Usability_Study#Top|Back to Top]]</u></font></div>
 
<div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2012T1_One-hit_Wonder_Final_Wiki_Usability_Study#Top|Back to Top]]</u></font></div>
  
===<font color="#ffffff">Results & Analysis</font>===
+
<!--Sub Navigation-->===<font color="#ffffff">Results & Analysis</font>===
<!--Sub Navigation-->
 
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">Results & Analysis</font>
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">Results & Analysis</font>
Line 189: Line 185:
 
<div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2012T1_One-hit_Wonder_Final_Wiki_Usability_Study#Top|Back to Top]]</u></font></div>
 
<div style = "text-align:right;"><font ="color:#000000; size:"12px;"><u>[[IS480_Team_wiki:_2012T1_One-hit_Wonder_Final_Wiki_Usability_Study#Top|Back to Top]]</u></font></div>
  
===<font color="#ffffff">Improvements</font>===
+
<!--Sub Navigation-->===<font color="#ffffff">Improvements</font>===
<!--Sub Navigation-->
 
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
{| style="background-color:none; text-align: justify; color:#ffffff; font-weight: bold; border-bottom:0px solid #FFC786; border-left:0px solid #000000; border-right:0px solid #000000;" cellspacing="0" cellpadding="0" valign="top" |
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">Improvements</font>
 
| style="padding:10px 20px; font-size:130%; background-color:#dfeff0; border-top-left-radius: 10px; border-top-right-radius: 10px; -webkit-box-shadow: 0px 0px 6px #dfeff0;" | <font color="#000000">Improvements</font>

Revision as of 07:35, 29 November 2012

HomeOHW.png Home

Project Progress

Project Management

Project Quality

Usability Study

Reflection

Slides and Poster

Usability Study: User Testing 2

Usability Study Recap

Usability Study Recap

HEURISTIC EVALUATION

In order to find out the usability of Flauntpage, we conducted a Heuristic Evaluation.

This HE focuses mainly on 8 Usability Heuristics focus points as follows:

  1. Be consistent
  2. Focus on tasks
  3. Provide feedback
  4. Follow established conventions
  5. Speak the user’s language
  6. Prevent errors
  7. Minimize clicks
  8. Avoid scrolling

Refer to detailed analysis of Heuristic Evaluation here


USER TESTING 1

Our first User Testing was conducted to gather more in-depth insights on the usability of FlauntPage and to ensure that the deployed version is running smoothly.

We also gathered many valuable feedbacks on how we could improve the workflow due to varying human behavior and other user interface improvements


Refer to detailed analysis of UT1 here


Difference between UT1 & UT2

UT1 UT2
Objectives To ensure that FlauntPage is performing well on the server with no major bugs and errors caught in the process. To find out the effectiveness of FlauntPage and how convenient it is for users to create employment documents using our application as compared to other tools like Microsoft Word.

To find out the effectiveness and value of FlauntPage and how convenient it is for companies to find suitable candidates as compared to other channels (e.g Other job portals, newspaper, company website etc)

Execution Guided.

Users assigned a role and given detailed test cases with guided steps to follow. Users rated difficulty and gave comments for each task completed.

Unguided.

Part I: Users assigned a role and given a resume template to create a replica of the resume using Microsoft words and FlauntPage. Timings will taken for creation of documents and we later observed users behavior when using FlauntPage.
Part II: A new group of testers to measure the quality of the resumes created by Part I's users.

Back to Top

UT2 Objective

UT2 Objective

Execution Period: 5th November 2012 - 7th November 2012 (3 days)


Job Seeker:

To find out the effectiveness of FlauntPage and how convenient it is for users to create employment documents using our application as compared to other tools like Microsoft Word.

Job Seeker
Total no. of testers 16

M.png M.png M.png M.png M.png M.png M.png M.png
F.png F.png F.png F.png F.png F.png F.png F.png

Browser used Google Chrome & Firefox
Age range 18 - 30
No. of testers assigned difficult level 10
No. of testers assigned easy level 6


Company:

To find out the effectiveness and value of FlauntPage and how convenient it is for companies to find suitable candidates as compared to other channels (e.g Other job portals, newspaper, company website etc)

Company
Total no. of testers 2
Browser used Google Chrome
Company name/Tester Richemont Luxury (Singapore) Pte Ltd and Hiring Consultant
Back to Top

Procedure

Procedure

Part 1:

  1. Tester will be assigned to complete a resume using either the easy or difficult version of the sample resume information
  2. Create a resume using Microsoft Word (Activity timed)
  3. Testers are required to format the layout and imagine that they are sending this resume out to apply for a job
  4. Login to dev.flauntpage.com and create a resume using the same piece of information provided (Activity timed)
  5. Team will record the time taken in completing the resume for both the MS Word and Flauntpage version.
  6. Navigate around the application – Flauntpage freely to try out other functionalities
  7. Answer a few questions on their general feelings of our application – FlauntPage


Download sample of easy template here
Download sample of difficult template here
Download sample of user overall experience feedback here


Part 2:

  • With all the resumes collected from the previous testers, we will get another group of testers to measure the quality of the resume.
  • Testers were given 16 sets of resumes (consist of both MS Word & FlauntPage version, randomized) and tasked to rate each resume between the scale of 1 to 5 (1 being the lowest)
Back to Top

Results & Analysis

Results & Analysis
  1. Based on the feedbacks provided by the testers in Part 1 of the testing, team identified the major feedbacks and implemented the changes
  2. With the ratings provided by the testers in Part 2, team ploted a graph (time vs quality) to identify the correlation between MS Word and FlauntPage
Back to Top

Improvements

Improvements

Instant Resume Template (Finalized Layout):

Resume1.jpg Resume2.jpg


Cover Letter Template (Finalized Layout):

Coverletter1.jpg

Back to Top