HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T1 4Sight User Testing 3"

From IS480
Jump to navigation Jump to search
 
(7 intermediate revisions by the same user not shown)
Line 98: Line 98:
  
  
===2. Difficult to view the conversion rate chart ===
+
===3. Filter marketing channel for a specified time period===
 
{|  class="wikitable"  border="1"
 
{|  class="wikitable"  border="1"
 
|- style="background:#35404f; color:white"  
 
|- style="background:#35404f; color:white"  
Line 110: Line 110:
 
|}
 
|}
  
 +
Users pointed out that the current filter feature could be enhanced by allowing them to choose the period. This will be helpful for them when saving filters as they might only be interested to see marketing channels that were spent in a particular year and month.
  
 +
===4. Manage marketing channels ===
 +
<br/>
 +
[[File:UT3 enhancement4.png|600px|center|link=]]<br>
  
 +
Users made a request for a page to manage their marketing channels. As a marketing channel can be purchased at different point in time for a particular year (eg: Facebook can be purchased in Jan 2015, May 2015, Dec 2015..), the list of marketing channels will increase with time. A page to manage the marketing channels will be useful in keeping track of only the relevant marketing channels.
  
===Collated Feedback Score - Survey Questionnaire===
+
===5. Differentiate marketing channels in dropdown selection===
 
+
{|  class="wikitable"  border="1"
<div style="text-align: left; width:99%; margin-left:auto; margin-right:auto;">
+
|- style="background:#35404f; color:white"
{| class="wikitable" width="100%" font-family="Roboto Lt"
+
! style="text-align: center; bold;background: #35404f;color:white; width:20px; border:1px solid #999" | Before
 +
! style="text-align: center; bold;background: #35404f;color:white; width:20px; border:1px solid #999" | After
 
|-
 
|-
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:5%; border:1px solid #999" | #
+
|
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:30%; border:1px solid #999" | Question
+
[[File:UT3 enhancement5Before.png|500px]]
! style="font-family: Roboto Lt; text-align: center; bold;background: #34495e;color:#ecf0f1; width:60%; border:1px solid #999" | Collated Comments
+
||  
|-
+
[[File:UT3 enhancement5After.png|500px]]
| style="text-align:center" | 1
+
|}
| style="text-align:center" | What do you like about the application?
 
| style="text-align:center" | Very simple to use, simple to understand <br> Will make us efficient <br> Ease of use for essential tasks. Runs smoothly with no lag <br> I like the analytics dashboards as it simplifies the current process where a lot of my work was done manually, across multiple channels (CMS, paper, online shared doc and black book). An integrated platform like this helps reduce my workload <br> The app is easy to use. It will save us a lot of time especially in managing the appointments <br> Very simple to use and many of the features built are what we need <br> Very clear and nice <br> Very easy to use. Reduces human error, making us more efficient
 
  
|-
+
Users pointed out that the current dropdown for marketing channels does not differentiate the spending for the same marketing channel of different months. Hence the team made some modifications to address the concern raised.
| style="text-align:center" | 2
 
| style="text-align:center" | What do you not like about the application?
 
| style="text-align:center" | Disable auto swap? Maybe can prompt to swap appointment when you delete appointment on crowded days <br> Learning curve for swap waiting list patients is steep <br> Auto sending out of appointment reminder. Some patients might not like it <br> Quite hard to understand and use the swap appointment function
 
  
|-
 
| style="text-align:center" | 3
 
| style="text-align:center" | Comment on how easy it is to use the application
 
| style="text-align:center" | Easy to navigate around and update appointments <br> Application is intuitive <br> very easy to navigate
 
 
|-
 
| style="text-align:center" | 4
 
| style="text-align:center" | Comment on the overall usefulness of the application in helping you complete your daily tasks?
 
| style="text-align:center" | Compared to the current work process, this application greatly reduces the time needed for us to complete some tasks such as calling patients to remind them of appointment, collating the patient no show list etc. <br> Eliminates many of the manual work that we have been doing. Save us a lot of time and reduces error especially during peak periods. <br> Maintains old function of our appointments book, and can be updated <br> I like the analytics dashboards as it simplifies the current process where a lot of my work was done manually, across multiple channels (CMS, paper, online shared doc and black book). An integrated platform like this helps reduce my workload <br> Streamlined work process <br> Charts provided are useful as it allows drilling down of information <br> Application reflects current functions but make a lot easier
 
|}
 
</div>
 
  
 
===User Study Summary===
 
===User Study Summary===
* Overall, users find the application easy to user and intuitive to perform all required tasks
+
* Overall, users like the improvements/ enhancements we have made to the analytics dashboard in comparison with the one they have tested in user testing 2.
* Usability scores did not vary drastically from user to user
+
* The admin module received positive comments from user. No change was required.
* Number of clicks are fairly consistent compared to the members
+
* For the entire list of tasks, usability scores did not vary drastically from user to user. All tasks were rated at least 4/5.
* Users are satisfied and have positive comments on all the features of the application
 
* User provided good feedback for improvement
 
 
 
===User Study Takeaways===
 
* Consistent usability score for different users, considering that different users have different functions to perform in their day-to-day operation.
 
* With users' feedback, we identified areas of improvement on these functions. Eg. export function.
 
* Allow us to evaluate the usefulness of these features. Team will improve on the features based on users feedback and manage all change requests (remove/ add feature). Most feedback has been documented and accounted for in our implementation plan in which the team will work on it in subsequent development.
 

Latest revision as of 22:01, 23 November 2015

4Sight team logo.png
4Sight Home.png HOME   4Sight Team.png ABOUT US   4Sight Project overview.png PROJECT OVERVIEW   4Sight Project management.png PROJECT MANAGEMENT   4Sight Documentation.png DOCUMENTATION  
Technical Diagrams Design Documents Meeting Minutes User Testings Project Documents

Venue

  • Location: Clearvision @ 6 Nutmeg Road
  • Date: 16 November 2015 (Wednesday)
  • Time: 15:00pm

Objectives

1. Determine usability of the admin and analytics module
2. Verify if features built are in line with user requirements (admin & analytics modules)

Participants

  • Number of participants: 3
  • Roles of participants: admin and marketing team members

Tasks

Each of the users was given a list of tasks to complete. Click here to download tasklist. The tasklist also consists of some questionnaire to gather feedback from users.

Summary of Survey Results

Click here to download the raw data and analysis.

Based on users' feedback, we have made the following enhancements:

1. Limited listing available for selections

Before After

UT3 enhancement1Before.png

UT3 enhancement1After.png

During the testing, one of the users pointed out that the options for the listing were too limited. She mentioned that they often have to refer to marketing efforts in previous months (>3 months) to see the effectiveness of it. It would be more useful if they are able to conveniently view a year worth of data. Hence, based on the feedback gotten, we have improved on it by listing 1 year worth of data from the current month.

2. Difficult to view the conversion rate chart

Before After

UT3 enhancement2Before.png

UT3 enhancement2After.png

Both marketing members commented that they found it difficult to view the conversion rate chart as they were not able to quickly view at a glance as to which bar charts are for which particular marketing channel. The bar charts are so cramped together that they could not differentiate between the leads, converts and rate bar charts. In addition, they also raised a concern that the viewing of data will be made more difficult with increasing marketing channels in the future. Hence, based on the feedback gotten, we have added the zooming in of chart function (see after) to allow users to zoom in to a particular section of the chart. To address the concern raised, users can do the filtering using our filter feature that has been implemented before the user testing.


3. Filter marketing channel for a specified time period

Before After

UT3 enhancement3Before.png

UT3 enhancement3After.png

Users pointed out that the current filter feature could be enhanced by allowing them to choose the period. This will be helpful for them when saving filters as they might only be interested to see marketing channels that were spent in a particular year and month.

4. Manage marketing channels


UT3 enhancement4.png


Users made a request for a page to manage their marketing channels. As a marketing channel can be purchased at different point in time for a particular year (eg: Facebook can be purchased in Jan 2015, May 2015, Dec 2015..), the list of marketing channels will increase with time. A page to manage the marketing channels will be useful in keeping track of only the relevant marketing channels.

5. Differentiate marketing channels in dropdown selection

Before After

UT3 enhancement5Before.png

UT3 enhancement5After.png

Users pointed out that the current dropdown for marketing channels does not differentiate the spending for the same marketing channel of different months. Hence the team made some modifications to address the concern raised.


User Study Summary

  • Overall, users like the improvements/ enhancements we have made to the analytics dashboard in comparison with the one they have tested in user testing 2.
  • The admin module received positive comments from user. No change was required.
  • For the entire list of tasks, usability scores did not vary drastically from user to user. All tasks were rated at least 4/5.