HeaderSIS.jpg

IS480 Team wiki: 2014T1 Techne Logos Project Documentation Testing

From IS480
Jump to navigation Jump to search
Technelogos.png

Home

 

Techne Logos

 

Project Overview

 

Project Management

 

Project Documentation

 
Prototypes Diagrams Testing Minutes


User Test 2

The specifications for this second test is to verify the business idea and concept of the system as a viable proof of concept. The tests for the mobile system and the CMS were performed in separate sessions and the findings for these sessions were enlightening for the team.

The demographics of the participants found for this second test remain similar to those found in the first user test.
The testing of the mobile app continued to target mobile device users, and the CMS with advertisers/ media owners

Study Design Document (Mobile)
Study Design Document (CMS)

Mobile Application Study Result

The mobile application study was mainly focused on finding out if consumers would prefer scanning images of the advertisement themselves as compared to QR codes.

From the testing performed, we have discovered that most people find that scanning an advertising image was more aesthetically pleasing than scanning a QR code, with a score of 1 being the most unappealing and a score of 5 being the most appealing. The average scores were then compared, with advertising images gaining a higher average score than QR codes.

TL Mobile UT2.png

In the second half of the test, users were assessed on which media they found more preferable to scan. The results this time were more balanced, with the preference for scanning the image directly being slightly higher.

TL Mobile2 UT2.png

It is worth noting that some of the comments received for the preference for QR codes were that they are more distinct to recognise so that they are more obvious to users that they should be scanned while those who prefer scanning the image like the fact that they can essentially scan any image and it is perceived to be more high-tech to scan the image directly.

CMS Web Application Study Result

The CMS web application study was mainly focused on finding out if participants (advertisers/media owners) would find it more preferable to use scanning of the advertisement image and hence, the CMS than using QR codes to get product/ digital advertising information to their consumers.

The participants were first introduced to the CMS and the mobile companion app at the start of the study, where the workflow and business process behind the two systems will be explained. After the explanation of the workflow and business process, the participants are then asked to tasked with creating an advertisement to be that will be published to the mobile app. This is done so that the participants can gain a more hands-on experience with the business process behind the concept of the systems.

The findings from our study denote that in general, the participants found that the CMS was straightforward in its use, with the CMS obtaining an average score of 3.42 for its effectiveness in helping the participants to design mobile advertisement content.

TL CMS1.png

In addition to the effectiveness of the CMS, the study also questioned participants on their preference to use QR codes or to directly use the advertisement image for their consumers to scan. The general preference was for the scanning the advertising app directly, one particular point that we noticed during the study was the participants who work with more high-end brands tended towards scanning the image directly, while those who did more everyday brands tended towards QR codes. When questioned further, it was because high-end brands tended to place more emphasis on the creative content and would prefer not to have QR codes on the advertising image as they are regarded not to be aesthetically pleasing.

TL CMS2.png TL CMS3.png

This leads us to the next portion of our findings, which is that participants for the CMS also found that using the advertising image was more aesthetically pleasing, noting that while QR codes scan rather quickly, the overall look and feel of the advertisement would be different.

TL CMS4.png

User Test 1

We conducted our first user testing for both the MIP mobile application as well as the CMS web application with 10 users for the mobile application and 4 users for the CMS application.

For the testing of our mobile application, we approached users from the age group of 21 - 26 years old. This age group was chosen as we believe that the age group that would use our technology would be similar to those who use QR-code scanning (source). We conducted the test using the Samsung S4 smart phone that was loaned from the school.

QR Code.jpg
Proportion of QR code users


For the testing of our CMS web application, we approached users from the age group of 30-40 years. This age group was chosen as statistics have shown that this contains the larger portion of working executives (advertising included). User testing was conducted using the team's laptops.


Mobile Application Test Result

CLAIM: It will be easier and faster for users to find specific information about an ad via MIP as compared to users having to manually search for the information after seeing the ad

RESULT: Based on the test results using two magazine advertisements, our test shows that our mobile application is able to get the search results faster and in lesser clicks.

Mobile test result.png


CLAIM: The Activity page will help users to go back to an ad or ad content he/she has read more easily

RESULT: Based on the user feedback, most users strongly agree that with our mobile application, it is easier to recall the advertisement read.

Mobile test result2.png

CMS Web Application Test Result

CLAIM: Creating a marketing campaign is easy with our application

RESULT: Based on the user feedback, although users generally feel that our web application serves its function well, there is still areas to improve on.

Cms test result.png