HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2016T1 Airvolution FinalWiki"

From IS480
Jump to navigation Jump to search
 
(18 intermediate revisions by 2 users not shown)
Line 45: Line 45:
  
 
==Project Progress Summary==
 
==Project Progress Summary==
[[Image:Airvolution-Project-Summary.jpg|center|1024px|link=]]
+
[[Image:Project-Summary-1.jpg|center|1024px|link=]]
 
+
<center>Please click [https://drive.google.com/a/smu.edu.sg/file/d/0By0L3h6EiBjBT040cW1BUlBTWkU/view?usp=sharing here] to view our Poster</center>
<center>Please click [https://drive.google.com/a/smu.edu.sg/file/d/0By0L3h6EiBjBLUI5YjZVVDRaT2M/view?usp=sharing here] to view our Midterm presentation slides</center>
+
<center>Please click [https://drive.google.com/a/smu.edu.sg/file/d/0By0L3h6EiBjBa05WY3NoTzFkU0k/view?usp=sharing here] to view our Video Pitch</center>
 +
<center>Please click [https://drive.google.com/a/smu.edu.sg/file/d/0By0L3h6EiBjBOWp3YjJqSmhJUzQ/view?usp=sharing here] to view our Final Presentation Slides</center>
  
 
==Project Management==
 
==Project Management==
Line 127: Line 128:
  
 
===<div style=" font-size:85%; font-family:Century Gothic">Actual Project Schedule===
 
===<div style=" font-size:85%; font-family:Century Gothic">Actual Project Schedule===
[[Image:Project-Schedule-v4.jpg|center|824px|link=]]
+
[[Image:Project-Schedule-v5.jpg|center|824px|link=]]
 
<div style="margin-top: 20px;">
 
<div style="margin-top: 20px;">
 
{| class="wikitable" style="background-color:#FFFFFF; width:100%; text-align: center;"
 
{| class="wikitable" style="background-color:#FFFFFF; width:100%; text-align: center;"
Line 205: Line 206:
 
||Accept
 
||Accept
 
||Accept & Low Priority
 
||Accept & Low Priority
 +
||Closed
 +
|-
 +
||8
 +
||16 Oct 2016
 +
||Analytics Dashboard
 +
||To present our findings to UOB in order to get their validation
 +
||Vincent would like to compare our analysis and insights against what UOB has done to see how accurate we are in our analysis using our machine learning.
 +
||Accept
 +
||Accept & High Priority
 +
||Closed
 +
|-
 +
||9
 +
||20 Oct 2016
 +
||App
 +
||To formally drop good-to-have functions
 +
||We decided to focus on the quality of the functions rather than the quantity as we wanted to make the functions more user-friendly and more robust. 
 +
||Accept
 +
||Accept & High Priority
 
||Closed
 
||Closed
 
|-
 
|-
Line 211: Line 230:
  
 
===<div style="background: #226C9A; padding: 15px; line-height: 0.3em; text-indent: 15px;  font-size:85%; font-family:Century Gothic"><font color= #FFFFFF>Project Metrics</font></div>===
 
===<div style="background: #226C9A; padding: 15px; line-height: 0.3em; text-indent: 15px;  font-size:85%; font-family:Century Gothic"><font color= #FFFFFF>Project Metrics</font></div>===
[[Image:Sprint-Velocity-5.jpg|left|500px|link=]][[Image:Burndown-Sprint9.jpg||500px|link=]][[Image:Bug-5.jpg||500px|link=]]
+
[[Image:Sprint-Velocity-5.jpg|left|500px|link=]][[Image:Burndown-Sprint9.jpg||500px|link=]][[Image:Bug-6.jpg||500px|link=]]
 
<br>
 
<br>
  
Line 227: Line 246:
 
! style="color:white; background-color:#226C9A;" | Actions
 
! style="color:white; background-color:#226C9A;" | Actions
 
! style="color:white; background-color:#226C9A;" | Status
 
! style="color:white; background-color:#226C9A;" | Status
|-
 
| Client Risk
 
| Initial X-factor unable to be done as client does not want to expose his clients to the POC yet as our project is just the start. There are many more components which need to be added before it is ready to be shown to clients which is out of our scope.
 
| HIGH
 
| HIGH
 
| HIGH
 
| Mitigate
 
| Actively engage client to give us another party to validate our app. Client was able to get us Amadeus to vet our progress and app and to give comments for us to learn and improve on. Client has yet to meet Amadeus
 
| Fail
 
 
|-
 
|-
 
| Technology Risk
 
| Technology Risk
| The launch of iOS 10 would result in some libraries becoming incompatible, which would result in the app not being functional
+
| Analytics Dashboard display does not size correctly on different monitor sizes.
| HIGH
 
 
| HIGH
 
| HIGH
 +
| Medium
 
| HIGH
 
| HIGH
 
| Mitigate
 
| Mitigate
| Plan a task for the app team to update the project to be compatible with iOS 10 and make the app future proof
+
| Dashboard team to rigorously test the dashboard to ensure that it displays properly on all screen sizes.
 
| Success
 
| Success
 
|-
 
|-
| Dependency Risk
+
| Client Risk
| As we are using an external API for the speech-to-text, if the API provider becomes unusable, the app will not be functional
+
| We do not have validation from external party on the accuracy and usefulness of our generated insights and dashboard
 
| HIGH
 
| HIGH
 
| HIGH
 
| HIGH
 
| HIGH
 
| HIGH
 
| Mitigate
 
| Mitigate
| Switch to Google-API as it is more stable.
+
| Ask client to help arrange a presentation to UOB to verify the data and feasibility of the dashboard and the insights generated.
 
| Success
 
| Success
 
|-
 
|-
Line 304: Line 314:
 
|rowspan="1"| Testing
 
|rowspan="1"| Testing
 
|| User test plan
 
|| User test plan
|| Every sprint, the QA team will conduct an integration and regression testing to ensure that the app is still working fine after the new implementations and to look for more corner cases in order to make the app more stable.  
+
|| Every sprint, the QA team will conduct an integration and regression testing to ensure that the app is still working fine after the new implementations and to look for more corner cases in order to make the app more stable. [[IS480 Team wiki: 2016T1 Airvolution-Quality Assurance| Quality Assurance]]
 
|-
 
|-
  
 
|rowspan="5"| Design & Research
 
|rowspan="5"| Design & Research
 
|| Use case
 
|| Use case
||This is the use case diagram for our iOS app and management dashboard. Our diagram can be viewed here [[ https://drive.google.com/a/smu.edu.sg/file/d/0By0L3h6EiBjBdDM1RWtMS29ETW8/view?usp=sharing| Use Case]]
+
||This is the use case diagram for our iOS app and management dashboard. Our diagram can be viewed here [https://drive.google.com/a/smu.edu.sg/file/d/0By0L3h6EiBjBdDM1RWtMS29ETW8/view?usp=sharing Use Case]  
 
|-
 
|-
  
 
|| Market Study
 
|| Market Study
||We conducted a market study of the popular travels apps in the market to see what are the unique selling points and mandatory features that these apps share to help validate our client's claim that there is a gap in the market for speech-to-text booking and a recommendation engine. Our research can be viewed here: [[ IS480 Team wiki: 2016T1 Airvolution-Market-Study| Market Study]]
+
||We conducted a market study of the popular travels apps in the market to see what are the unique selling points and mandatory features that these apps share to help validate our client's claim that there is a gap in the market for speech-to-text booking and a recommendation engine. Our research can be viewed here: [[IS480 Team wiki:2016T1 Airvolution-Market-Study| Market Study]]
 
|-
 
|-
  
Line 328: Line 338:
  
 
===<div style="background: #226C9A; padding: 15px; line-height: 0.3em; text-indent: 15px;  font-size:85%; font-family:Century Gothic"><font color= #FFFFFF>Testing</font></div>===
 
===<div style="background: #226C9A; padding: 15px; line-height: 0.3em; text-indent: 15px;  font-size:85%; font-family:Century Gothic"><font color= #FFFFFF>Testing</font></div>===
 +
<b> Test:</b> User Testing 3 <br>
 +
<b> Date:</b> 17 November 2016 - 18 November 2016 <br>
 +
<b> Venue:</b> School of Accountancy, School of Information Systems & Li Ka Shing Library, Singapore Management University <br>
 +
<b>Total Number of Users: </b> 26 <br>
 +
<b>Target Audience: </b> Millennials  <br>
 +
<b>Objectives:</b><br>
 +
# Identify any issue in usability and functionalities created
 +
# Determine if application design is user-friendly
 +
# Understand which parts of the application could confuse users
 +
# Gauge the openness of millennials in using the speech-to-text function
 +
<b>Scope:</b><br>
 +
<b>Functionalities tested:</b>
 +
# Speech-to-Query
 +
# Flight Search via Typing
 +
# Filter & Sort Search
 +
# Traveler Details Input
 +
# Price Watch
 +
# Login
 +
# View Booked Trip Details
 +
# Recommended Travel Destinations
 +
<b>Procedure:</b> <br>
 +
# A UT document with tasks to complete is displayed on a laptop for participants to read and type their answers.
 +
# Participants complete the tasks and answer questions from the UT. Tester/observer records participants’ answers and comments as well as observations between users and the system.
 +
# After completing the tasks, participants would answer a few questions about their feedback on the application in general.
 +
<b>Tasks:</b>
 +
The UT document contains the following task(s): <br>
 +
Participants/observers are required to document down the following information for each task:<br>
 +
* Execution of Task (Successful or Unsuccessful)
 +
* Outcome
 +
* Usability Rating
 +
* Design of Page Rating
 +
*<b>Price Watch Notification & Login Test Cases</b>
 +
**Enter the App via Price Watch Notification
 +
**Register a New Account
 +
*<b>Flight Search Test Cases</b>
 +
**Speech to Query a Flight
 +
**Typing to Query a Flight
 +
**Sort and Filter Flight Search Results
 +
**Confirm a Selected Flight
 +
*<b>Traveler and Trip Details Test Cases</b>
 +
**Add a New Traveler
 +
**Select Travelers for Tickets Booked
 +
**View Trip Details
 +
*<b>Recommendation and Price Watch Test Cases</b>
 +
**Browse through and Select Recommended Travel Destination
 +
**Create a New Price Watch
 +
After completing the tasks, participants answered the following questions:
 +
*Overall thoughts and feelings about the application
 +
*Other difficulties faced in interacting with the application
 +
*Other improvements you would like to see in the application
 +
<b><u>Results</u></b><br>
 +
<b>Demographic of Users</b><br>
 +
Total no. of participants: 26<br>
 +
We tested a majority of non-IS students to understand their needs and view on the usability of our application as we have previously in UT<br>
 +
2 tested mostly IS students.<br>
 +
All of the participants have not used our application prior to the Usability Test.<br>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
! Male !! Female
 +
|-
 +
| 14 || 12
 +
|}
 +
<br>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
! School !! Count !! Percentage
 +
|-
 +
| Information Systems || 9 || 35%
 +
|-
 +
| Business || 8 || 31%
 +
|-
 +
| Accountancy || 6 || 23%
 +
|-
 +
| Social Science || 3 || 12%
 +
|}
 +
<b>Overall:</b><br>
 +
Participants rated the different functions’ usability and the design of the many pages of the application. The results are as following:<br>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
!  Screen !! Usability !! Design !! No. of Errors
 +
|-
 +
| Price Watch Alerts || 8.92 || 8.73 ||
 +
|-
 +
| Home/Speech || 8.77 || 8.92 ||
 +
|-
 +
| Flight Search || 9.27 || 9.04 ||
 +
|-
 +
| Add Passengers || 9.19 || 9.19 || 1
 +
|-
 +
| My Trips|| 9.04 ||8.54 ||
 +
|-
 +
| My Recommendation|| 7.38||8.88 ||
 +
|-
 +
|Login|| 8.78|| || 1
 +
|-
 +
|Filter & Sort || 8.54 ||  || 1
 +
|-
 +
|Create Price Watch || 8.04 || ||
 +
|-
 +
|Average ||8.66|| 8.88 ||
 +
|}
 +
<br>
 +
<b> Speech-to-Query </b>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
!  !! Unsuccessful!! Successful
 +
|-
 +
| No. of users || 6 || 20
 +
|-
 +
| % of users ||23% || 77%
 +
|}
 +
 +
Users thought of a leisure trip in mind and the details of the trip before testing out the speech function. The unsuccessful cases were due to inaccuracy of the speech-to-text/natural language processing technology in understanding the participant’s speech.<br>
 +
<br>
 +
<b> Speech-to-Query </b>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
! Function  !! No. of Testers !! No. of Errors !! Avg. Time Taken(s) !! Max Time Taken(s) !! Min Time Taken(s) !! Comments
 +
|-
 +
| Speech-to-Query || 20 || 0 || 37.8 || 130 || 5 || Quite cool, can detect the dates and speech.
 +
Surprisingly easy!!!! Caught all my words even when I said “wanna”
 +
I tried to speak in proper English with clear pronunciation.
 +
|-
 +
| Type Query || 26 || 0 || 42.8 || 80 || 7 ||
 +
|}
 +
<br>
 +
<b>Recommended Travel Destinations</b><br>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
!  Recommendation !! No. of users!! % of users
 +
|-
 +
| "Drag" item for Top Destination is unresponsive || 13 || 50%
 +
|-
 +
| Unclear of how to interact with "Drag" item for Top Destination || 8 || 31%
 +
|}
 +
<br>
 +
Other Comments:<br>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
| Naming does not convey a recommendation
 +
|-
 +
| Not clear which image refers to which country at a quick glance
 +
|}
 +
<br>
 +
<b>Create Price Watch</b><br>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
!  Create Price Watch !! No. of users!! % of users
 +
|-
 +
| Find it impossible or difficult to navigate to Price Watch || 10 || 38%
 +
|-
 +
| Difficulty using slider for adjusting price target || 6 || 23%
 +
|-
 +
| Very useful functionality that should be explained more clearly to users and 'advertised' more within the app (e.g. weeks, clear mention that input is a target price as anyone may think of PW as a notification when price drops.)|| 7 || 27%
 +
|}<br>
 +
Other Comments:<br>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
| Colour of the top bar could be bolder
 +
|-
 +
|Price watch very empty. Fading background and not blue background, like a photos or pictures; Blue and grey line
 +
|-
 +
|Should add a confirmation message for the user that acknowledges that the app has accepted the price watch target. Next price watch setting should be set to the current price watch setting.
 +
|}
 +
<br>
 +
<b>Filter & Sort Flight Search</b><br>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
!  Filter & Sort !! No. of users!! % of users
 +
|-
 +
| "Reset" filter is confusing; "Done" would be more easily interpreted than a "Back" icon || 8 || 31%
 +
|-
 +
| Flight filter should have the airline names arranged in alphabetical order || 2 || 8%
 +
|-
 +
| Design of the times filter feels too compact|| 2 ||8%
 +
|-
 +
| Size of 'pop-out' stretch over screen edges|| 2 ||8%
 +
|-
 +
| Slider is hard to use because the numbers 12am, 12pm, 12am are not helpful and the right side may be blocked due to "fat fingers"|| 2 ||8%
 +
|}
 +
Other Comments:<br>
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
| Sort could be a dropdown instead of pop out.
 +
|-
 +
|Maybe show summary of filters on the main page.
 +
|-
 +
|Sorting can be in ascending or descending order.
 +
|}
 +
<b>OVERALL COMMENTS:</b> <br>
 +
 +
{| class="wikitable" style="background-color:#FFFFFF; width:100%;margin-top:10px;text-align: center;"
 +
|-
 +
| Sort could be a dropdown instead of pop out.
 +
|-
 +
|Maybe show summary of filters on the main page.
 +
|-
 +
|"Definitely will use the app"
 +
|-
 +
|"Useful, speech function is easy to use. Not sure if will use to purchase, will prefer a bigger screen for security/peace of mind."
 +
|-
 +
|"Interesting app, feels like Skyscanner"
 +
|-
 +
|"Very user friendly, but can improve about the clarity of the inputs."
 +
|-
 +
|"Functional & useful travel app. Would be an app I use for future travels"
 +
|-
 +
|"Overall I thought it was a very sleek app which I would use in the future. Design wise, maybe more pictures can be added. Function wise, it’s quite amazing. "
 +
|-
 +
|"Features are available but difficult to use."
 +
|-
 +
|"For some functions, the UI is too plain or too much text. Make use of more icons."
 +
|-
 +
|"Useful app, easy and convenient to use, able to filter to the exact flight appropriate for my trip – can manipulate all the details! "
 +
|-
 +
|"Interesting as it has a few additional features to make planning of trips better (did not know of price watch before). Concerned over how much info may be tracked"
 +
|}
 +
<br>
 +
<b>Key findings:</b> <br>
 +
Need to improve on <br>
 +
# Top Destinations to be ‘dragged’ more easily/clearer hint on use
 +
# Filter navigation bar buttons should be consistent and clear
 +
# Creating Price Watch should be easier to navigate to, have clear explanations and better way to input values
  
 
==Reflection==
 
==Reflection==
  
 
===<div style="background: #226C9A; padding: 15px; line-height: 0.3em; text-indent: 15px;  font-size:85%; font-family:Century Gothic"><font color= #FFFFFF>Team Reflection</font></div>===
 
===<div style="background: #226C9A; padding: 15px; line-height: 0.3em; text-indent: 15px;  font-size:85%; font-family:Century Gothic"><font color= #FFFFFF>Team Reflection</font></div>===
<center>We learnt that change management is a very crucial skill especially in projects where changes are constant. Having the right processes in place to handle and mitigate the possible risks will help improve our productivity.</center>
+
[[Image:Team-Reflection.jpg|center|700px|link=]]
  
 
===<div style="background: #226C9A; padding: 15px; line-height: 0.3em; text-indent: 15px;  font-size:85%; font-family:Century Gothic"><font color= #FFFFFF>Individual Reflections</font></div>===
 
===<div style="background: #226C9A; padding: 15px; line-height: 0.3em; text-indent: 15px;  font-size:85%; font-family:Century Gothic"><font color= #FFFFFF>Individual Reflections</font></div>===
[[Image:Reflection-h.jpg|center|850px|link=]]
+
[[Image:Final-Reflection.jpg|center|600px|link=]]
 +
 
 +
===<div style="background: #226C9A; padding: 15px; line-height: 0.3em; text-indent: 15px;  font-size:85%; font-family:Century Gothic"><font color= #FFFFFF>Sponsor Comment</font></div>===
 +
[[Image:Sponsors-Comment.jpg|center|600px|link=]]

Latest revision as of 17:16, 29 November 2016


Airvolution-Logo.png


Airvolution-House.png  HOME

 

Airvolution-About-Us.png  ABOUT US

 

Airvolution-Project-Overview.png  PROJECT OVERVIEW

 

Airvolution-Project-Management.png  PROJECT MANAGEMENT

 

Airvolution-Documentation.png  DOCUMENTATION

 
Main Wiki Midterm Wiki Final WikiAirvolution-Paper-Plane.png


Project Progress Summary

Project-Summary-1.jpg
Please click here to view our Poster
Please click here to view our Video Pitch
Please click here to view our Final Presentation Slides

Project Management

Project Status

S/N Function/features, etc Status Confident Level (0-1) Remarks
1. Speech-to-query function Fully deployed and tested 100% 1 Completed
2. Search Function Fully deployed and tested 100% 1 Completed
3. Booking Function (Make a new Booking) Fully deployed and tested 100% 1 Completed
4. Payment Function Fully deployed and tested 100% 1 Completed
5. Booking Function Fully deployed and tested 100% 1 Completed
6. Account Management Fully deployed and tested 100% 1 Completed
7. Analytics Dashboard 80% done 1 In Progress
8. Price Watch Function + Push Notification Fully deployed and tested 100% 1 Completed
9. Machine Learning Function Fully deployed and tested 100% 1 Completed
10. Weather Function Fully deployed and tested 100% 1 Completed

Project Schedule (Plan vs. Actual)

Planned Project Schedule

Airvolution-Project-Schedule-v2.1.jpg

Actual Project Schedule

Project-Schedule-v5.jpg
Changes in Schedule
Sprint No. Date Category Change Description Reason for Request Accept/Reject Priority Status of Request
4 19 Aug 2016 Application To change the Speech-to-text API from Nuance API to Google API Nuance API was becoming unstable and even crashing the app regularly Accept Accept & High Priority Closed
5 31 Aug 2016 X-Factor X- factor to be changed from getting 20 live users to test our app to getting GDSs to validate our app and analytics platform X-factor not able to be done as client is not comfortable with getting the 20 live UOB customers to test the app. Accept Accept & High Priority Closed
5 2 Sep 2016 Analytics Dashboard To deploy our analytics dashboard on their own Tocco Azure Server Client wants to have the analytics deployed on their own Azure server so that they can access the dashboard and maintain control over the dashboard as sensitive data will be hosted on it. Accept Accept & High Priority Closed
6 1 Sep 2016 Application To add mock flight data which are tagged as UOB preferred Client would like us to mock out some flight data which are UOB preferred so we can simulate such flights Accept Accept & Low Priority Closed
6 17 Sep 2016 Application Remove Notification Module - Boarding Gate Updates and belt no. API were not available and creating or sourcing for an API would be too time-consuming Accept Accept & Low Priority Closed
6 20 Sep 2016 Application Update project version to be compatible with iOS 10. To future proof the app so that future development on the app will be easier to integrate. This will reduce the risk of libraries becoming outdated in the future. Accept Accept & High Priority Closed
6 23 Sep 2016 Application Formally removed seat-booking function, update current booking function, SMS function There are no APIs are available and implementing it ourselves would be very time-consuming. Thus, we decided to formally drop these functions so we can focus on making the app better and on the machine learning Accept Accept & Low Priority Closed
8 16 Oct 2016 Analytics Dashboard To present our findings to UOB in order to get their validation Vincent would like to compare our analysis and insights against what UOB has done to see how accurate we are in our analysis using our machine learning. Accept Accept & High Priority Closed
9 20 Oct 2016 App To formally drop good-to-have functions We decided to focus on the quality of the functions rather than the quantity as we wanted to make the functions more user-friendly and more robust. Accept Accept & High Priority Closed

Project Metrics

Sprint-Velocity-5.jpg

Burndown-Sprint9.jpgBug-6.jpg


Project Risks

To view past risks that the team may have/may not been affected by, please visit: IS480 Team wiki: 2016T1 Airvolution-Risk Management

Current Risks that may affect the team:
Risk Type Risk Event Likelihood Impact Level Category Strategy Adopted Actions Status
Technology Risk Analytics Dashboard display does not size correctly on different monitor sizes. HIGH Medium HIGH Mitigate Dashboard team to rigorously test the dashboard to ensure that it displays properly on all screen sizes. Success
Client Risk We do not have validation from external party on the accuracy and usefulness of our generated insights and dashboard HIGH HIGH HIGH Mitigate Ask client to help arrange a presentation to UOB to verify the data and feasibility of the dashboard and the insights generated. Success

Technical Overview

Tech-Overview.jpg

Technical Complexity

Tech-Comp.jpg

3DS Authentication Send API request to Tocco’s payment URL Response returned will consist of bank’s ACS URL Start phone server Send POST Request to ACS URL with URL of phone server ACS URL returned will consist of page for OTP. OTP HTML will be sent as response which will be rendered on the app User will receive OTP from bank which he will enter. After entering OTP, a POST request will be sent from the bank’s server to which the phone server will receive indicating the payment was a success Once the payment succeeds, the server will be shut down.

Tech-Comp--1.jpg

User submits price watch and the details of price watched is stored on Firebase. NodeJS Server runs an hourly check on pricing by retrieving prices via Tocco’s API If lowest price for flight is within 10% of the max pricing or less, NodeJS Server sends a notification user’s phone via Firebase

Quality of Product

Intermediate Deliverables

Stage Specifications Work Product(s)
Project Management Minutes There are 3 types of minutes being maintained: Client Minutes, Supervisor Minutes and Internal Minutes. Our minutes can be found here: Meeting Minutes
Metrics We maintain 3 types of metrics to monitor our progress: Sprint Velocity, Scrum Burn down Chart, Bug Metrics. Our metrics can be viewed here: Metrics
Change Management Whenever changes are being made, the team will deliberate and decide on the severity and importance before coming to a group decision of accepting or dropping the change. Our changes can be viewed here: <URL>
Risk Management We have a risk metrics in place to keep track of the risks that may disrupt the success of our project as well as our mitigation. Our risks and mitigation can be viewed here Metrics
Sprint Backlog To look for the breakdown of tasks completed at each sprint, our Sprint Backlog can be viewed here: Sprint Backlog
Testing User test plan Every sprint, the QA team will conduct an integration and regression testing to ensure that the app is still working fine after the new implementations and to look for more corner cases in order to make the app more stable. Quality Assurance
Design & Research Use case This is the use case diagram for our iOS app and management dashboard. Our diagram can be viewed here Use Case
Market Study We conducted a market study of the popular travels apps in the market to see what are the unique selling points and mandatory features that these apps share to help validate our client's claim that there is a gap in the market for speech-to-text booking and a recommendation engine. Our research can be viewed here: Market Study
Screen Shots As our project is under NDA, we cannot post the screenshots of our App here. To view it, please go to our private document.

Deployment

Analytics Dashboard is deployed to our client Microsoft Azure Server, It can be found at this URL: http://tocco-trailblazer.azurewebsites.net/
Note: Please ensure that you are using the latest version of Google Chrome browser & Javascript enabled to view the application.

Testing

Test: User Testing 3
Date: 17 November 2016 - 18 November 2016
Venue: School of Accountancy, School of Information Systems & Li Ka Shing Library, Singapore Management University
Total Number of Users: 26
Target Audience: Millennials
Objectives:

  1. Identify any issue in usability and functionalities created
  2. Determine if application design is user-friendly
  3. Understand which parts of the application could confuse users
  4. Gauge the openness of millennials in using the speech-to-text function

Scope:
Functionalities tested:

  1. Speech-to-Query
  2. Flight Search via Typing
  3. Filter & Sort Search
  4. Traveler Details Input
  5. Price Watch
  6. Login
  7. View Booked Trip Details
  8. Recommended Travel Destinations

Procedure:

  1. A UT document with tasks to complete is displayed on a laptop for participants to read and type their answers.
  2. Participants complete the tasks and answer questions from the UT. Tester/observer records participants’ answers and comments as well as observations between users and the system.
  3. After completing the tasks, participants would answer a few questions about their feedback on the application in general.

Tasks: The UT document contains the following task(s):
Participants/observers are required to document down the following information for each task:

  • Execution of Task (Successful or Unsuccessful)
  • Outcome
  • Usability Rating
  • Design of Page Rating
  • Price Watch Notification & Login Test Cases
    • Enter the App via Price Watch Notification
    • Register a New Account
  • Flight Search Test Cases
    • Speech to Query a Flight
    • Typing to Query a Flight
    • Sort and Filter Flight Search Results
    • Confirm a Selected Flight
  • Traveler and Trip Details Test Cases
    • Add a New Traveler
    • Select Travelers for Tickets Booked
    • View Trip Details
  • Recommendation and Price Watch Test Cases
    • Browse through and Select Recommended Travel Destination
    • Create a New Price Watch

After completing the tasks, participants answered the following questions:

  • Overall thoughts and feelings about the application
  • Other difficulties faced in interacting with the application
  • Other improvements you would like to see in the application

Results
Demographic of Users
Total no. of participants: 26
We tested a majority of non-IS students to understand their needs and view on the usability of our application as we have previously in UT
2 tested mostly IS students.
All of the participants have not used our application prior to the Usability Test.

Male Female
14 12


School Count Percentage
Information Systems 9 35%
Business 8 31%
Accountancy 6 23%
Social Science 3 12%

Overall:
Participants rated the different functions’ usability and the design of the many pages of the application. The results are as following:

Screen Usability Design No. of Errors
Price Watch Alerts 8.92 8.73
Home/Speech 8.77 8.92
Flight Search 9.27 9.04
Add Passengers 9.19 9.19 1
My Trips 9.04 8.54
My Recommendation 7.38 8.88
Login 8.78 1
Filter & Sort 8.54 1
Create Price Watch 8.04
Average 8.66 8.88


Speech-to-Query

Unsuccessful Successful
No. of users 6 20
% of users 23% 77%

Users thought of a leisure trip in mind and the details of the trip before testing out the speech function. The unsuccessful cases were due to inaccuracy of the speech-to-text/natural language processing technology in understanding the participant’s speech.

Speech-to-Query

Function No. of Testers No. of Errors Avg. Time Taken(s) Max Time Taken(s) Min Time Taken(s) Comments
Speech-to-Query 20 0 37.8 130 5 Quite cool, can detect the dates and speech.

Surprisingly easy!!!! Caught all my words even when I said “wanna” I tried to speak in proper English with clear pronunciation.

Type Query 26 0 42.8 80 7


Recommended Travel Destinations

Recommendation No. of users % of users
"Drag" item for Top Destination is unresponsive 13 50%
Unclear of how to interact with "Drag" item for Top Destination 8 31%


Other Comments:

Naming does not convey a recommendation
Not clear which image refers to which country at a quick glance


Create Price Watch

Create Price Watch No. of users % of users
Find it impossible or difficult to navigate to Price Watch 10 38%
Difficulty using slider for adjusting price target 6 23%
Very useful functionality that should be explained more clearly to users and 'advertised' more within the app (e.g. weeks, clear mention that input is a target price as anyone may think of PW as a notification when price drops.) 7 27%

Other Comments:

Colour of the top bar could be bolder
Price watch very empty. Fading background and not blue background, like a photos or pictures; Blue and grey line
Should add a confirmation message for the user that acknowledges that the app has accepted the price watch target. Next price watch setting should be set to the current price watch setting.


Filter & Sort Flight Search

Filter & Sort No. of users % of users
"Reset" filter is confusing; "Done" would be more easily interpreted than a "Back" icon 8 31%
Flight filter should have the airline names arranged in alphabetical order 2 8%
Design of the times filter feels too compact 2 8%
Size of 'pop-out' stretch over screen edges 2 8%
Slider is hard to use because the numbers 12am, 12pm, 12am are not helpful and the right side may be blocked due to "fat fingers" 2 8%

Other Comments:

Sort could be a dropdown instead of pop out.
Maybe show summary of filters on the main page.
Sorting can be in ascending or descending order.

OVERALL COMMENTS:

Sort could be a dropdown instead of pop out.
Maybe show summary of filters on the main page.
"Definitely will use the app"
"Useful, speech function is easy to use. Not sure if will use to purchase, will prefer a bigger screen for security/peace of mind."
"Interesting app, feels like Skyscanner"
"Very user friendly, but can improve about the clarity of the inputs."
"Functional & useful travel app. Would be an app I use for future travels"
"Overall I thought it was a very sleek app which I would use in the future. Design wise, maybe more pictures can be added. Function wise, it’s quite amazing. "
"Features are available but difficult to use."
"For some functions, the UI is too plain or too much text. Make use of more icons."
"Useful app, easy and convenient to use, able to filter to the exact flight appropriate for my trip – can manipulate all the details! "
"Interesting as it has a few additional features to make planning of trips better (did not know of price watch before). Concerned over how much info may be tracked"


Key findings:
Need to improve on

  1. Top Destinations to be ‘dragged’ more easily/clearer hint on use
  2. Filter navigation bar buttons should be consistent and clear
  3. Creating Price Watch should be easier to navigate to, have clear explanations and better way to input values

Reflection

Team Reflection

Team-Reflection.jpg

Individual Reflections

Final-Reflection.jpg

Sponsors-Comment.jpg