HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2018T1 analyteaka FinalWiki"

From IS480
Jump to navigation Jump to search
(Created page with "<center> <!--HEADER--> 1000px|center <!--/HEADER--> <!--MENU--> {|style="background-color:#272729; color:#F5F5F5; padding: 5 0 5 0;" width="...")
 
 
(12 intermediate revisions by 2 users not shown)
Line 40: Line 40:
  
 
<!--CONTENT-->
 
<!--CONTENT-->
 +
[[File: Analyteaka_Finals_1.png| 1025px |center]]
 +
[[Image:Analyteaka_Button_Try.png|center| 1025px |link=https://scanteak-202717.appspot.com]]
 +
[[File:Analyteaka_Footer.png| 1025px |center]]
 +
[[File:Analyteaka_Midterms_2.png| 1025px |center]]
 +
[[File:Analyteaka_Finals_2.2.png| 1025px |center]]
 +
{| class="wikitable" style="font:Century Gothic; background-color:#FFFFFF; width: 100%;" align="center"
 +
|-
  
[[File:Analyteaka_Footer.png|1000px|center]]
+
! style="color:#ffffff; background-color:#7D5B53;" width="100pt" | Function
 +
! style="color:#ffffff; background-color:#7D5B53;" width="100pt" | Status
 +
! style="color:#ffffff; background-color:#7D5B53;" width="100pt" | Confidence
 +
! style="color:#ffffff; background-color:#7D5B53;" width="100pt" | Comments
 +
|-
 +
 
 +
|style="text-align: center;"| Data Upload
 +
|style="text-align: center;"| Deployed
 +
|style="text-align: center;"| 1
 +
|style="text-align: center;"| Done
 +
|-
 +
 
 +
|style="text-align: center;"| Customer profile
 +
|style="text-align: center;"| Deployed
 +
|style="text-align: center;"| 1
 +
|style="text-align: center;"| Done
 +
|-
 +
 
 +
|style="text-align: center;"| Store profile
 +
|style="text-align: center;"| Deployed
 +
|style="text-align: center;"| 1
 +
|style="text-align: center;"| Done
 +
|-
 +
 
 +
|style="text-align: center;"| Marketing planning
 +
|style="text-align: center;"| Deployed
 +
|style="text-align: center;"| 1
 +
|style="text-align: center;"| Done
 +
|-
 +
 
 +
|style="text-align: center;"| Customization module
 +
|style="text-align: center;"| Deployed
 +
|style="text-align: center;"| 1
 +
|style="text-align: center;"| Done
 +
|-
 +
|style="text-align: center;"| Geospatial Maps
 +
|style="text-align: center;"| Deployed
 +
|style="text-align: center;"| 1
 +
|style="text-align: center;"| Done
 +
|-
 +
 
 +
|style="text-align: center;"| Staff Profile module
 +
|style="text-align: center;"| Dropped
 +
|style="text-align: center;"| -
 +
|style="text-align: center;"| Can be integrated into store profile page. Therefore, there’s no need for a separate module.
 +
|-
 +
 
 +
|style="text-align: center;"| Analytics & Reporting module
 +
|style="text-align: center;"| Dropped
 +
|style="text-align: center;"| -
 +
|style="text-align: center;"| Can be integrated into store and customer profile. Therefore, there’s no need for a separate module.
 +
|-
 +
|}
 +
 
 +
[[File: Analyteaka_Midterms_3.png| 1025px |center]]
 +
[[File:Analyteaka_Schedule_Change2.png| 1025px |center]]
 +
[[File: Analyteaka_Midterms_4.png| 1025px |center]]
 +
[[File: Analyteaka_Project_Metrics1.png| 1025px |center]]
 +
[[Image: Analyteaka_Project_Metrics2.png |center| 1025px |link=https://wiki.smu.edu.sg/is480/IS480_Team_wiki%3A_2018T1_analyteaka_metrics]]
 +
 
 +
[[File: Analyteaka_Midterms_5.png| 1025px |center]]
 +
[[File: Analyteaka_Project_Risk1.png| 1025px |center]]
 +
[[Image: Analyteaka_Project_Risk2.png |center| 1025px |link=https://wiki.smu.edu.sg/is480/IS480_Team_wiki%3A_2018T1_analyteaka_metrics]]
 +
 
 +
[[File: Analyteaka_Midterms_6.png| 1025px |center]]
 +
{| class="wikitable" style="font:Century Gothic; background-color:#FFFFFF; width: 100%;" align="center"
 +
|-
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Iteration
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Date
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Type
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Change Reason
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Description
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Issued By
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Decision
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Action Taken
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Request Status
 +
|-
 +
 
 +
 
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;"| 3
 +
|style="text-align: center; background-color:#ffffff;" | 22/6/2018
 +
|style="text-align: center; background-color:#ffffff;" | Schedule
 +
|style="text-align: left; background-color:#ffffff;" | Changing of UT schedule due to stackholder's schedule  and re-estimate of task
 +
|style="text-align: left; background-color:#ffffff;" | Shifting the schedule of UT and shifting certain tasks around
 +
|style="text-align: center; background-color:#ffffff;" |Team
 +
|style="text-align: left; background-color:#ffffff;" | To go ahead
 +
|style="text-align: center; background-color:#ffffff;" | Proceed with change
 +
|style="text-align: center; background-color:#ffffff;" | Closed
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;"| 7
 +
|style="text-align: center; background-color:#ffffff;" | 14/8/2018
 +
|style="text-align: center; background-color:#ffffff;" | Schedule
 +
|style="text-align: left; background-color:#ffffff;" | Updating of schedule for changing of modules
 +
|style="text-align: left; background-color:#ffffff;" | Sponsor realize it would be useful to have marketing planning feature as well as bein able to name their categories as the cateorgies naming is ever changing. Having the system to do so would be great.
 +
|style="text-align: center; background-color:#ffffff;" |Sponsor
 +
|style="text-align: left; background-color:#ffffff;" | To go ahead with the change.
 +
|style="text-align: center; background-color:#ffffff;" | Proceed with change
 +
|style="text-align: center; background-color:#ffffff;" | Closed
 +
|-
 +
 
 +
|}
 +
 
 +
 
 +
 
 +
[[File:Analyteaka issues.png|1000px|center]]
 +
 
 +
Issues metrics show the issues that surfaced during the course of our project. As well as steps being taken to resolve it.
 +
 
 +
{| class="wikitable"
 +
|-
 +
! # !! Iteration !! Issues !! Module !! Priority !! Initiator !! Status !! Open on !! Closed on !! Action taken
 +
|-
 +
| 1 || 3 || Client requested everything to be done on Google standard engine. However, machine learning cannot be done on standard. It would require a flexible or VM instance. || Backend || High || Chester Ong || Closed || 20/6/18 || 22/6/18 || Adding compute engine as the backend.
 +
|-
 +
| 2 || 5 || During integration, we discovered issues with running flask and dash concurrently. Therefore we decide to use iframe or run dash on flask or flask on dash.  || Visualization || High || Larry || Closed || 9/7/18 || 9/7/18 || Use iframe to integrate dash and flask.
 +
|-
 +
| 3 || 5 || Server log shows unauthorized user from China trying to ssh into our compute engine. However, we are not at the stage of whitelisting IP currently. Therefore, we need an alternative solution for security hardening.  || Backend || Medium || Solomon || Closed || 13/7/18 || 13/7/18 || "Proceed with hardening
 +
Non-default SSH port
 +
Uncomplicated Firewall
 +
Disabled root access
 +
Disabled password
 +
RSA key only
 +
LogWatch enabled
 +
Fail2ban enabled "
 +
|-
 +
| 4 || 6 || We realize gender has no bearing on the customer clustering result as purchasing decision tends to be made as a family. Therefore, we would need a different formula to cluster customer.  || Machine learning || low || Hong yang || Closed || 24/7/18 || 25/7/18 || Dropping gender and use house size, household income, age, race and district for clustering purpose
 +
|-
 +
| 5 || 7 || Notice high swap on the compute engine system. This affects the performance of the system, increasing load time by 230% (based on browser inspector) || Backend  || Medium || Solomon || Closed || 8/8/18 || 8/8/18 || Increase compute engine instance size from f1-micro to g1-small and activate auto scaling for app engine. Will monitor for the next few iter before deciding on CPU and ram size for custom machine size.
 +
 
 +
Adding of gunicorn with 2 workers threads
 +
|-
 +
| 6 || 9 || Datastore is too slow, we would require a faster system for pulling of data. Hence, the need to dd Mysql to contain the aggregated data.  || Backend || High || Solomon || Closed || 3/9/18 || 13/9/18 || Datastore is meant for long-term storage. Hence even retrieval of a single record will take at least 2 seconds. Hence, there's a need to speed up the process by using aggregating of data. Data will still be uploaded to datastore and during certain period, a cron job will trigger and aggregate the data to MySQL, allowing the front end to reduce the size of the data being retrieve while increasing the processing speed by reducing the computational power needed.
 +
|-
 +
 
 +
|}
 +
 
 +
 
 +
[[File:Analyteaka_Finals_XFactor.png| 1025px |center]]
 +
 
 +
f
 +
[[File: Analyteaka_Midterms_7.png| 1025px|center]]
 +
 
 +
{| class="wikitable" style="font:Century Gothic; background-color:#FFFFFF; width: 100%;" align="center"
 +
|-
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Stage
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Specification
 +
! style="color:#ffffff; background-color:#7D5B53;" width="50pt" | Links
 +
|-
 +
 
 +
|rowspan="2" style="text-align: center; background-color:#ffffff;"| Project Management
 +
|style="text-align: center; background-color:#ffffff;" | Minutes
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka Documentation |Link Here]]
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;" | Metrics
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka metrics |Link Here]]
 +
|-
 +
 
 +
|rowspan="4" style="text-align: center; background-color:#ffffff;" | Analysis
 +
|style="text-align: center; background-color:#ffffff;" | Research
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka research |Link Here]]
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;" | Architecture Diagram
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka diagrams |Link Here]]
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;" | Use Case
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka diagrams |Link Here]]
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;" | Business Process Diagram
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka diagrams |Link Here]]
 +
|-
 +
 
 +
|rowspan="4" style="text-align: center; background-color:#ffffff;" | Design
 +
|style="text-align: center; background-color:#ffffff;" | ER Diagram
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka diagrams |Link Here]]
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;" | Class Diagram
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka diagrams |Link Here]]
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;" | Persona And Scenarios
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka personaandscenario |Link Here]]
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;" | Prototype
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka prototype |Link Here]]
 +
|-
 +
 
 +
|rowspan="3" style="text-align: center; background-color:#ffffff;" | Testing
 +
|style="text-align: center; background-color:#ffffff;" | User Testing 1
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka UT1 |Link Here]]
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;" | User Testing 2
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka UT2 |Link Here]]
 +
|-
 +
 
 +
|style="text-align: center; background-color:#ffffff;" | User Testing 3
 +
|style="text-align: center; background-color:#ffffff;" | [[IS480 Team wiki: 2018T1 analyteaka UT3 |Link Here]]
 +
|-
 +
 
 +
|}
 +
 
 +
 
 +
[[File: Analyteaka_Midterms_11.1.png| 1025px |center]]
 +
{|
 +
|[[Image: Analyteaka_Midterms_11.2.png |left| 512px |link=https://wiki.smu.edu.sg/is480/IS480_Team_wiki%3A_2018T1_analyteaka_diagrams]]
 +
|[[Image: Analyteaka_Midterms_11.3.png |right| 512px |link=https://wiki.smu.edu.sg/is480/IS480_Team_wiki%3A_2018T1_analyteaka_research]]
 +
|}
 +
 
 +
 
 +
[[File: Analyteaka_Midterms_10.png| 1025px |center]]
 +
[[File:Analyteka Screenshot.png|1000 px | center]]
 +
 
 +
 
 +
[[File: Analyteaka_Midterms_8.png| 1025px |center]]
 +
 
 +
[[File:Analyteaka_Footer.png|1025px|center]]
 
<!--CONTENT-->
 
<!--CONTENT-->

Latest revision as of 09:12, 23 November 2018

Analyteaka Header.png


HOME

ABOUT US

PROJECT OVERVIEW

PROJECT MANAGEMENT

DOCUMENTATION



Analyteaka Finals 1.png
Analyteaka Button Try.png
Analyteaka Footer.png
Analyteaka Midterms 2.png
Analyteaka Finals 2.2.png
Function Status Confidence Comments
Data Upload Deployed 1 Done
Customer profile Deployed 1 Done
Store profile Deployed 1 Done
Marketing planning Deployed 1 Done
Customization module Deployed 1 Done
Geospatial Maps Deployed 1 Done
Staff Profile module Dropped - Can be integrated into store profile page. Therefore, there’s no need for a separate module.
Analytics & Reporting module Dropped - Can be integrated into store and customer profile. Therefore, there’s no need for a separate module.
Analyteaka Midterms 3.png
Analyteaka Schedule Change2.png
Analyteaka Midterms 4.png
Analyteaka Project Metrics1.png
Analyteaka Project Metrics2.png
Analyteaka Midterms 5.png
Analyteaka Project Risk1.png
Analyteaka Project Risk2.png
Analyteaka Midterms 6.png
Iteration Date Type Change Reason Description Issued By Decision Action Taken Request Status
3 22/6/2018 Schedule Changing of UT schedule due to stackholder's schedule and re-estimate of task Shifting the schedule of UT and shifting certain tasks around Team To go ahead Proceed with change Closed
7 14/8/2018 Schedule Updating of schedule for changing of modules Sponsor realize it would be useful to have marketing planning feature as well as bein able to name their categories as the cateorgies naming is ever changing. Having the system to do so would be great. Sponsor To go ahead with the change. Proceed with change Closed


Analyteaka issues.png

Issues metrics show the issues that surfaced during the course of our project. As well as steps being taken to resolve it.

# Iteration Issues Module Priority Initiator Status Open on Closed on Action taken
1 3 Client requested everything to be done on Google standard engine. However, machine learning cannot be done on standard. It would require a flexible or VM instance. Backend High Chester Ong Closed 20/6/18 22/6/18 Adding compute engine as the backend.
2 5 During integration, we discovered issues with running flask and dash concurrently. Therefore we decide to use iframe or run dash on flask or flask on dash. Visualization High Larry Closed 9/7/18 9/7/18 Use iframe to integrate dash and flask.
3 5 Server log shows unauthorized user from China trying to ssh into our compute engine. However, we are not at the stage of whitelisting IP currently. Therefore, we need an alternative solution for security hardening. Backend Medium Solomon Closed 13/7/18 13/7/18 "Proceed with hardening

Non-default SSH port Uncomplicated Firewall Disabled root access Disabled password RSA key only LogWatch enabled Fail2ban enabled "

4 6 We realize gender has no bearing on the customer clustering result as purchasing decision tends to be made as a family. Therefore, we would need a different formula to cluster customer. Machine learning low Hong yang Closed 24/7/18 25/7/18 Dropping gender and use house size, household income, age, race and district for clustering purpose
5 7 Notice high swap on the compute engine system. This affects the performance of the system, increasing load time by 230% (based on browser inspector) Backend Medium Solomon Closed 8/8/18 8/8/18 Increase compute engine instance size from f1-micro to g1-small and activate auto scaling for app engine. Will monitor for the next few iter before deciding on CPU and ram size for custom machine size.

Adding of gunicorn with 2 workers threads

6 9 Datastore is too slow, we would require a faster system for pulling of data. Hence, the need to dd Mysql to contain the aggregated data. Backend High Solomon Closed 3/9/18 13/9/18 Datastore is meant for long-term storage. Hence even retrieval of a single record will take at least 2 seconds. Hence, there's a need to speed up the process by using aggregating of data. Data will still be uploaded to datastore and during certain period, a cron job will trigger and aggregate the data to MySQL, allowing the front end to reduce the size of the data being retrieve while increasing the processing speed by reducing the computational power needed.


Analyteaka Finals XFactor.png

f

Analyteaka Midterms 7.png
Stage Specification Links
Project Management Minutes Link Here
Metrics Link Here
Analysis Research Link Here
Architecture Diagram Link Here
Use Case Link Here
Business Process Diagram Link Here
Design ER Diagram Link Here
Class Diagram Link Here
Persona And Scenarios Link Here
Prototype Link Here
Testing User Testing 1 Link Here
User Testing 2 Link Here
User Testing 3 Link Here


Analyteaka Midterms 11.1.png
Analyteaka Midterms 11.2.png
Analyteaka Midterms 11.3.png


Analyteaka Midterms 10.png
Analyteka Screenshot.png


Analyteaka Midterms 8.png
Analyteaka Footer.png