HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2016T1 Charlies-Angels-QA"

From IS480
Jump to navigation Jump to search
Line 138: Line 138:
 
| 13 SEP 2016
 
| 13 SEP 2016
 
| 119/120; Bug Metrics of 5 - Hitting 1 High Impact
 
| 119/120; Bug Metrics of 5 - Hitting 1 High Impact
 +
|-
 +
| 9
 +
| 10 OCT 2016
 +
| 126/130; Bug Metrics of 8 - Hitting 1 High Impact & 3 Low Impact
 +
|-
 +
| 10
 +
| 23 OCT 2016
 +
| 134/136; Bug Metrics of 6 - Hitting 1 High Impact & 1 Low Impact
 
|-
 
|-
 
|}
 
|}

Revision as of 11:49, 28 November 2016


Charlies Angels Logo.png


Charlies Angels Home.png  HOME

 

Charlies Angels About Us.png  ABOUT US

 

Charlies Angels Project Overview.png  PROJECT OVERVIEW

 

Charlies Angels Project Management.png  PROJECT MANAGEMENT

 

Charlies Angels Project Documentation.png  DOCUMENTATION

 
Technical Documents Wireframes Charlies Angels Current Stage.png Quality Assurance Meeting Minutes Deliverables

Survey Findings

Survey Findings

Key Findings from Survey

This survey is meant to gather sentiments towards the features of our application that is intended to be rolled out (i.e. Dashboard, Robot Advisor). The targeted audience in this survey are millenials whom have little or no investment experience.

Key Findings:

  • Total no. of participants: 50
  • We have a fair mix of composition of gender, with 64% males and 36% females
  • All participants were aged between 20-29
  • 96% of our participants were Chinese, and 4% were Malay
  • 22% of our participants have began working full time, 76% have not began, and the remaining 2% are currently looking for jobs
  • We discovered that 92% of participants place between $0-$500 monthly into investments, or 8% > $1000. Surprisingly, there seem to not be a 'moderate' range of $501- $1000
  • 68% of participants have not began investment, while the other 32% being distributed across several ranges
  • 96% of participants felt that a feature to consider CPF and Housing Loan would be a useful one in a portfolio management

Graphical breakdowns of the survey can be found below:
Charlies Angels Survey Age.pngCharlies Angels Survey Gender.png
Charlies Angels Survey Race.pngCharlies Angels Survey Working.png
Charlies Angels Survey InvestmentExp.pngCharlies Angels Survey InvestmentAmt.png
Charlies Angels Survey CPF.png



We have also took our initial design of the application, specifically for the Robot Advisor to the users, and have requested for their feedback regarding the User Interface and Experience. The reason why we narrowed down to specifically Robot Advisor as it is a never-before-seen feature in any portfolio management application. The following are screenshots of the design that was shown to the users:

Screenshots of CPF-Robot Advisor

Screenshot #1: Charlies Angels CPF 1.jpg
Screenshot #2: Charlies Angels CPF 2.jpg
Screenshot #3: Charlies Angels CPF 3.jpg

User Feedback via Survey

Key Comments:

  • Having to input so many fields at once is really troublesome. It is a turn off!
  • I have not even began working, I don't have CPF, so effectively having me to enter 0s does not make sense
  • I am not buying a house so soon, housing loan does not affect me
  • Maybe a segmented survey would be more pleasing to the eyes

With these comments, we have properly evaluated that the user interface created was horrible and required immediate actions to be taken. This is despite of the good intentions of being thorough and precise when it came to calculations. Instead, we have considered what are the most essential of inputs, and have changed the user interface to ensure a more seamless experience for the user to utilise the feature.

Survey #2 Results

Charlies Angels Survey 2 Results 1.PNGCharlies Angels Survey 2 Results 2.PNG
Charlies Angels Survey 2 Results 3.PNG Charlies Angels Survey 2 Results 4.PNG
Charlies Angels Survey 2 Results 5.PNG Charlies Angels Survey 2 Results 6.PNG
Charlies Angels Survey 2 Results 7.PNG Charlies Angels Survey 2 Results 8.PNG

Survey #3 Results

Charlies Angels Survey 3 Results.jpg

Regression Testing

Regression Testing
Results of Internal Unit Testing
Iteration No. Date Results
3 06 JUL 2016 33/36; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact
4 27 JUL 2016 69/74; Bug Metrics of 9 - Hitting 1 High Impact & 4 Low Impact
5 10 AUG 2016 87/90; Bug Metrics of 7 - Hitting 1 High Impact & 2 Low Impact
6 29 AUG 2016 101/105; Bug Metrics of 8 - Hitting 1 High Impact & 3 Low Impact
7 5 SEP 2016 105/107; Bug Metrics of 6 - Hitting 1 High Impact & 1 Low Impact
8 13 SEP 2016 119/120; Bug Metrics of 5 - Hitting 1 High Impact
9 10 OCT 2016 126/130; Bug Metrics of 8 - Hitting 1 High Impact & 3 Low Impact
10 23 OCT 2016 134/136; Bug Metrics of 6 - Hitting 1 High Impact & 1 Low Impact

UT 1 Results

UT Results & Findings


Date: 05 Aug 2016 - 10 Aug 2016
Venue: Online
Duration: At their own timing
Number of Participants: 10
Target Audience: Users with Beginners' Investment Background



Objectives:

  1.   Identify functionalities and usability issues
  2.   Determine is the user interface is intuitive
  3.   Discover ways to improve features and functions of the website based on the results of User Testing #1




Scope:
Functionalities tested are ones developed between Iteration 3 and 4

  1.   Account Management
    • Log In
    • Log Out
    • Registration
    • Change Password
    • Forget Password
  2.   Search and Display
    • Display Fundamental Information (Live Data)
    • Display Financial Information (Live Data)
  3.    iStockTrade
    • Add/Delete Stock
    • Create/Delete Portfolio
    • Delete Transactions
  4.    StockBook Portfolio Stocks
    • Display Fundamental, Financial Information (Live Data) & Transaction History of the owned stocks
  5.    StockBook Portfolio Summary
    • Display a summary of user's portfolio




Procedure:

  1.   A UT document with instructions on how to test the website have been given to the testers
  2.   Participants will log down the testing outcomes & time taken per task in the sheet
  3.   Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document




Tasks:
The UT document requests participants to perform the following task(s):

  1. Registration
  2. Login
  3. Logout
  4. Change Password
  5. Forget Password
  6. Create a Portfolio
  7. Add (Buy) Few Stocks to the Portfolio
  8. Remove (Sell) a Stock from the Portfolio
  9. Delete Portfolio


For every task, participants were required to document down the following information:

  • Execution of Task (Successful or Unsuccessful)
  • Outcome
  • Time Taken


At the end of the test plan, we also asked the participants the following questions:

  • Do you have investment knowledge prior to using this application?
  • Any Comments?


Results

For UT #1, we tasked participants to perform the testing online, without assistance from the team, to best determine the state of the application

S/N Objective Achieved? % of Participants that found this task easy or very easy
1 Participants should be able to register for an account Yes 100%
2 Participants should be able to login Yes 100%
3 Participants should be able to change their password Yes 100%
4 Participants should be able to create a new portfolio Partially 66.67%
5 Participants should be able to add three stocks of their choice Partially 50%
6 Participants should be able to delete a stock from their portfolio No 25%
7 Participants should be able to delete their portfolio Yes 100%
8 Participants should be able to log out Yes 100%


Key Findings


Overall Findings

  • The website has a very clean and modern design
  • The website is intuitive
  • Nothing new about what has been created so far from what is out there
  • Some functions are still breaking, need to ensure fully fixed before testing



Key Improvements to be made

  • Ensure that the application does not break before deployed for testing
  • There is nothing unique of this application as yet. However, we recognise that this is because the foundation of the application needs to come first
  • Interface looks good, can continue adding colour schemes to make the UI more intuitive
  • Future UTs shall not be conducted via online means. Instead, hold a testing environment with physical presence to better gauge time taken for task completion


UT 2 Results

UT Results & Findings

Date: 15 Sep 2016 - 16 Sep 2016
Venue: School of Information Systems, Singapore Management University
Duration: 15 Sep 2016: 0900 - 1200 Hours @ SIS CR 3-2 & 1800 - 2100 Hours @ SIS CR 3-1; 16 Sep 2016: 0900 - 1200 & 1800 - 2100 Hours @ SIS CR 3-2
Number of Participants: 20
Target Audience: Millennials; aged 16-36 with Basic or No Investment Background



Objectives:

  1.   Identify functionalities and usability issues
  2.   Determine is the user interface is intuitive
  3.   Discover ways to improve features and functions of the website based on the results of User Testing #2
  4.   Introduce CPF & Housing Loan calculations - Never seen before feature in the market




Scope:
Functionalities tested are ones developed between Iteration 3 and 8




Procedure:

  1.   A UT document with instructions on how to test the website have been given to the testers
  2.   Participants will log down the testing outcomes & team members would note the time taken per task in the sheet
  3.   Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document




Tasks:
The UT document requests participants to perform the following task(s):
For every task, participants were required to document down the following information:

  • Execution of Task (Successful or Unsuccessful)
  • Outcome
  • Time Taken


  • Login & Registration Test Cases
    • Register a New Account
    • Retrieve your Password
    • Login
    • Change your Password
  • Portfolio Test Cases
    • Create a Portfolio
    • Search for a Stock
    • Buy a Specific Stock
    • Buy Two Other Stocks
    • Sell One Stock
  • PDF & Excel Test Cases
    • View your Portfolio Summary
    • Generate PDF Report of your Portfolio
    • View your PDF Report summary and verify if the information is correct
    • Generate Excel Report of your Portfolio
    • View your Excel Sheet and verify if the information is correct
    • Delete your Portfolio
  • Watch List Test Cases
    • Add any Two Stocks into your Portfolio
    • Delete the stocks from your watch list


At the end of the test plan, we also asked the participants the following questions:

  • Demographics Questions such as Age, Race, Work Experience, Investment Habits
  • Do you have investment knowledge prior to using this application?
  • Any Comments?


Results

Demographics of our testers

  • Total number of testers: 20
  • Age group:
    • 0 testers aged between 16 and 19
    • 19 testers aged between 20 and 29
    • 1 tester aged above 30 years old
  • Working Profile:
    • 3 testers are currently working
    • 17 testers are currently not working
  • Investment Background:
    • 12 of 20 testers indicated no background
    • 3 out of 20 testers indicated investment background of half a year
    • 3 out of 20 testers indicated investment background of 1 year
    • Remaining 2 testers indicated investment background of 2 years


Login & Registration Test Cases

Function No. of Testers No. of Errors Avg. Time (Sec) Fastest (Sec) Slowest (Sec) Comments
Registration 20 0 36.75 16 56 Username req too long
Retrieve Password 20 0 32 7 118 Email can be formatted better; Password that is resetted is too long; Let user see password field
Login 20 0 12.31 2 41 NIL
Change Password 20 0 14.63 3 32 Consider a confirm password field


Portfolio Test Cases

Function No. of Testers No. of Errors Avg. Time (Sec) Fastest (Sec) Slowest (Sec) Comments
Create Portfolio 20 1 11.63 6 22 Can't create a portfolio called "test" but it appears in dropdown when I buy stocks
Search for DBS Stock 20 0 10.19 5 24 NIL
Buy DBS Stock 20 0 18.38 6 33 Page to show all stocks would be good; Buy/Sell like trading. Consider changing to add/remove.
Buy 2 more Stocks 20 0 58 2 126 Populate last done price in modal & quantity too
Sell any 1 Stock 20 1 46.13 14 95 Loading bar is too small; Confirmation box upon selling


PDF & Excel Test Cases

Function No. of Testers No. of Errors Avg. Time (Sec) Fastest (Sec) Slowest (Sec) Comments
View Portfolio 20 0 4.13 2 16 NIL
Generate PDF Report 20 0 20 3 54 Inform user that they already have clicked the PDF and show them the progress; Feature looks good. Very Useful; Might want to add disclaimer; Popup blocker will disable download, inform users if it is the case
View PDF 20 0 13 4 48 Sold all Genting stocks but they are still under winning stocks; Trust/warrants not in the PDF.
Generate Excel Report 20 3 7 2 126 Inform user that download has started; Icon looks like delete button
View Excel Report 20 3 46.13 14 95 Format Excel nicely please
Delete Portfolio 20 0 5 1 15 Confirmation box upon delete


Watchlist Test Cases

Function No. of Testers No. of Errors Avg. Time (Sec) Fastest (Sec) Slowest (Sec) Comments
Add any 2 Stocks 20 1 29.67 10 55 NIL
Delete the Stocks 20 1 7.73 3 17 Confirmation box upon delete


No. Risk Profiling
1 A bit of doubt on accuracy of the app but good to have. Good functions.
2 Icon is misleading. Thought its settings icon; Setup during registration better for me; Put in profile should not be changed all the time. Some investors are greedy and wanna see rewards in short amt of time
3 Useful function; Put more questions for more accuracy
4 Form was ok
5 Assumes few questions to generate this > GOOD! Very good profiling. Questioning on accuracy of quarters
6 Robot advisor icon not clear. Did not know what that button is for. Breakdown is too general, because large cap stocks have different yield and prices
7 Good amt of questions. Trust that the report is accurate. Useful!
8 Good feature. Recommendation is fair enough. Default profile set looks suspicious
9 Decent. Consider as a pop-up to force reader to read.
10 Limited and some questions are similar. Q2 is too long. Breakdown is not clear. Change to another name!
11 include reasons for breakdown. Default not convincing. Change robot word to financial advisor.
12 Questions are okay. Function is useful. Can provide directions (what you should do)
13 -Remove default values, describe functionality instead and tell user what to do; Q2 too long, intimidating; Q1-3, 2-4, 3-2, 4-4, 5-1; Breakdown is very very very conservative for my input; Explain the terms like tooltip/link e.g. ETF
14 Useful and tell which things to buy. No. of questions are good. Not too long
15 Good feature. Questions just nice.
16 Q4 time range? Define it. Taken aback by form's default values. Should put robot vertically.
17 The default recommendation confused me
18 I like the allocation done, but some parts seem wordy.
19 Description abit wordy but otherwise its ok.
20 Question 2 needs to be rephrase a bit


No. Robot Advisor
1 Good feature! Retirement analyser needs to have more output
2 Error should not stay so long; Increment and decrement makes no sense; Assumptions why got scroll bar; Describe that the est interest rate is automatically populated; Link with robot advisor? How to invest?; Give $ to earn as retirement goal
3 Form is ok, need to be more detailed; Can include additional salary per month, death age and future value at retirement.
4 Very useful. Inputs are ok ------- More details about retirement given would be helpful
5 Light bulb looks like an icon; Too many fields to fill in; Best if can use 1 accordion; Too many tabs is too troublesome for me; More details provided would be good, like telling me exactly how far I am away from my goal, maybe display a chart or something?
6 Good! Cpf and housing loan feature is fresh and very relevant; The application showed me how much I need to earn every month to reach my retirement goal. Its too vague and I don’t know what to do with the information!
7 Good feature, but input a lot of stuff and only getting 1 line of results is a bit disappointing
8 Sentencing structure is weird; Useful feature but questions is how it ties to business environment; Investment should be closer to how my portfolio is doing and advise
9 Useful to have; How would this affect my current investment goals? //might be a problem if they deleted their portfolio?

Would be good if there are clearer action steps for me.

10 Retirement nest value = 2 decimal places; if I can't hit the goals, what to do next?
11 Good function; Expected monthly salary? Or what salary?; Monthly salary based on monthy savings?; Make the function more prominent. It looks like fine print.

Would be good if you show me how exactly I can hit my retirement goals

12 Calculation might be wrong for retirement nest; Lack of info makes it unappealing.
13 Inflation rate put 4%, which is cpf rate. So usually investment must be more than 4%; Target pension term in sg context is it useful?; how much do you need per month (based on?); 2 decimal places; make assumptions tooltip more obvious, e.g. color; more explanation about retirement portion would be good
14 Very good. Information to earn is there; No. of questions is just nice.
15 A lot of inputs but will have a more accurate answer; Try to fit the inputs in a form, very lenghty; The amount of inputs I have to go through just to get 1 sentence of calculation does not seem worth it
16 -Expected salary? Entry level salary? ; Bank interest rate in savings acc is negligible; CPF details link to cpf site; Average salary income increment would be good; This feature is good. ; Feature is useful but too vague to be useful.
17 Telling me how to hit my retirement plans would be more useful than telling me to earn 10k a month for the next 40 years.
18 Feature is interesting, but lacks useful information.
19 NIL
20 Useful feature, but no advice was provided
Key Findings


Overall Findings

No. Overall Comment(s)
1 Love it. Simple and intuitive to use.
2 Ui is not bad. Just the icon; Customize dashboard?; Homepage alignment; Filter for STI components; User icon beside username should always be there.
3 Simple ui.
4 Portfolio summary stocks have alert?; Easy to use, very clear ui
5 More data in graphs! But very good features so far
6 At dashboard the portfolio sector shows 2 stocks but I only have 1 stock; System is slow. Suggest to replace p/e, yield, p/b to ask/bid price; Fix decimal places. Show 2 decimal places; Portfolio robot advisor got error
7 Nil
8 UI easy and straightforward; Some icons needs to be clearer (robot advisor)
9 Dashboard can be neater! Make sure information and actors ar ebetter represented.
10 Make stockbook more obvious at the side nav bar; Search bar still contains stock after logging out.
11 Ui needs improvement. Keep up the good work.
12 Two scrollbar, horizontal bar not needed; Export pdf text should be made clickable. Design is nice.
13 Confirmation box for functions; Color and change text to remove after stocks is added; Information is straightforwrd, easy to find. Things are informative; Search bar is easy to find. Dashboard page quite long, need more organization; Ui is nice and smooth; Purple is weird for stock investment, does not feel professional; Confused as to targeted audience of app, some parts are filled with technical jargons while others feel like a guiding app; Robot advisor and retirement calculation is a good way to stand out; Try to add more value towards this direction since portfolio mgmt app is easily available.
14 UI is quite nice. Easy to navigate around the app.
15 UI cluttered; Under portfolio, icon seems out of place; No search results notification. Indicate that stocks are already in watchlist.
16 Filter equities to the top for search; UI is plain; Homepage feels weird. Icon should be linked to home page; STI component time looks off; Put div data in a table and change PE ratio to P/E ratio. Excel to have opening/closing price over a range of timing.
17 UI needs more graphs. A bit plain looking now.
18 Application looks promising but there are rooms for improvement. Retirement analyser portion really needs more info. If that is supposed to be your unique feature with a Singaporean element, make it more useful by providing useful info.
19 Keep up the good work!
20 Ui is simple and straightforward. Like it a lot.



Key Improvements to be made

  • Consider more visualizations
  • Continue enhancing the User Interface
  • Continue user-centric development as it is proving to be great!



UT 3 Results

UT Results & Findings

Date: 16 Nov 2016
Venue: School of Information Systems, Singapore Management University
Duration: 16 Nov 2016: 1530 - 1900 Hours @ LKCSB CR 2-1
Number of Participants: 40
Target Audience: Millennials; aged 16-36 with Basic or No Investment Background



Objectives:

  1.   Identify functionalities and usability issues
  2.   Determine is the user interface is intuitive
  3.   Discover ways to improve features and functions of the website based on the results of User Testing #3




Scope:
Functionalities tested are ones developed between Iteration 3 and 11




Procedure:

  1.   A UT document with instructions on how to test the website have been given to the testers
  2.   Participants will log down the testing outcomes & team members would note the time taken per task in the sheet
  3.   Participants are welcomed to type their general comments and feedback into the feedback textbox provided at the end of the test plan document




Tasks:
The UT document requests participants to perform the following task(s):
For every task, participants were required to document down the following information:

  • Execution of Task (Successful or Unsuccessful)
  • Outcome
  • Time Taken


  • Login & Registration Test Cases
    • Register a New Account
    • Retrieve your Password
    • Login
    • Change your Password
  • Portfolio Test Cases
    • Create a Portfolio
    • Search for a Stock
    • Buy a Specific Stock
    • Buy Two Other Stocks
    • Sell One Stock
  • PDF & Excel Test Cases
    • View your Portfolio Summary
    • Generate PDF Report of your Portfolio
    • View your PDF Report summary and verify if the information is correct
    • Generate Excel Report of your Portfolio
    • View your Excel Sheet and verify if the information is correct
  • Watch List Test Cases
    • Add any Two Stocks into your Portfolio
    • Delete the stocks from your watch list
  • Risk Profiling Test Case
    • Perform the risk profile and give feedback accordingly
  • Robot Advisor Test Case
    • Perform the Robot Advisor and give feedback accordingly
  • Dividend Tracker Test Case
    • Generate the Dividend Tracker Report for any one of the stock added to your portfolio
  • User Help Display Feedback
    • After observing the user interface and give feedback accordingly


At the end of the test, we also asked the participants to fill the following post-UT questionnaire at the following URL: http://tinyurl.com/stockbook


Results

Demographics of our testers

  • Total number of testers: 40
  • Age group:
    • 4 testers aged between 16 and 21
    • 33 testers aged between 22 and 25
    • 7 testers aged between 26 and 30
    • 0 testers aged above 30 years old
  • Working Profile:
    • 6 testers are currently working
    • 34 testers are currently not working
  • Investment Background:
    • 34 of 40 testers indicated investment background within a year
    • 5 out of 40 testers indicated investment background of 2 to 4 years
    • 1 out of 40 testers indicated investment background of more than 4 years
  • Have you tested for us before in UT 2?
    • 9 out of 40 testers tested for us before
    • 31 out of 40 testers are new to the application


Login & Registration Test Cases

Function No. of Testers No. of Errors Avg. Time (Sec) Fastest (Sec) Slowest (Sec) Comments
Registration 40 0 35.95 16 78
Retrieve Password 40 0 28.12 10 84 Inform me that password is sent to my email
Login 40 0 6.4 2 18
Change Password 40 0 17 2 80 Consider a Confirm Password field.
Consider showing password strength


Portfolio Test Cases

Function No. of Testers No. of Errors Avg. Time (Sec) Fastest (Sec) Slowest (Sec) Comments
Create a Portfolio 40 0 29.8 5 95 Button can be properly aligned
CDP Import button is confusing
Search for DBS Group Holdings stock 40 0 18.6 3 98 Show a list of stocks available
Buy DBS Group Holdings stock 40 1 17.12 2 152 Font a bit too small
Error message for decimal quantity wrong
Unable to select portfolio, solved after refresh
Buy any 2 other stocks 40 0 59.9 12 153 Loading bar can put in centre?
Change colour when hovering over
Sell any stock from your portfolio 40 0 43.55 7 155 A little difficult to find. Consider adding a delete button by the side of the stock.
Would be good if you showed indication that the stocks are listed below


PDF & Excel Test Cases

Function No. of Testers No. of Errors Avg. Time (Sec) Fastest (Sec) Slowest (Sec) Comments
View Portfolio 40 0 3.85 1 30 Colour the words 'buy' and 'sell' differently
Generate PDF Report 40 0 39.87 2 152 Feature is intuitive. It is useful
Popup blocker will disable download. Inform users if that is the case.
View PDF 40 0 3.15 1 10 Put your brand on the PDF report
Generate Excel Report 40 0 10.6 1 46
View Excel Report 40 0 3.1 1 10 Put your brand on the Excel report


Watchlist Test Cases

Function No. of Testers No. of Errors Avg. Time (Sec) Fastest (Sec) Slowest (Sec) Comments
Add any 2 stocks 40 1 44.05 7 90 Easy to use
Delete the stocks 40 0 7.85 1 14


Dividend Tracker Test Cases

Function No. of Testers No. of Errors Avg. Time (Sec) Fastest (Sec) Slowest (Sec) Comments
Generate the Dividend Tracker Report of any of the stock you have added earlier in your portfolio 40 3 31.66 9 139 Some users experienced Error 500.


Risk Profiling

No. Comments
1 Initially, I decide the appetite to lose about 20% above inflation rate but when I saw that I'm willing to lose 20% - 50%. I was shocked as it's not personalised
2 It'll be better to understand the industry the user is interested in and suggest based on that as I may not be interested in the stocks that you recommend. I don't know if five questions is enough to gauge what kind of investor I am, maybe more questions might be better?
3 Useful but not sure how trustable the suggestions are. questions are not very lengthy, short and sweet.
4 Good feature
5 Indentation a bit weird, maybe align all the same? Useful for new users though.
6 Useful functionality to have, I like how it shows a suggested portfolio at the end. So if I'm a noob investor I can probably follow this suggested portfolio. But of course this is subjected to a certain level of trust to the recommendation. Form is alright, not too long, easy to fill up.
7 Should not call it pension. Maybe rename it to target monthly payout. Should put next instead of calculate. I think its really useful, more useful than robot advisor.
8 Useful but information very wordy. Don't feel like reading. Maybe can provide headings for each segment.
9 Understandable. Good
10 Suggestions are good. However, a little dubious on the outcome due to the small number of questions.
11 Can have better organization of the recommendations. Have more striking words that can differentiate

Have more information regarding the recommendation (instead of just the redirect URL)

12 If I already tick conservative, it's not realistic that I can put loss of 50% or what. Shouldn't ask me what kind of investor I am. Just analyse and tell me that I am aggressive or what.
13 The questions are lengthy but this function is useful. taking into consideration, those who are new to investing, this questions are not so beginner friendly.
14 Trust issue with the allocation breakdown. Might be more convincing with graphical representation. I also want to know how robot advisor is calculating my investment
15 Font a bit small
16 Content-wise the questions being asked are questionable in determining the risk level
17 The result was expected, no new insights, need to increase emphasis on the recommendation part instead of the risk profile
18 List of recommended stocks would be good. the recommendation not very clear. give an indepth explanation on what are STI index and all.
19 Useful. would be good if there are some examples of the stocks to buy. top 3 stocks?
20 The portfolio allocation of 'good business model', etc. is a little vague. But good feature.
21 OK feature to have. Good to know what is my risk appetite.
22 Just now the questionaire is centralized but it shifted to the left when 1 questionaire is done
23 Good to have to know risk appetite, and to further do research on what to invest, using it as a guide is good
24 Pretty good guide. Very real and very similar to my own current portfolio, realistic and accurate.
25 Quite cool, tells me what kind of investor I am and where I should invest in. But not sure how trustworthy the advice is. Like how do you compute it or where is the algorithm from?
26 Number of question is ok. There are a variety of questions to assess to choose from -> good. Easy to use. Fonts are too small
27 Profile description does not match suggested allocation. Alignment issues. Not sure what does the number mean. What am i supposed to do?
28 Hyperlink not obvious enough. Profiling quite accurate, would trust the suggested portfolio given
29 Useful to have. Also good that there are some recommendations that are good as to know what kind of stocks I should invest in. Good feature
30 Would be better if there is a graph to show. I think its useful.
31 Good: I like the fact that it analyze my risk. Bad: Would be better if I can see some recommended stocks here or a graph.
32 Nicer if there is a piechart here.
33 I think its useful.
34 Too many words.
35 Give examples of stocks. Can trust the input more if there are more than just words
36 I think its useful, not sure can trust or not
37 Would be good if your profiling contains a lot of information like this. It feels more 'value' for my time and effort doing the questionnaire.
38 Curious to see how many % are aggressive/conservative/balanced
39 Lack of charts here
40 Good features

Robot Advisor

No. Comments
1 I like that it's very detailed and there are recommendation given to me. However, there is a slight decrease for savings around 40-60 years for bank savings which abit unrealistic as people are at their peak. CPF was peak at about 20 years old.
2 Monthly salary shouldn't increase by 1, 100 per increment is more realistic. When I change the estimated bank interest rate to 0.5, there's a red box over it. Upon clicking submit, values will populate the previous values. For a non-Singaporean, we should be allowed to de-select CPF or something because none of my salary goes into CPF anyway. The advice is good and exact amount is given which is good. I need to invest $2 million a year??? Very demoralising. For "Compare to people of Similar Age": What is the x-axis? And where am I? I prefer to see my savings over time so I know how I'm doing. It's good to know what people with similar risk appetite are investing in and it'll be good to have like: "I see that you are interested in technology, here are some stocks you might want to consider"
3 Useful function. you like the breakdown and tells me that how much am i away from my target. font size abit small.
4 Good question and breakdown
5 Dont round the corners of the retirement analyzer pop up. Change the button of "calculate retirement analyzer" to the same kind of button on the questionnaire. Notification bar says its is calculated already but the bottom still loading and spinning. Annoying to keep loading again when you go other pages and click on "back" on the browser. Charts should have legend for x and y axis
6 Good functionality to have, looks like this could replace a human financial advisor to help people with retirement planning. I think it's good that there's some comparison between myself and the national benchmark and of course the recomendation of what stocks to buy look good as well.
7 Should not call it pension. Maybe rename it to target monthly payout. Should put next instead of calculate. I think its really useful, more useful than robot advisor.
8 Useful but information very wordy. dont feel like reading. maybe can provide headings for each segment.
9 Interesting and good advice
10 Useful but could have more concrete suggestions such as more in-depth suggestions
11 Good feature to have as users are lazy to calculate on their own. Could have indicators on the risk of the stock at the recommendation
12 Not clear that there are other pages. Retirement stock recommendation should be linked to robot advisor.
13 Quite useful. information a bit overload. structure them with headers or put them into tabs.
14 I like this function as it gives a good indication of my current status with regards to my plans to plan for retirement. Also, as there are graphical representation, I am more convinced about the reliability of this function.
15 I think the feature is good.
16 Content-wise the questions being asked are questionable in determining the risk level
17 In terms of monthly salary its expected average . Currently not very relevant as a student or fresh grad without salary. Would not use as a benchmark as anything. Values seem unrealistic. Fonts too light
18 Have a next button below so that people will know that he/she needs to fill in other tabs as well. information too wordy. highlight important points. bold them? label axis for cpf balances / savings. Overall is good. Breakdown is clear.
19 Useful. would be good if there are some examples of the stocks to buy. top 3 stocks?
20 Very good feature, it searches stocks for you in terms of your risk appetite because of similar risk nature and interest are buying. Can consider displaying the stocks of similar risk appetite of its details for users to invest
21 What if there are people who have non-stable income (commission based, etc). Quite a cool feature, very comprehensive and its good to know what other people of similar risk appetite are investing
22 The graph cannot see the axis when value is very big. Should have comma for the number
23 Can plan my course of action, whether I am in the right direction, whether to manage my expectaitons, manage my goals, adjust accordingly, Good feature to have!
24 Very good feature to those who do not know personal finance, and a very good gauge on how this would affect retirement plans, etc. Pretty good feature!
25 Quite cool, tells me what kind of investor I am and where I should invest in. But not sure how trustworthy the advice is. Like how do you compute it or where is the algorithm from?
26 Easy to understand. Good recommendation. Good in showing current progress of their retirement goal. Fonts are too small
27 Informative that the nubmers are broken down nicely. I like the top 5 recommended div yield because its beneficial to my trading process.
28 Hyperlink should open in a new tab. Hyperlink not obvious enough. Profiling quite accurate, would trust the suggested portfolio given
29 Very efficient. It allows me to know how should I plan for my retirement, and to reach my goals. Very good to show what kind of stocks of my risk appetite can handle, to invest and reach closer to my goal.
30 I think that the retirement analyzer is fairly useful. I like how highest dividend yielding stocks are recommended. It would be great if there are other stocks that you can recommend me as well.
31 Good: Showed me top 5 dividend yielding stocks. Bad: The calculate button is confusing, i did not know that there are other fields
32 Good feature to have. Better if there is a field for me to put my monthly expenses.
33 Personally i dont like the retirement planning part, but I like the stock recommendation part.
34 Too many words! Can better segment content to make it more 'fun' to read
35 Calculate button confusing. Otherwise its good
36 I think its useful, but not sure can trust or not
37 Would be good if your profiling contains a lot of information like this. It feels more 'value' for my time and effort doing the questionnaire.
38 I am more interested in how to earn money fast
39 What about non-stable income? Expenses? I like the breakdown, would be good if I choose to see other recommendations other than dividend stocks.
40 Useful for working class people

User Help Display

No. Comments
1 I think it help in explanation for the financial terms but will be great if there are indicators, like if the ROE more than 10 will be good.
2 Good for people who just started investing. Maybe it'll be better to have more specific tips on how to invest and when to invest. Quote from experts if they have some tips - Tip of the day? Hahaha. A small guide to teach people how to invest, when to invest and what to invest.
3 Useful function. for people who dont know anything about financial data
4 Tooltip is good. Helps me makes decision better. Maybe can put a status beside to saying how good it is. Like P/B ratio what is the average.
5 Justify instead of center aligned - tooltip
6 This is definitely useful for novice investors who may not be too sure of certain financial terminologies. Can't think of anything bad about this.
7 Useful because your app is to manage not to educate. Good feature
8 Useful because beginners might not know what those terms meant
9 Generally useful. Instead of just adding in values, show how these values affect your performance. Looking at the value doesnt really tell me. Show a dynamic view of how the value impacts the stock or my portfolio.
10 Definitely good to have as it provides a brief knowledge to the term
11 Good, better if explaination can be clearer
12 Total portfolio value description might need to be check again.
13 Useful tooltips!
14 It is a good indication of explaining what these terms are, especially when I am a novice investors.
15 Should have 1 for dividend??
16 Useful. Would like to have thousands separator in retirement progress
17 Good. Should have help section or promotional video if targeting new investors
18 Good implementation. Would be better if there is an option to turn on and off the tooltip for expert
19 Tool tips are useful.
20 Useful to have to introduce financial terms to users. But do not add to all financial terms but only key ones to avoid clutter.
21 Useful to know and understand better on what you are doing to make a better informed decision. Good to them on ALL financial terms
22 NIL
23 Very useful to have and understand what the jargon means and no need for me to go read up on Investopedia.
24 Very good!
25 Quite good then I don't have to go somewhere else to find.
26 NIL
27 It is useful for novice to use
28 Clear and useful. Good that it is not a pop up box
29 Very good to have because it helps to explain what the jargons are easy for people to follow, and even explained how some terms are calculated. Transparent and good. And it's good that it is a hover.
30 I think that these tooltips are good, would be better if there can be a page with all these resources.
31 Good: Useful for novice investors
32 Tooltip is useful
33 For incoming investors it is lacking info, for moderate investors they do not need it. Not sure for novice investors.
34 Tooltips did not tell me what to do with the stock
35 Good
36 Tooltips are alright
37 Not very useful for me, but i think useful for novice
38 Would be better if you tell me HOW instead of what do those terms mean
39 Useful
40 Useful
Key Findings


Overall Findings

No. Overall Comment(s)
1 Great improvements made since UT 2
2 Great user interface, very easy to use!
3 Can be improved with slightly bigger fonts?
4 Very intuitive and modern, love the design element
5 Very useful application, I would consider using this for my actual investments
6 Cool features built
7 Love the landing page to intrigue me
8 Unsure of the accuracy of results but if it is validated, it is really good!
9 Visually appealing, would have preferred a more colourful and bright colour scheme than purple though
10 Amazing features, remarkable of what a FYP team managed to achieve
11 Can consider more tooltips to explain fundamental terms
12 Great to explore possibility for technical analysis
13 Would be willing to pay $50-200 amount for such a tool to aid me in my investments



Key Improvements to be made

  • Colour scheme consideration changes
  • Technical analysis component [more graphs]
  • Ensuring all bugs are fixed, and ready for handover