HeaderSIS.jpg

IS480 Team wiki: 2015T2 REALIS Documentation - Testing

From IS480
Jump to navigation Jump to search
REALIS-Banner-main6.png
HOME   PROJECT OVERVIEW   PROJECT MANAGEMENT   DOCUMENTATION   THE TEAM
ANALYSIS DESIGN TESTING

Types of Tests

REALIS Overall UT.png


Property Analyst Jessie:

“ The user interface and usability have improved a lot since the first prototype. This application allows us to do quick property analysis presentation to our bosses ”

“Compared to the current REALIS system, it is a lot easier to navigate through this application.”



Property Analyst Hiong Chin:

“This application allows us to filter the properties we want to see so quickly and at ease. This saves a lot of time too!”

“The project comparison feature helps us a lot in our analysis.”


User Test 1 & 2

REALIS UT1.png


REALIS UT1 dates.png


PURPOSE OF THE TEST:

1. Gather feedback for the developed functions
2. Detect usability issues of the application

Feedback:

  1. Selection multiple markers on map
  2. Include minimum, median and maximum percentile for line graph
  3. Implement a global reset button to clear graphs criteria
  4. Charts should not be placed on the map
  5. Representation of data is interesting
  6. Heat map and clustering of map markers are good

Usability Issues:

  1. Filtering of graphs not intuitive
  2. Organization of information is confusing
LEARNING OUTCOMES:

1. Users find the application confusing due to poor organization of information
2. Users not used to the new way of filtering graphs

  • Due to the use of crossfilters

3. Users do not like to see many graphs in one view
4. Users like the visually appealing way of representing data

CHANGES MADE:
Change No: Before: After:
1. Select multiple markers on map
REALIS UT1 change1BEFORE.png
REALIS UT1 change1AFTER.png
2. Minimum, median and maximum percentile graph
REALIS UT1 change2BEFORE.png
REALIS UT1 change2AFTER.png
3. Implemented a global reset button
NA
REALIS UT1 change3AFTER.png
4. Charts are removed from the map
REALIS UT1 change4BEFORE.png
REALIS UT1 change4AFTER.png

User Test 3

REALIS UT3.png


REALIS UT3 dates.png


PURPOSE OF THE TEST:

1. Gather feedback for the developed functions
2. Detect usability issues of the application
3. Determine the learning curve of the application
4. Find out the application’s relevance to URA users (Mainly property analysts)

Feedback:

  1. Data table needs to include information on sale type
  2. Legend labels are needed in relation to the colour used for the charts

Usability Issues:

  1. Pie chart toggle is difficult to find
  2. The lines in line chart are too cluttered
LEARNING OUTCOMES:

Evaluate The Usefulness Of The Functions (Importance):

REALIS UT3 usefulness.png


Average Time Taken To Use A Function (Usability):

REALIS UT3 timetaken.png


1. The least important function to property analyst are:

  • Pie chart for property volume
  • Histogram chart for price distribution

2.The histogram chart to view the property price distribution is the most user unfriendly function 3.Generally, property analysts concluded that the tested functions are useful and user-friendly

CHANGES MADE:
Change No: Before: After:
1. Included sale type in data table
REALIS UT3 change1BEFORE.png
REALIS UT3 change1AFTER.png
2. Included legend labels
REALIS UT3 change2BEFORE.png
REALIS UT3 change2AFTER.png

User Test 4

REALIS UT4.png


REALIS UT4 dates.png


PURPOSE OF THE TEST:

1. Gather feedback for the developed functions
2. Detect usability issues of the application
3. Find out the application’s relevance to URA users (Non-property analysts)

Feedback:

  1. Map requires a reset button to its original view
  2. Google street view will be useful for planners
  3. Top part of the line chart is cut off
  4. Labels for the axis are required

Usability Issues:

  1. Too much scrolling
LEARNING OUTCOMES:

Evaluate The Usefulness Of The Functions (Importance):

REALIS UT4 usefulness.png


Average Time Taken To Use A Function (Usability):

REALIS UT4 timetaken.png


1. The most user unfriendly function for non property analysts are:

  • Bar chart for viewing property price against date
  • Line chart for percentiles

2. Pie chart for sale type volume is the least important function to non-property analysts 3. Generally, non property analysts concluded that the tested functions are useful

CHANGES MADE:
Change No: Before: After:
1. Included reset button for map
REALIS UT4 change1BEFORE.png
REALIS UT4 change1AFTER.png
2. Implement google street map NA
REALIS UT4 change2AFTER.png
3. Corrected appearance of line chart
REALIS UT4 change3BEFORE.png
REALIS UT4 change3AFTER.png
4. Added axes and legends for better clarity
REALIS UT4 change4BEFORE.png
REALIS UT4 change4AFTER.png

User Test 5

REALIS UT5.png


REALIS UT5 dates.png


PURPOSE OF THE TEST:

1. Gather feedback for the developed functions
2. Detect usability issues of the application
3. Final interview with users

Feedback:

  1. Nearby projects can be shown on the map
  2. Date in data table is too detailed

Usability Issues:

  1. Google street view needs to populate panorama upon entering postal code
  2. Enable tooltip on histogram
LEARNING OUTCOMES:

Average Time Taken To Use A Function (Usability):

REALIS UT5 timetaken.png


1. Users take the longest time for the project comparison

  • Relatively new concept of comparing projects

2. Property market analysts concluded that google street view is more useful 3. Despite the long usability timings, project comparison and accessibility are rated the most useful functions!

CHANGES MADE:
Change No: Before: After:
1. Display markers of nearby projects
REALIS UT5 change1BEFORE.png
REALIS UT5 change1AFTER.png
2. Implement google street map
REALIS UT5 change2BEFORE.png
REALIS UT5 change2AFTER.png