HeaderSIS.jpg

Difference between revisions of "IS480 Team wiki: 2015T1 A3xy FinalWiki"

From IS480
Jump to navigation Jump to search
 
(17 intermediate revisions by the same user not shown)
Line 45: Line 45:
 
|[[Image:A3xy_midterm.png|left|100px|link=]]||
 
|[[Image:A3xy_midterm.png|left|100px|link=]]||
 
| width="100%" |
 
| width="100%" |
'''Midterm Slides'''<br/>
+
'''Final Presentation Slides'''<br/>
 
Download:  [[Media:A3xy_finalslides.pdf | Final presentation]]
 
Download:  [[Media:A3xy_finalslides.pdf | Final presentation]]
 
|}
 
|}
Line 71: Line 71:
 
| width="100%" |
 
| width="100%" |
 
'''Lab session'''<br/>
 
'''Lab session'''<br/>
Date: 13th November
+
Date: 13th November<br/>
 
Venue: Ngee Ann Polytechnic
 
Venue: Ngee Ann Polytechnic
 
|}
 
|}
Line 79: Line 79:
 
| width="100%" |
 
| width="100%" |
 
'''Users'''<br/>
 
'''Users'''<br/>
42 students
+
42 students<br/>
 
1.5 hour lab session
 
1.5 hour lab session
 
|}
 
|}
Line 92: Line 92:
 
|}
 
|}
 
<br/>
 
<br/>
Feedback from students :
+
<b>Feedback from students : </b><br/>
 +
<br/>
 +
Average scores of the students against an expert user (our group member)<br/>
 +
[[Image:A3xy_labresult.png|left|400px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/>
 +
* Team with highest score had 292 points
 +
* Team with lowest scores had 203 points
 +
* Assuming 300 is the best score a team can have, all teams scored over 68%
 +
* Top 5 teams received prizes since they scored above 90% (>=270 points)
 
<br/>
 
<br/>
 
Below are some pictures from the lab session :
 
Below are some pictures from the lab session :
Line 125: Line 132:
 
<br/>
 
<br/>
 
{| width="50%" |
 
{| width="50%" |
[[Image:A3xy_finalSM.png|left|400px|link=]]
+
[[Image:A3xy_finalSM.png|left|450px|link=]]
 
| width="50%" |
 
| width="50%" |
 
{| class="wikitable"  
 
{| class="wikitable"  
Line 138: Line 145:
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
 
| style="text-align:center" | 16
 
| style="text-align:center" | 16
| style="text-align:center" | 87.5%
+
| style="text-align:center" | 0.88
 
|-
 
|-
 
| style="text-align:center" | 2
 
| style="text-align:center" | 2
Line 144: Line 151:
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
 
| style="text-align:center" | 15
 
| style="text-align:center" | 15
| style="text-align:center" | 93.33%
+
| style="text-align:center" | 0.93
 
|-
 
|-
 
| style="text-align:center" | 3
 
| style="text-align:center" | 3
Line 150: Line 157:
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
| style="text-align:center" | 100%
+
| style="text-align:center" | 1.00
 
|-
 
|-
 
| style="text-align:center" | 4
 
| style="text-align:center" | 4
Line 156: Line 163:
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
 
| style="text-align:center" | 17
 
| style="text-align:center" | 17
| style="text-align:center" | 82.4%
+
| style="text-align:center" | 0.82
 
|-
 
|-
 
| style="text-align:center" | 5
 
| style="text-align:center" | 5
Line 162: Line 169:
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
 
| style="text-align:center" | 9
 
| style="text-align:center" | 9
| style="text-align:center" | 155.6%
+
| style="text-align:center" | 1.56
 
|-
 
|-
 
| style="text-align:center" | 6
 
| style="text-align:center" | 6
Line 168: Line 175:
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
 
| style="text-align:center" | 17
 
| style="text-align:center" | 17
| style="text-align:center" | 82.4%
+
| style="text-align:center" | 0.82
 
|-
 
|-
 
| style="text-align:center" | 7
 
| style="text-align:center" | 7
Line 174: Line 181:
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
 
| style="text-align:center" | 15
 
| style="text-align:center" | 15
| style="text-align:center" | 93.3%
+
| style="text-align:center" | 0.93
 
|-
 
|-
 
| style="text-align:center" | 8
 
| style="text-align:center" | 8
Line 180: Line 187:
 
| style="text-align:center" | 14
 
| style="text-align:center" | 14
 
| style="text-align:center" | 10
 
| style="text-align:center" | 10
| style="text-align:center" | 140.0%
+
| style="text-align:center" | 1.40
 +
|-
 +
| style="text-align:center" | 9
 +
| style="text-align:center" | 100%
 +
| style="text-align:center" | 9
 +
| style="text-align:center" | 9
 +
| style="text-align:center" | 1.00
 +
|-
 +
| style="text-align:center" | 10
 +
| style="text-align:center" | 100%
 +
| style="text-align:center" | 14
 +
| style="text-align:center" | 19
 +
| style="text-align:center" | 0.74
 +
|-
 +
| style="text-align:center" | 11
 +
| style="text-align:center" | 100%
 +
| style="text-align:center" | 15
 +
| style="text-align:center" | 15
 +
| style="text-align:center" | 1.00
 
|-
 
|-
 
|}
 
|}
Line 186: Line 211:
 
<br/><br/><br/>
 
<br/><br/><br/>
 
Below are the reasons for high and low schedule metrics for the iterations : <br/>
 
Below are the reasons for high and low schedule metrics for the iterations : <br/>
[[Image:A3xy_midSM1.png|center|900px|link=]]
+
[[Image:A3xy_finalSM1.png|center|900px|link=]]
[[Image:A3xy_midSM2.png|center|900px|link=]]
+
[[Image:A3xy_finalSM2.png|center|900px|link=]]
[[Image:A3xy_midSM3.png|center|900px|link=]]
+
[[Image:A3xy_finalSM3.png|center|900px|link=]]
[[Image:A3xy_midSM4.png|center|900px|link=]]
+
[[Image:A3xy_finalSM4.png|center|900px|link=]]
 +
[[Image:A3xy_finalSM5.png|center|900px|link=]]
 
<br/>
 
<br/>
 
<div style="font-size:20px">'''Bug Metrics'''</div>
 
<div style="font-size:20px">'''Bug Metrics'''</div>
 
<br/>
 
<br/>
 
Below are the bug points distribution for each iteration:
 
Below are the bug points distribution for each iteration:
[[Image:A3xy_midbug1.png|center|850px|link=]]
+
[[Image:A3xy_finalbug1.png|center|850px|link=]]
 
Below is the distribution of bugs based on their severity for each iteration:
 
Below is the distribution of bugs based on their severity for each iteration:
[[Image:A3xy_midbug3.png|center|850px|link=]]
+
[[Image:A3xy_finalbug3.png|center|850px|link=]]
 
<br/>
 
<br/>
{| class="wikitable"
 
! style="font-weight: text-align: center; bold;width:100px; border:1px solid #999" | Iteration
 
! style="font-weight: text-align: center; bold;width:100px; border:1px solid #999" | Bug Score
 
! style="font-weight: text-align: center; bold;width:200px; border:1px solid #999" | Summary of Bugs
 
! style="font-weight: text-align: center; bold;width:200px; border:1px solid #999" | Action Taken
 
|-
 
| style="text-align:center" | 5
 
| style="text-align:center" | 13
 
| style="text-align:center" | Most of the bugs were in exposing BPM as a web service and UI  improvements.
 
| style="text-align:center" | Stop current development and resolve the bug immediately. Project Manager reschedules the project.
 
|-
 
| style="text-align:center" | 7
 
| style="text-align:center" | 4
 
| style="text-align:center" | Bugs were related  to parsing of XML element.
 
| style="text-align:center" | The system does not need immediate fixing, could be fixed during buffer time or during coding sessions.
 
|-
 
| style="text-align:center" | 8
 
| style="text-align:center" | 7
 
| style="text-align:center" | Errors involved UI improvements and calling of web services.
 
| style="text-align:center" | Use planned debugging time in the iteration to solve the bug.
 
|-
 
|}
 
 
<div style="font-size:20px">'''Risk Management'''</div>
 
<div style="font-size:20px">'''Risk Management'''</div>
 
{| class="wikitable"  
 
{| class="wikitable"  
Line 245: Line 249:
 
| style="text-align:center" | Medium
 
| style="text-align:center" | Medium
 
| style="text-align:center" | PM has to work closely with the Back-End and front-end lead developers and bridge the gap between business process and technical components.
 
| style="text-align:center" | PM has to work closely with the Back-End and front-end lead developers and bridge the gap between business process and technical components.
|-
 
|}
 
<div style="font-size:20px">'''Technical Complexities'''</div>
 
{| class="wikitable"
 
! style="font-weight: text-align: center; bold;background: #57E3AB;color:#fff; width:100px; border:1px solid #999" | Feature Involved
 
! style="font-weight: text-align: center; bold;background: #57E3AB;color:#fff; width:100px; border:1px solid #999" | Description of Technical Complexity
 
! style="font-weight: text-align: center; bold;background: #57E3AB;color:#fff; width:200px; border:1px solid #999" | What is to be achieved as the end result
 
|-
 
| style="text-align:center" | Web service calling from BPM.
 
| style="text-align:center" | Use of SOAP request message and IBM BPM mapping to make web services call from IBM BPM.
 
| style="text-align:center" |  BPM can access data from the database only through web services in order to read a Letter of Credit, uploaded documents and other data.
 
|-
 
| style="text-align:center" | Exposing web service through BPM.
 
| style="text-align:center" | Use of undercover agent feature of IBM BPM.
 
| style="text-align:center" | This is used in order to trigger the BPM process by a web service call or any action from the front-end portal.
 
|-
 
| style="text-align:center" | Messaging standard web services between banks.
 
| style="text-align:center" | Use of Gateway that supports both SWIFT and ISO standards.
 
| style="text-align:center" | Banks have different standards for sending messages across each other. The gateway is used for sending advise and acknowledgement messages from one bank to the other.
 
 
|-
 
|-
 
|}
 
|}
 
==<div style="background: #4d627f; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px; font-size:24px"><font color= #FFFFFF>Quality of Product</font></div>==
 
==<div style="background: #4d627f; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px; font-size:24px"><font color= #FFFFFF>Quality of Product</font></div>==
 
<div style="font-size:20px">'''Intermediate Deliverables'''</div>
 
<div style="font-size:20px">'''Intermediate Deliverables'''</div>
There should be some evidence of work in progress.<br/>
+
There should be some evidence of work.<br/>
 
{|  class="wikitable"  border="1"
 
{|  class="wikitable"  border="1"
 
|- style="background:#fcd703; color:white"  
 
|- style="background:#fcd703; color:white"  
Line 328: Line 313:
 
|-
 
|-
 
|}
 
|}
<div style="font-size:20px">'''User Test 2'''</div>
+
<div style="font-size:20px">'''User Test 4'''</div>
<b>Objective : Are we building an understandable portal?</b><br/><br/>
+
<b>Objective : Compare the usability of the platform between first-time and old users.</b><br/><br/>
The tasks assigned can be found here: [[Media:A3xy_UT2.pdf| A3XY User Test 2 Plan]]<br/>
+
The tasks assigned can be found here: [[Media:A3xy_UT4.pdf| A3XY User Test 4 Plan]]<br/><br/>
 
<b>Demographic</b> <br/>
 
<b>Demographic</b> <br/>
 
{| class="wikitable"  
 
{| class="wikitable"  
Line 337: Line 322:
 
|-
 
|-
 
| style="font-weight: text-align: center; bold;background: #57E3AB;color:#fff; width:100px; border:1px solid #999" | Number of Users  
 
| style="font-weight: text-align: center; bold;background: #57E3AB;color:#fff; width:100px; border:1px solid #999" | Number of Users  
| style="text-align:center" | 5
+
| style="text-align:center" | 12 (6 old users, 6 new users)
 
|-
 
|-
 
| style="font-weight: text-align: center; bold;background: #57E3AB;color:#fff; width:100px; border:1px solid #999" | Venue
 
| style="font-weight: text-align: center; bold;background: #57E3AB;color:#fff; width:100px; border:1px solid #999" | Venue
Line 344: Line 329:
 
|}
 
|}
 
<br/>
 
<br/>
<b>Brief information on the participants:</b>
+
<b>Brief information on the participants:</b><br/>
*Experienced with background in Consumer Internet Banking
+
'''Group A (old users)'''<br/>
*Understand banking terms
+
* Have prior experience of using the platform
*Have not being exposed to the software being used (IBM BPM)
+
* Have worked on the LC process
 +
* Have basic knowledge of Trade Finance from prior usage
 
<br/>
 
<br/>
<b>Goals:</b>
+
'''Group B (new users)'''<br/>
*Students should find the BPM portal and Trade Finance portal user friendly.
+
* Experienced with background in Consumer Internet Banking
*Students should like the web interface of the portal.
+
* Understand banking terms
*Students should understand the process of LC Application and Document Presentation.
+
* Have not being exposed to the software being used (IBM BPM)
<br/>
+
 
<b>Feedback Collected:</b>
 
The feedback collected can be found here: [[Media:A3xy_UT2Results.pdf| A3XY User Test 2 Results]]
 
 
<br/><br/>
 
<br/><br/>
 
<b>Results:</b>
 
<b>Results:</b>
 
*Time Spent in finishing the LC Application process (in mins)<br/>
 
*Time Spent in finishing the LC Application process (in mins)<br/>
[[Image:a3xy_UT2_result1.png|left|500px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
+
[[Image:a3xy_UT4_result1.png|left|500px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
 
*Time Spent in finishing the Document Presentation process (in mins)<br/>
 
*Time Spent in finishing the Document Presentation process (in mins)<br/>
[[Image:a3xy_UT2_result2.png|left|500px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
+
[[Image:a3xy_UT4_result2.png|left|500px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
 +
*Average Time Spent in finishing the Shipping Guarantee, Trust Receipt and Banker’s guarantee processes (in mins)<br/>
 +
[[Image:a3xy_UT4_result3.png|left|500px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
 
*Did you understand the full process?<br/>
 
*Did you understand the full process?<br/>
[[Image:a3xy_UT2_result3.png|left|400px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
+
[[Image:a3xy_UT4_result4.png|left|400px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
 
*Was the application easy to use?<br/>
 
*Was the application easy to use?<br/>
[[Image:a3xy_UT2_result4.png|left|400px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
+
[[Image:a3xy_UT4_result5.png|left|400px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
 +
*Results for quizzes for both the groups. (Average number of answers answered correctly)<br/>
 +
[[Image:a3xy_UT4_result6.png|left|500px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
 
<b>Key Findings:</b>
 
<b>Key Findings:</b>
*Participants find the technical names confusing sometimes. They have to go back to the Trade Finance home page every time in order to recall the meaning of different terms.
+
*Group A participants feel that the new interface is a big improvement from the previous version.
*Participants pointed out that it would be better if the URL of the document is clickable on the portal itself rather than copy pasting
+
*Group A participants feel that the new version provides a more comprehensive flow of the Trade Finance process and its components.
*Participants find the IBM BPM portal easy to use and straightforward with minimum clicks involved.
+
*Group A participants have on average 25% better performance compared to their performance in a previous user test.
*Participants liked the user interface of the Trade Finance portal.
+
*Group A participants have on average 15% better performance compared to the performance of Group B on average.
*80% of the participants understood the process of LC Application and Document Presentation using this application.
+
*All participants found the glossary to be really useful for referencing to the definitions.
*60% of the participants did not find the application easy to use.
+
*Group B participants do not face the issues that Group A faced in the previous user tests and on average have a 10% better performance for the same processes.
*Participants were a bit confused about the ISO and SWIFT messaging standards display.
+
*12.5% of Group B participants felt that the constant movement between the portal and IBM BPM was confusing
 +
*All participants find individual components of the application easy to use.
 +
 
<br/>
 
<br/>
<div style="font-size:20px">'''User Test 3'''</div>
+
<div style="font-size:20px">'''User Test 5'''</div>
<b>Objective : Process Verification</b><br/><br/>
+
<b>Objective : Heuristic Evaluation of the built application. </b><br/><br/>
The tasks assigned can be found here: [[Media:A3xy_UT3.pdf| A3XY User Test 3 Plan]]<br/>
+
The tasks assigned can be found here: [[Media:A3xy_UT5.pdf| A3XY User Test 5 Plan]]<br/><br/>
 
<b>Demographic</b> <br/>
 
<b>Demographic</b> <br/>
 
{| class="wikitable"  
 
{| class="wikitable"  
 
| style="font-weight: text-align: center; bold;background: #fcd703;color:#fff; width:100px; border:1px solid #999" | Users
 
| style="font-weight: text-align: center; bold;background: #fcd703;color:#fff; width:100px; border:1px solid #999" | Users
| style="text-align:center" | Professors
+
| style="text-align:center" | Students
 
|-
 
|-
 
| style="font-weight: text-align: center; bold;background: #fcd703;color:#fff; width:100px; border:1px solid #999" | Number of Users  
 
| style="font-weight: text-align: center; bold;background: #fcd703;color:#fff; width:100px; border:1px solid #999" | Number of Users  
| style="text-align:center" | 2
+
| style="text-align:center" | 8
 
|-
 
|-
 
| style="font-weight: text-align: center; bold;background: #fcd703;color:#fff; width:100px; border:1px solid #999" | Venue
 
| style="font-weight: text-align: center; bold;background: #fcd703;color:#fff; width:100px; border:1px solid #999" | Venue
| style="text-align:center" | SIS MR 4.3
+
| style="text-align:center" | SOE CR 3.4
 
|-
 
|-
 
|}
 
|}
 
<br/>
 
<br/>
 
<b>Brief information on the participants:</b>
 
<b>Brief information on the participants:</b>
*Experienced with background in Trade Finance
+
*Have basic knowledge of Trade Finance from prior study
*Work at Ngee Ann Polytechnic
 
 
<br/>
 
<br/>
 
<b>Goals:</b>
 
<b>Goals:</b>
*To gather suggestions and feedback after using the application.
+
*Students should be able to navigate around the website easily
*To verify content and check consistency throughout the platform.
+
*Students should understand the requirements for various input fields without additional help
*To find pain points identified by the Professors while using the platform and trade portal.
+
*Students should find the application visually appealing
*To find out whether the platform would act as a good teaching tool or not.
 
 
<br/>
 
<br/>
<b>Usability:</b><br/>
+
<b>Results:</b><br/>
Ratings of various elements of the portal<br/>
+
*Rating based on the student’s experience while navigating the website where 1 is hard and 5 is easy<br/>
[[Image:a3xy_UT3_result.png|left|600px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
+
[[Image:a3xy_UT5_result1.png|left|400px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
 +
*Rating based on clarity of requirements for input fields<br/>
 +
[[Image:a3xy_UT5_result2.png|left|400px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
 +
*Rating based on visual appeal of the website<br/>
 +
[[Image:a3xy_UT5_result3.png|left|400px|link=]]<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
 +
<b>Key Findings:</b>
 +
*In general, participants find it easy to navigate around that website. However, some participants still take some time to understand the jump from trade portal to trade operations
 +
*Participants are able to understand the requirement for all input fields easily.
 +
*Participants find the trade portal visually appealing but there is still room for improvement.
 +
*Some participants feel a requirement for a feature that show a summary of their lc transactions.
 +
 
 
==<div style="background: #4d627f; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px; font-size:24px"><font color= #FFFFFF>Reflection</font></div>==
 
==<div style="background: #4d627f; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px; font-size:24px"><font color= #FFFFFF>Reflection</font></div>==
 
[[Image:A3xy_midref1.png|center|800px|link=]]
 
[[Image:A3xy_midref1.png|center|800px|link=]]
 
[[Image:A3xy_midref2.png|center|800px|link=]]
 
[[Image:A3xy_midref2.png|center|800px|link=]]
 +
<br/>
 +
==<div style="background: #4d627f; padding: 15px; font-weight: bold; line-height: 0.3em; text-indent: 15px; font-size:24px"><font color= #FFFFFF>Client's View</font></div>==
 +
" Using this new application, I will be able to more effectively teach Trade Finance to my MITB class.  The hands-on use of the tool will help to drive home the main learning points of the course.The tool functions nearly like a “real” Trade Finance system a bank might use, and it implements industry standard message formats, eg; SWIFT and ISO. This is the first FYP project that I am aware of that implements a BPM engine, and it would be useful to demo the application in PMSB. Ngee Ann Poly will also use this application to support their Financial Informatics Diploma course. "<br/>
 +
<b>- Professor Alan, Chief Architect for SMU tBank</b>
 +
<br/><br/>
 
|}
 
|}

Latest revision as of 11:45, 30 November 2015

A3xy team logo1.png



A3xy HomeIcon.png

HOME

  A3xy UserIcon.png

ABOUT US

  A3xy Project.png

PROJECT OVERVIEW

  A3xy StatsIcon.png

PROJECT MANAGEMENT

  A3xy PapersIcon.png

DOCUMENTATION

 
Main Wiki Midterm Wiki Final WikiWP SubPlane.png


Project Progress Summary


A3xy midterm.png

Final Presentation Slides
Download: Final presentation


A3xy computer.png

Deployed website
Trade Portal : http://tbankonline.com/SMUtBank_CIB
Trade Operations : https://tbankonline.com:9443/ProcessPortal/login.jsp


Development Progress

Current Progress : 100%
Current Iteration : 12
12th Nov - 23rd Nov

Below is the scope of our project and the functionalities :

A3xy scope.png


Project Highlights (X-factor)

A3xy live.png

Lab session
Date: 13th November
Venue: Ngee Ann Polytechnic


A3xy labusers.png

Users
42 students
1.5 hour lab session


A3xy labpurpose.png

Purpose

  • Learn about Trade Finance
  • Prelude to Corporate Banking module
  • Experience SMU’s teaching pedagogy


Feedback from students :

Average scores of the students against an expert user (our group member)

A3xy labresult.png









  • Team with highest score had 292 points
  • Team with lowest scores had 203 points
  • Assuming 300 is the best score a team can have, all teams scored over 68%
  • Top 5 teams received prizes since they scored above 90% (>=270 points)


Below are some pictures from the lab session :

A3xy Xfactor lab.JPG

Project Management


Iteration Tasks

A3xy finaltasks.png
























Project Schedule (Planned VS Actual)
Planned Actual

A3xy timeline v1.jpg

A3XY Timeline.png


Project Scope (Planned VS Actual)
Planned Actual

A3XY Scope.png

A3XY Scope1.png


Schedule Metrics


A3xy finalSM.png
Iteration Completion % Planned Days Actual Days Metric Index
1 100% 14 16 0.88
2 100% 14 15 0.93
3 100% 14 14 1.00
4 100% 14 17 0.82
5 100% 14 9 1.56
6 100% 14 17 0.82
7 100% 14 15 0.93
8 100% 14 10 1.40
9 100% 9 9 1.00
10 100% 14 19 0.74
11 100% 15 15 1.00




Below are the reasons for high and low schedule metrics for the iterations :

A3xy finalSM1.png
A3xy finalSM2.png
A3xy finalSM3.png
A3xy finalSM4.png
A3xy finalSM5.png


Bug Metrics


Below are the bug points distribution for each iteration:

A3xy finalbug1.png

Below is the distribution of bugs based on their severity for each iteration:

A3xy finalbug3.png


Risk Management
Risk Consequences Likelihood Impact Mitigation Strategy
Team is unfamiliar with technologies used. Project will be potentially delayed due to incorrect estimates. High High Team members will research and guide each others. Project manager will allocate more time to this task.
Delay in development due to downtime of server. Front-end and IBM BPM implementation not possible if the server is down. Low High Coordinate with the client on a regular basis to modify the schedule if required.
Failure to factor in minor coding tasks due to lack of experience. Project will be potentially delayed as these minor tasks need to be performed. Medium Medium PM has to work closely with the Back-End and front-end lead developers and bridge the gap between business process and technical components.

Quality of Product

Intermediate Deliverables

There should be some evidence of work.

Stage Specification
Project Management Project schedule
Schedule Metrics
Bug Metrics
Risk Management
Change Management
Project Overview Project Description
Motivation
Scope
Technologies
X-factor
Documentation Technical Documents
Design Documents
Test Documents
Meeting Minutes
Project Documents
Deployment
User Test 4

Objective : Compare the usability of the platform between first-time and old users.

The tasks assigned can be found here: A3XY User Test 4 Plan

Demographic

Users Students
Number of Users 12 (6 old users, 6 new users)
Venue SMU school campus


Brief information on the participants:
Group A (old users)

  • Have prior experience of using the platform
  • Have worked on the LC process
  • Have basic knowledge of Trade Finance from prior usage


Group B (new users)

  • Experienced with background in Consumer Internet Banking
  • Understand banking terms
  • Have not being exposed to the software being used (IBM BPM)



Results:

  • Time Spent in finishing the LC Application process (in mins)
A3xy UT4 result1.png











  • Time Spent in finishing the Document Presentation process (in mins)
A3xy UT4 result2.png











  • Average Time Spent in finishing the Shipping Guarantee, Trust Receipt and Banker’s guarantee processes (in mins)
A3xy UT4 result3.png











  • Did you understand the full process?
A3xy UT4 result4.png












  • Was the application easy to use?
A3xy UT4 result5.png












  • Results for quizzes for both the groups. (Average number of answers answered correctly)
A3xy UT4 result6.png











Key Findings:

  • Group A participants feel that the new interface is a big improvement from the previous version.
  • Group A participants feel that the new version provides a more comprehensive flow of the Trade Finance process and its components.
  • Group A participants have on average 25% better performance compared to their performance in a previous user test.
  • Group A participants have on average 15% better performance compared to the performance of Group B on average.
  • All participants found the glossary to be really useful for referencing to the definitions.
  • Group B participants do not face the issues that Group A faced in the previous user tests and on average have a 10% better performance for the same processes.
  • 12.5% of Group B participants felt that the constant movement between the portal and IBM BPM was confusing
  • All participants find individual components of the application easy to use.


User Test 5

Objective : Heuristic Evaluation of the built application.

The tasks assigned can be found here: A3XY User Test 5 Plan

Demographic

Users Students
Number of Users 8
Venue SOE CR 3.4


Brief information on the participants:

  • Have basic knowledge of Trade Finance from prior study


Goals:

  • Students should be able to navigate around the website easily
  • Students should understand the requirements for various input fields without additional help
  • Students should find the application visually appealing


Results:

  • Rating based on the student’s experience while navigating the website where 1 is hard and 5 is easy
A3xy UT5 result1.png










  • Rating based on clarity of requirements for input fields
A3xy UT5 result2.png










  • Rating based on visual appeal of the website
A3xy UT5 result3.png










Key Findings:

  • In general, participants find it easy to navigate around that website. However, some participants still take some time to understand the jump from trade portal to trade operations
  • Participants are able to understand the requirement for all input fields easily.
  • Participants find the trade portal visually appealing but there is still room for improvement.
  • Some participants feel a requirement for a feature that show a summary of their lc transactions.

Reflection

A3xy midref1.png
A3xy midref2.png


Client's View

" Using this new application, I will be able to more effectively teach Trade Finance to my MITB class. The hands-on use of the tool will help to drive home the main learning points of the course.The tool functions nearly like a “real” Trade Finance system a bank might use, and it implements industry standard message formats, eg; SWIFT and ISO. This is the first FYP project that I am aware of that implements a BPM engine, and it would be useful to demo the application in PMSB. Ngee Ann Poly will also use this application to support their Financial Informatics Diploma course. "
- Professor Alan, Chief Architect for SMU tBank