IS480 Team wiki: 2017T1 Edugators Internal Testing
UAT 1
Date: 15 August 2017 and 16 August 2017
Venue: Li Ka Shing Library Project Room 2-5
Time: 12-12.30pm, 3pm-3.30pm (GMT +8)
Number of Participant(s): 4 (2 participant tested for 2 roles)
Target Audience: Super Administrators, Curriculum designers & End users
Mode of Testing: Face to face
UAT 1 Test Plan
Objectives
- To determine the usability of the android app and CMS
- To gather feedback on other aspects of the CMS and android app such as based on the user interface
- To improve the web application as well as the android app based on feedback given
Scope of UAT 1
- Login/Logout (Android and CMS)
- Change/Reset Password (Android and CMS)
- Creating curriculums (CMS)
- Sort articles by category (CMS)
- Updating curriculums(CMS)
- View curriculums created (CMS)
- Adding content - images (CMS)
- Webscrapping for URL
- View User Profile (Android)
- View Curriculum and articles (Android)
Procedures
- Participants will be given a test plan document with detailed instructions on how to carry out the user testing.
- Participants will be required to write a P (for pass) or F (for fail) in the Pass/Fail column depending on whether the expected results were attained.
- - At the end or during the UAT the participants may write down their feedback in the space provided in the Pass/Fail column as well as provide it directly to any of the team members.
Key Findings
- Slow system response causes users to sometimes wonder whether system is working properly
- Users are unaware of certain functions if not given the proper context
- User interface can be more friendly and pleasing to eye
Overall Findings
- Generally no problems with the clarity of the interface, which looks clean and easy to read, with each page uncluttered and easy to navigate.
- The interface was user-friendly especially due to simplicity. However, some areas could be improved, specifically design palette in the centre as compared to being at the right hand side
- Having to copy and paste and just slightly tweak waste time..rather spend time updating content
UAT 2
Date: 3 October 2017
Venue: Ngee Ann Polytechnic
Time: 3pm - 4pm (GMT +8)
Number of Participant(s): 5
Target Audience: Super Administrators, Curriculum designers & End users
Mode of Testing: Face to face
UAT 2 Test Plan
Objectives
- To determine the usability of the android app and CMS
- To gather feedback on other aspects of the CMS and android app such as based on the user interface
- To improve the web application as well as the android app based on feedback given
Scope of UAT 2
- Creating curriculums (CMS)
- Sort articles by category (CMS)
- Updating documents (CMS)
- View curriculums created (CMS)
- Updating curriculums(CMS)
- View curriculums created (CMS)
- Bookmarking(Android)
- Analytics Dashboard (CMS)
- Course Management(CMS)
- User Management (CMS)
Procedures
- Participants will be given a test plan document with detailed instructions on how to carry out the user testing.
- Participants will be required to write a P (for pass) or F (for fail) in the Pass/Fail column depending on whether the expected results were attained.
- At the end or during the UAT the participants may write down their feedback in the space provided in the Pass/Fail column as well as provide it directly to any of the team members.
Key Findings
- User Management may need a import CSV, else it might be too tedious for admin manager to upload one by one
- User interface can be more friendly and pleasing to eye
Overall Findings
- Generally ideal UI, where it is extremely simple to use.
- The demarcation of different file types actually helps the curriculum designer in terms of
- Parsing of article links make it extremely convenient
- Good dashboard analytics, which provides certain insights to what users have been using
UAT 3
Date: 17 November 2017
Venue: Singapore Institute of Management & Singapore Management University
Time: 10 - 11am && 3pm - 4pm (GMT +8)
Number of Participant(s): 15
Target Audience: Super Administrators, Curriculum designers & End users
Mode of Testing: Face to face
Objectives
- To determine the usability of the android app and CMS for the quizzes portion
- To gather feedback on other aspects of the android app such as public users side
- To suggest improvements that could be made to the web application as well as the android app based on feedback given moving forward
Scope of UAT 3
-
UAT 3 Test plan
- Creating Quizzes (CMS)
- Publishing Quizzes(CMS)
- Viewing quizzes(CMS)
- Analytics dashboard for highest quiz scores(CMS)
- View curriculums created (CMS)
Procedures
- Participants will be given a test plan link with detailed instructions on how to carry out the user testing.
- Participants will be required fill up the link depending on whether the expected results were attained.
- At the end or during the UAT the participants may write down their feedback in the space provided in the Pass/Fail column as well as provide it directly to any of the team members.
Key Findings
- Typing Manually each QnA might be too labour intensive for the CMS app
- Transition between quizzes and curriculum page might take some time
- Analytics dashboard helps the curriculum designer in knowing who attempted the quiz
Overall Findings
- Would be better to embed the questions within the curriculum when reading to facilitate and reinforce learning on the go
- The demarcation of different file types actually helps the curriculum designer in terms of
- App is simple and clean to use
- Good dashboard analytics, which provides certain insights to what users have been using