Quick Access
Helpful Links
How to Join:
Find this page at om.rs/qanotes
Tuesdays at 8:30pm IST | 6pm Nairobi | 5pm Cape Town | 3pm UTC |10am Boston | 7am Seattle.
Quality Assurance Support Team Roadmap(Full Product Roadmap here) | ||
Done Recent Work Completed | Now What We're Working on Today | Next Next Priorities* |
Optimizing E2E Testing: Reducing Time and Resource Consumption Optimized the E2E testing process by using a pre-filled Docker container with a pre-built frontend instead of the dev server. This change reduced test execution time by over 75% and minimized resource consumption by more than 80%, resolving the persistent failures in GitHub Action builds. OPENMRS3 FELLOWSHIP OpenMRS 3.0 E2E Test Automation As development of OpenMRS 3.0 progressively evolves, so are the tests being developed using the Playwright integration. Ensuring the two processes are happening simultaneously. OPENMRS3 VOLUNTEERS Legacy selenium test rewrite to Cucumber Framework Legacy selenium tests are being translated to the cucumber framework for the purposes of maintainability and eliminating dependencies that arose when the tests were migrated to the QAFramework module. UW ITECH VOLUNTEERS Rest API Test Automation The Platform team used to manually test and track the REST API end points. The collaboration between the Platform team and QA support ensured that the tests are now tracked through the QA dashboard and automated missing REST API end points. PLATFORM TEAM UW ITECH OpenMRS QAFramework Module Migrated the utilities and pages from RefApp distro, and uitestframework module into the openmrs-contrib-qaframework and integrated github action to run at every single pull request. UW ITECH QA-KenyaEMR set up and support The QA support team has been working collaboratively with Palladium Kenya to set up a QA automation framework for the KenyaEMR. PALLADIUM KE. UW ITECH
Platform set-up wizard test Modifying existing tests to meet current requirements of the platform team UW ITECH Integration of Heroku This is to assist in testing changes in unmerged pull requests before being merged to the master. Opted to use github actions which replace heroku UW ITECH | Load Test Automation The objective is to identify performance bottlenecks and ensure that the software can handle high traffic without compromising functionality or speed. OPENMRS3 E2E Coverage for React Form Engine E2E coverage for the React Form Engine ensures comprehensive testing of form interactions, validations, and user workflows, guaranteeing a seamless user experience. This thorough testing approach helps identify and resolve potential issues across the entire form submission process. OPENMRS3 VOLUNTEERS | Security XSS vulnerability Testing Resurrection of sonarqube with the aim of helping the team to identify and resolve code vulnerabilities. VOLUNTEERS Documentation Revamp Developing and updating the QA documentation UW ITECH Expanding the QA portfolio Investigate and determine additional focus areas to be supported by the QA Support team under the QA testing pyramid. Proposed areas by the community: accessibility testing and performance testing QA SUPPORT TEAM IMPLEMENTER X |
Parking Lot: Topics for Subsequent Meetings
Meeting Notes
2023 October
2023-10-10
Attendees: Jayasanka Weerasinghe Ayush Mishra , Edison
2023-10-03
Attendees: Mutagubya Jonathan Ayush Mishra , Veronica, Edison
Mutagubya Jonathan
Almost done with the work on fixing on of the test for 2.x and will create the PR by next week.
Ayush Mishra
this pr got merged https://github.com/openmrs/openmrs-esm-patient-management/pull/805
Currently working on fixing the test for the esm-appointments-app.
Also found one of the bug that was there due to the missing scripts in package.json of the esm-appointments-app. Will create the issue soon
2023 September
2023-09-26
Attendees:
2023-09-19
Attendees: Anjula Samarasinghe Ayush Mishra Mutagubya Jonathan Dennis Kigen (Unlicensed) Randila Premarathne
Anjula Samarasinghe
Closed the webpack PR since it won't fixed the issue https://github.com/openmrs/openmrs-esm-core/pull/739
Randila Premarathne
mark will setup e2e tests for fast data entry
Dennis Kigen (Unlicensed)
Facing some issues with the fixing form builder failing issues
Ayush Mishra
patient chart
worked on visit form component tests in patient chart
vineet suggested more test cases
https://github.com/openmrs/openmrs-esm-patient-chart/pull/1355
looked into lint issues unused functions and variables are not getting detected
dennis worked on some eslint improvements for form builder and will push some updates
https://github.com/openmrs/openmrs-esm-patient-management/pull/812
2023-09-12
Attendees: Ayush Mishra Randila Premarathne Jayasanka Weerasinghe
Randila updated the Epic for E2E tests
TODO: Identify test cases for a repository
TODO: Work on setting up a repository (fast data entry app)
Ayush:
TODO: wrap patient chart tests
TODO: fix form hooks tests
TODO: Dilshan work on writing a new test
2023-09-05
Attendees:Piumal Rathnayake Jayasanka Weerasinghe Ayush Mishra Kakumirizi Daud Pahan,
There are some test failures in the platform tests on the contrib-qa-framework
TODO: Share it on the slack
Ayush Mishra Opened 2 more PRs:
https://github.com/openmrs/openmrs-esm-patient-management/pull/805
https://github.com/openmrs/openmrs-esm-patient-management/pull/804
TODO: Work on the lint issue
TODO: Work on the epic
Unit and integration coverage: https://docs.google.com/spreadsheets/d/1vOTcL7zNiDJmiqeYJh__5iFiLD9Dtr20pCgQcZf39b0/edit#gid=0
Facing an issue with medications e2e tests
TODO: Update the Epic
TODO: Setup e2e on other repositories
Dilan is working on the appointment e2e test
Ayush - Create a ticket for removing the .env file on management
Randila - Work on the e2e documentation
Piumal: TODO: Work on supporting arm64 on pre-filled docker
2023 August
2023-08-29
Attendees: Anjula Samarasinghe Piumal Rathnayake Randila Premarathne Ayush Mishra @EDISON
Randila Premarathne trying to merge the medication PR
Issue with the table, form submit buttons
Christopher Lumu was facing some issues with e2e tests
Jayasanka Weerasinghe and Ian Bacher Identified the bugs
Added more tests to cohort builder
2 more tests needs to be written
Drug order flow - Blocked by a backend issue
Added pre-filled docker image integration to the esm-core
Opened PR for updating O3-docs
Worked on the GSoC Report and the video
Worked on the status sheet (https://docs.google.com/spreadsheets/d/1vOTcL7zNiDJmiqeYJh__5iFiLD9Dtr20pCgQcZf39b0/edit?usp=sharing)
esm-core tests are not running
TODO: Create a ticket
@Edison is willing to work on the 2.X legacy test migration
2023-08-22
Attendees: Anjula Samarasinghe Piumal Rathnayake Randila Premarathne Ayush Mishra Jayasanka Weerasinghe Kakumirizi Daud
2.x
2.X Random test failures:
TODO: Kakumirizi Daud Piumal Rathnayake Find the issue
Legacy tests:
Piumal Rathnayake Created an epic: https://issues.openmrs.org/browse/RATEST-353
TODO: Piumal Rathnayake check whether the location test has been already written
KenyaEMR QA
Instantiated E2E tests. https://github.com/palladiumkenya/kenyaemr-esm-3.x
TODO: Next week: Anjula Samarasinghe Complete one tests case.
Cohort Builder
TODO: Next week: Anjula Samarasinghe Complete two test caseFailing form builder tests:
All of them are fixed now
Failing e2e tests due to webpack:
Login and logout PRs on core has been merged.
E2E coverage doc
Branch protection:
TODO: Jayasanka Weerasinghe update branch rules to make tests mandatory
E2E optimisation
esm core is remaining
Next Week: Piumal Rathnayake Esm core and documentation
TODO: Randila Premarathne create a ticket to setup
TODO: Next week: Randila Premarathne Improve the documentation
Ayush worked on writing unit tests for appointment and outpatient
TODO: Ayush Mishra prepare the coverage document
2023-08-15
Attendees: Anjula Samarasinghe Piumal Rathnayake Randila Premarathne Ayush Mishra Jayasanka Weerasinghe Njidda Salifu Ayush Mishra Mutagubya Jonathan
2.X E2E tests
There are some tests that needed to be translated to BDD.
TODO: Piumal Rathnayake create an epic, so that someone can work on it. Kakumirizi Daud help Piumal to create epics
KenyaEMR QA
Anjula Samarasinghe worked on writing on unit tests and it is completed! ?
Need to initiate E2E tests.
TODO:
To write e2e tests
Jayasanka Weerasinghe merge this: https://github.com/openmrs/openmrs-esm-cohortbuilder/pull/52
Patient chart has been updated. Most of the PRs from Randila was merged by Anjula Samarasinghe this week
TODO: Randila Premarathne confirm changes and update tests
TODO: Randila Premarathne Update remaining requested changes on PRs
PRs for the dynamic frontend is merged.
Bamboo job for the prefilled docker has been moved
TODO: Jayasanka Weerasinghe run the bamboo job
Ayush Mishra opened a set of PR to cover unit tests on the patient management
Status of coverage:
Randila Premarathne and Ayush Mishra come up with a detailed report
2023-08-07
Attendees: Anjula Samarasinghe Piumal Rathnayake Randila Premarathne Ayush Mishra Jayasanka Weerasinghe
Randila
Created a spreadsheet to track the coverage of Test coverage OpenMRS
TODO: Gherkin
Also naming tests
Anjula
Looked into the webpack issue
Created a PR to update the watch ignore: https://github.com/openmrs/openmrs-esm-core/pull/739
Had a discussion with valentine from kenyaEMR
Started writing some unit tests for kenyaEMR
Did the OMRS23 presentation
Created the search by demographics E2E test https://github.com/openmrs/openmrs-esm-cohortbuilder/pull/52
Ayush
Started working on writing test for the esm-patient-search-app
Fixed the Previous PRs.
TODO
Create an epic for esm-patient-search-app
complete tests for compact-patient-search.component.tsx
Try to complete the tests for esm-patient-search-app
Piumal:
Worked on several PRs
Still waiting until the prefill bamboo job is approved
TODO:
Move the bamboo job into D3X bamboo plan as a stage
Optimize the e2e workflows
2023-08-01
Attendees: Anjula Samarasinghe Randila Premarathne Njidda Salifu
3.x
Added login and logout test
Setup the e2e tests https://github.com/openmrs/openmrs-esm-core/pull/740
Checked the vitals and biometrics validation
TODO:
Check the openmrs test coverage
Do the requested changes
I research about some tools we can use for the load performance testing
I sent a PR the webpack in the core
Was preparing for the OMRS23 lighting talk
Delivered today OMRS23
Need double check the webpack
Had a call with valentine regading the kenyEMR testing
2023 July
2023-07-25
Attendees: Anjula Samarasinghe Piumal Rathnayake Randila Premarathne Ayush Mishra
3.x
Covered patient chart repo
Opened PR for: Medication & conditions
Needs to done changes for the opened PR's
Progress:
? Allergies (PR)
? Programs (PR)
? Vitals & Biometrics (PR)
? Conditions (PR)
? Medication (PR)
TODO:
Add the requested changes
Planning to move on to the core
Opened a draft PR for patient registration test failure
Added waiting function
Updated the mock object
https://github.com/openmrs/openmrs-esm-patient-management/pull/763
It takes some time to get the API call completed (submit button not getting load)
Worked creating a dynamic docker images for the frontend
https://github.com/openmrs/openmrs-esm-patient-management/pull/765
This will create a production build of the frontend which takes less resources
Ias has reviewed the pre-filled docker image pr
TODO:
Working on cohort builder
Opened a pr for search by demographic (https://github.com/openmrs/openmrs-esm-cohortbuilder/pull/52)
Configured the tests (https://github.com/openmrs/openmrs-esm-cohortbuilder/pull/51)
Still have the issue with submitting forms
Created more tickets for cohort builder
TODO: Will continue working the cohort builder e2e tests
Daud asked to improve the vitals and biometrics form
Unit & integration
Continued working on patient management tests
Working on the text person attribute component tests
One of the PRs got merged
Capstone
Ethohri still working on the bug
Anjula Samarasinghe needs to have a discussion regarding the project since the ethiohri server is still down
2023-07-18
Attendees: Anjula Samarasinghe Randila Premarathne Jayasanka Weerasinghe Piumal Rathnayake Panendhar
3.x
Created an epic for the Cohort builder e2e coverage
Playwright video tracing blocker: Dennis Kigen is working on it.
TODO: Anjula Samarasinghe check for an estimation
https://github.com/openmrs/openmrs-esm-form-builder/pull/148
Next week:
Setup playwright for the cohort builder
Complete
(observation/ concept feature )
Working on fixing patient registration.
TODO: Piumal Rathnayake create a fix
TODO: Piumal Rathnayake come up with an estimation
Pre-filled Docker container:
PR: https://github.com/openmrs/openmrs-distro-referenceapplication/pull/735
TODO: Piumal Rathnayake open a PR for the frontend fix
Next week:
complete the pre-filled docker image
Blocker: Forms are not loading in allergies forms.
Possible fixes would be:
Progress:
? Allergies (PR)
? Programs (PR)
? Vitals & Biometrics (PR)
? Conditions
? Medication
Next week:
= to cover the patients chart
Capstone:
facing a blocker with ETHIOHRI migration: https://talk.openmrs.org/t/my-openmrs-fellowship-journey-anjula-samarasinghe/38687/15?u=jayasanka
Sent a PR: https://github.com/CDC-HIS/openmrs-esm-ethiohri/pull/54
Mitigation:
Get started with cohort builder tests
2023-07-11
Attendees: Anjula Samarasinghe Randila Premarathne Ayush Mishra Jayasanka Weerasinghe Piumal Rathnayake
3.x
Previous week:
Allergies
Programs
Vitals & Biometrics
Having some trouble with timeout errors in the Allergy forms.
TODO: Try disabling the cache and
Having trouble with Dates on Programs
Have a debugging session with Anjula Samarasinghe
Next week
Allergies
Programs
Vitals & Biometrics
Conditions
Medication
= to cover the patients chart
Previous week
Created a sample bamboo image to generate a pre-filled docker image
Next week:
Complete the bamboo plan to publish the prefilled image
Previous week:
Worked on Add Test for 'display-photo.component.tsx' and 'edit-patient-details-button.component' https://github.com/openmrs/openmrs-esm-patient-management/pull/751
Blocker: Having some issues with writing a test for
Next week:
Complete patient-attribute-field and patient-attributes.resource.ts components
Previous week:
Sent a PR to EthiOHRI by adding jest config
Currently working on:
Vitals summary component
Blocker: Need a way to find return types of API
Next Week:
Work on vitals component
Get the docker image integrated with github actions
Complete 40% (~10 components) Unit and integration tests
2023-07-04
Attendees: Anjula Samarasinghe Mutagubya Jonathan Randila Premarathne Daniel Kayiwa Ayush Mishra
2.x e2e
There wasn't any updates
3.x
Work on the epic:
Working on the :
Working on the:
Work on Ethiohri e2e tests and unit and integration tests
Having issues with ethiohri docker backend
Had a call with the ethiohri team
Working on merging the first PR with Unit and integration tests
Sent PR for add program e2e tests and add notes e2e test
Having issues with loading the UI when running the tests
Work on current PRs requested changes
2023 June
2023-06-20
Attendees: Anjula Samarasinghe Piumal Rathnayake Randila Premarathne Ayush Mishra Mutagubya Jonathan , Edison
2.x E2E
There was an issue with the node version. Piumal updated it
3.x E2E
TODO: Fix allergy test, having some trouble locating the table.
Use table tags.
TODO:
Vital and biometrics
Medications
E2E test on form builder
Was failing due to web pack issue. The reason is the webpack server restarts whenever playwright creates a new file for the report
TODO: Dennis Kigen fix the issue
TODO: Malindu Nimalsiri
check with
Capstone project:
Had the initial call with Dagim
Granted access to relevant channels
Next steps:
TODO: Go through ETHIOHRI repos to identify what to prioritise
TODO: Deliverable: A document with the scope
Add this to the TODO list
Updated the O3 documentation:
Live link: https://o3-docs.vercel.app/docs/frontend-modules/testing#end-to-end-testing-with-playwright
TODO: Next Week: Finalise the capstone project plan
Deliverable: Finalised proposal
TODO: Next week: Go through this conversation and start working on it: https://openmrs.slack.com/archives/CP343JH1R/p1686401453440459
BDD Steps
Malindu
Dennis Kigen reformatted the code with OMRS naming conventions
Unit integration
Worked on patient registration tests
Fixed the failing test on patient demographic
Start working on patient identifier
Blocker: there are two context
TODO: Create a talk thread or slack chat on help me channel?
TODO: Complete the identifier input on registration
TODO:
Write one or two more test cases on patient registration
Running E2E on bamboo:
Worked on getting playwright container to generate the report.
Blocker: Bamboo agent do not have sufficient per
TODO: followup with Burke regarding ssh access
TODO: Next week: configure playwright container to use a non-root user. To get the tests run on bamboo.
2023-06-06
Attendees: Anjula Samarasinghe Piumal Rathnayake Mutagubya Jonathan Njidda Salifu Jayasanka Weerasinghe Randila Premarathne Daniel Kayiwa
2.x e2e
removed the duplicated ocl tests
need to check the reliability and performance
3.x
patient chart e2e test setup is almost done will work on the patient allergies workflow
form builder test coverage is almost done need to improve the form creation tests, and the interactive builder
fix the form deletion issues
added the form publication tests need to be reviewed
create tickets to add the test steps to the existing tests
add the test docs to the new o3 doc
bamboo new strategy - use playwright container instead of installing them
2023 May
2023-05-30
Attendees: Anjula Samarasinghe Piumal Rathnayake Randila Premarathne
2.x e2e:
Anjula:
2.x tests were only running on firefox
Updated the workflows to run with both chrome and Firefox
Platform test failed, Fixed it
Piumal:
Removed duplicate ocl module test
Removed cypress
Will continue work on automatic driver updates
3.x e2e:
Randila:
Setting up patient-chart for playwright tests
Still under review
Will work on allergies e2e tests
Anjula:
Completed the form builder edit form test
Received 2 pre from Hadijah and Dennis
TODO: Review
Jayasanka’s PR got merged
TODO: create tickets for other e2e tests
TODO: update e2e test wiki https://github.com/denniskigen/o3-docs
TODO: link wiki pages to the repos
2023 April
2023-04-25
Attendees: Anjula Samarasinghe Piumal Rathnayake Ayush Mishra Mutagubya Jonathan Njidda Salifu Jayasanka Weerasinghe Randila Premarathne
3.x tests
OCL tests are configured
OCL test case PR still under review
Reloading issue in the form builder it’s blocked for jessie, ayush
Two funders are requesting test coverage with BDD coverage specially on the e2e tests
came up with playwright feature in order to achieve this
we can define steps
cannot use cucumber out of the box need use cucumber js, need to sacrifice some playwright features
3.x manual tests
Looked into xray extension
can create tests as tickets and add steps
2.x tests
jonathan is still working on the issue
Unit & integration tests
aysush select input component test anjula reviewed the PR
created two more PRs
2023-04-18
Attendees: Anjula Samarasinghe Piumal Rathnayake JESSIE SSEBULIBA Ayush Mishra
2.x e2e test coverage:
Location Management e2e tests PR was merged - herman muhereza
3.x e2e test coverage:
Started configuring e2e for form builder and OCL module
Need merge access for the repos
Created epic for form builder e2e tests:
Created tickets for tasks and assigned
Jessie opened a pr for creating form with dummy data https://github.com/openmrs/openmrs-esm-form-builder/pull/87
Ayush is working on a ticket
Randila Premarathne working on patient-management offline tests
Facing some difficulties
TODO: Create a thread
Created epic for OCL Subscription module e2e tests
Opened PR for configuring e2e tests (https://github.com/openmrs/openmrs-esm-admin-tools/pull/18)
TODO: Identify the test cases
Unit & Integration tests:
Ayush Mishra opened 2 pull requests (https://github.com/openmrs/openmrs-esm-patient-management/pull/667, https://github.com/openmrs/openmrs-esm-patient-management/pull/672 )
TODO: Create tickets for the issues
O3 Test plan : Piumal Rathnayake
Created a sample test plan document
Checking the possibility of using Jira Xray
2023-04-11
Attendees: Jayasanka Weerasinghe Piumal Rathnayake Anjula Samarasinghe Dilan Gamage Ayush Mishra Daniel Kayiwa
3.x tests
Anjula update the Workflow doc: https://docs.google.com/document/d/1qD_zpYUG8C28zoAhrl7slI55lInyO7a-QR3tiwhrjwk/edit#
Service queues are not working in O3, but works in Kenya EMR
Follow up with the MF squad and find the reason
Some e2e workflows are blocked
Follow up with the team
Initiate e2e tests on Form Builder:
Todo: Anjula will identify the test cases, functionalities
Piumal Fixed the workflow error.
testOnPush job is passing
Docker container takes around 20 minutes to start
Todo: Come up on the O3 test plan - Piumal
Initiate e2e tests on OCL Subscription Module - Piumal
CI Integration
Jayasanka Working on CI Integration
Checked Demo data generations issue
Ayush had some difficulties in setting up the environment
Suggested to use the dev server to utilise the resources
Todo: Create a thread on other issues
2023 March
2023-03-28
Attendees: Piumal Rathnayake Anjula Samarasinghe Randila Premarathne Chiran govinna Jayasanka Weerasinghe Ayush Mishra
New Guides
Anjula Samarasinghe will create a new wiki page for the E2E guide which will contain what are the do's and don'ts
Piumal Rathnayake will work on the unit and integration test guide
Demo data
Do a feasible research on what are the trade offs of using the sample data.
Jayasanka Weerasinghe Optimize the feeding of demo data to docker volume
2.x:
Herman’s PR (Todo: Piumal review the PR)
Juliet’s PR
3.x E2E tests
Patient list test is almost done but the action is failing due to 8084 port being used by a system service
Chiran govinna is working on that (https://talk.openmrs.org/t/github-workflows-fail-to-run-modules-on-port-8084/39200)
Anjula Samarasinghe Tried to test lab results widget, but couldn’t find a way to regenerate data
2023-03-21
Attendees: Piumal Rathnayake Anjula Samarasinghe Randila Premarathne Daniel Kayiwa Chiran govinna Ayush Mishra
Mini Community Meeting
Jayasanka, Anjula, Piumal presented the QA Support Team updates on the mini community meeting
3.x E2E tests coverage on esm-patient-management repo
Anjula:
Disabled playwright cross browser testing
Had a discussion with Dennis
Donald has sent a PR for fixing the patient-appointments issue
Working on the active visits e2e test
Looking for the endpoints required for creating medications, active visits
Piumal:
Updated the patient-list e2e tests according to the recent changes
The blocker related to edit-list feature was fixed with https://github.com/openmrs/openmrs-esm-patient-management/pull/605
The blocker related to delete-list is not fixed yet. https://github.com/openmrs/openmrs-module-cohort/pull/26
Randila:
Removed retry option in tests
Updated the playwright video recording configuration
Unit & Integration tests:
Finalised the document and added a new Gsoc project on implementing the test strategy
Main requirements of the project are:
Rewriting the existing tests to work with MockServiceWorker
Improve the coverage by writing missing tests and improving the existing tests
2023-03-07
Attendees: Piumal Rathnayake Anjula Samarasinghe Juliet Wamalwa Sibendire Joshua , SSEBAANA Suubi Joshua Ivan Nsookwa
2.X Tests:
Platform tests are failing.
Piumal Rathnayake tried setting up locally, but the openmrs-core fails to run
Juliet Wamalwa is currently testing Reference Application 2.13.0-SNAPSHOT (Thread)
Some tests are failing (results doc)
Opened a pull request to switch the test server (https://github.com/openmrs/openmrs-contrib-qaframework/pull/478)
3.x E2E tests coverage on esm-patient-management repo
Anjula Samarasinghe completed active visits e2e test. Pr still under review: https://github.com/openmrs/openmrs-esm-patient-management/pull/581
Created a ticket for improving the patient edit/registration tests
Blocker with the appointment table. Donald Kibet is working on the issue.
Piumal Rathnayake Opened a draft pull request for Patient Lists E2E Test: https://github.com/openmrs/openmrs-esm-patient-management/pull/578
The issue with edit list feature is resolved
Manoj Rathnapriya is working on the delete list issue . PR can be merged after resolving it.
Anjula Samarasinghe is investigating on the Firefox test failures
Suggestion: Try updating the firefox driver
Unit & Integration tests:
Piumal Rathnayake created a document on the current status of unit and integration tests
Mini community meeting:
TODO: Anjula & Piumal follow up with christine
2023 February
2023-02-28
Attendees: Piumal Rathnayake Anjula Samarasinghe Jayasanka Weerasinghe Daniel Kayiwa Irene Nyakate, Madhawa Monarawila, Chiran govinna , Sarguroh Tasmia
Update on fixing 2.x flaky E2E tests
Chiran sent a PR to fix clinical visit test: https://github.com/openmrs/openmrs-contrib-qaframework/pull/476
Missing badges: Piumal Rathnayake check with Kakumirizi Daud
3.x E2E tests coverage on esm-patient-management repo
Anjula:
Still having the blocker with the appointment table. The bug ticket is assigned but no updates yet.
Anjula still working on 3.x Active visit test and will complete it this week
Breakdown the Active visit test to sub tickets (drug order, test results)
Piumal:
Working on the Patient Lists E2E Test
Still the blockers are not resolved (https://talk.openmrs.org/t/bugs-related-to-3-x-patient-lists/38688/9?u=piumal1999)
Edit & Delete options are not working
Will open a draft pull request for the "create patient list" test and the "add patient to list" test
Randila Premarathne : Sent a PR for the patient edit
https://github.com/openmrs/openmrs-esm-patient-management/pull/553
Fixed screen recording issue on firefox
Patient registration is done by Joshua Nsereko
Found a performance issue. Tracked here:
Unit & Integration tests:
Todo: Piumal Rathnayake come up with a document on the findings
2023-02-21
Attendees: Piumal Rathnayake Anjula Samarasinghe Daniel Kayiwa Irene Nyakate Madhawa Monarawila, Edison Meks, Sibendire Joshua, thembo jonathan , Chiran govinna , Sarguroh Tasmia
Update on fixing 2.x flaky E2E tests
Chiran is working on the Clinical visit test (
)
3.x E2E tests coverage on esm-patient-management repo
Anjula is working on the appointments e2e test
Blocker:
Scheduled appointments are not showing in the table
Created a ticket and it is already assigned to a contributor
Can complete this after the ticket is resolved
Anjula started working on 3.x Active visit test
No issues with manual workflow
Piumal started working on 3.x Patient lists test
Blocker:
Patient list page is not accessible due to an error in the backend
Root cause: Deleting a cohort type which was associated with a patient list.
Daniel will help to fix this error
2023-02-14
Attendees: Joshua Nsereko Piumal Rathnayake Anjula Samarasinghe Ian Bacher Grace Potma Jayasanka Weerasinghe Daniel Kayiwa Kakumirizi Daud Randila Premarathne Dilan Gamage herman muhereza Irene Nyakate
Update on fixing 2.x flaky E2E tests
There’s nothing wrong with the GitHub workflow and the server. The error is due to some incorrect assertions and the order of the steps. The tests passed only when the server is not fast enough to load the pages quickly.
https://talk.openmrs.org/t/fixing-random-failures-in-qa-framework-e2e-tests/38579
TODO: Piumal: Create tickets for remaining tests
TODO: Herman fix the location management test
E2E tests coverage on esm-patient-management repo
Updated doc: ​​https://docs.google.com/document/d/1qD_zpYUG8C28zoAhrl7slI55lInyO7a-QR3tiwhrjwk/edit#heading=h.i9zfve3hphd6
TODO: Anjula, Piumal: Get the repo covered
Improving O3 Unit and Integration tests
We need a solid guide for unit and integration tests.
Once we come up with a guide and if we feel current tests are not up to standards, we can convert it into a GSoC project
TODO: Jayasanka, Piumal start working on the above
Integrating E2E into the bamboo plan
There should be a separate stage for E2E tests
Within that, have a job per repo
We can use the Distribution 3.x E2E plan to do all the experiments
More info on 3.x builds: https://talk.openmrs.org/t/update-on-2-x-e2e-tests/38448/8?u=jayasanka
2023-02-07
Attendees: Kakumirizi Daud , Daniel Kayiwa, herman muhereza , Piumal Rathnayake , Anjula Samarasinghe , Joshua Nsereko , thembo jonathan, Irene Nyakate , Edison Meks, Sibendire Joshua, Madhawa Monarawila,
Platform 2.6.0 Testing
herman muhereza started testing, ran the tests locally
Two tests are failing
RefApp 2.x Tests:
Piumal Rathnayake worked on fixing the failing tests
3 Workflows are failing (All firefox tests, RefApp2VisitNotes, OCL Module)
Created ticket for fixing OCL module test (https://issues.openmrs.org/projects/RATEST/issues/RATEST-341)
TODO: Request access for manually triggering workflows
herman muhereza working on E2E location management (https://github.com/openmrs/openmrs-contrib-qaframework/pull/433)
Some pull request tests are failing
TODO: fix it and update the pull request
3.X E2E Workflows:
Anjula Samarasinghe worked on Patient management E2E tests: (Document)
Identified the workflows
Created issues for the identified workflows (Link to the Epic)
Assigned contributors to the tickets
GSoC Project Ideas:
2023 January
2023-01-24
Attendees: Jayasanka Weerasinghe , Daniel, herman muhereza , Piumal Rathnayake , Anjula Samarasinghe , Randila Premarathne , Dilan,
Platform 2.6.0 Alpha Testing
Herman ran set of tests using qa contrib framework. Link to the results
TODO: Finalize testing
Contrib QA framework
Piumal tried to setup but couldn't get run tests locally
TODO: herman muhereza help Piumal to set it up
3.x E2E
Base PR is merged
There's an issue with `testOnMergeJob`
TODO: Piumal fix
Workflows for patient management needs to be finalised: Link to the doc
TODO: Jayasanka Create issues for existing workflows
TODO: Anjula finalise workflows
2023-01-17
Attendees: Dilina, Josh, Jayasanka Weerasinghe , Daniel Kayiwa , Gajindu Bandara , Piumal Rathnayake , herman muhereza , thembo jonathan , Madhawa
Platform 2.6.0 Alpha Testing
Jayasanka Weerasinghe will investigate the bamboo CI build failure.
Herman Muhereza will try to run the contrib-qa-framework pointing to the deployment.
Base E2E PR Merging
Need to add environment variables to the repo.
Jayasanka Weerasinghe will write to the help desk for assistance.
Expanding 3.x Test Coverage
New volunteers are encouraged to set up the environment by following the provided readme file.
Jayasanka Weerasinghe is working on drafting a document for possible E2E workflows and will convert them into issues for implementation.
2022 December
2022-12-06
Attendees: Juliet, Joshua, Irene, Randila, Daniel, Jayasanka
Created a POC for having repository specific tests
Worked on making offline tests pass
Blocker
The registration test is failing and couldn't debug
solution: use `–headed` argument to run tests in headed mode
Next steps:
Jayasanka Weerasinghe Finalise the PR and get it merged
Come up with a migration plan
Joshua Nsereko Fix offline tests and integrate to the build
Fix user settings test
2022 November
2022-11-29
Attendees: Daniel, Jayasanka, Joshua, Piumal, Daud
Working on removing cucumber
Blocker: tests are not running as expected
Solution:
We can have only one `it` block per test
Distribution 3.x E2E is passing!
Created a GH actions to run E2E tests on PRs: Link
Good news: It works!
Bad news: takes ~38 mins to run the whole test suit
More info on this talk post
Ian Bacher 's response on slack: Link
Is there a way to reduce the spin up time?
Using a DB dump would significantly reduce the time needed to startup
Evaluated playwright
Wrote some existing tests using playwright on patient-management repo
Key takeaways:
We can do almost everything we do now with it,
It appears to be far superior to cypress.
Having e2e tests on repository itself would improve the developer experience
Next week:
Joshua Nsereko : Make sure offline tests are up to date and integrate them with the pipeline
2022-11-22
Attendees: Joshua, Daniel, Irene, Jayasanka
Joshua:
Worked on removing cucumber
Jayasanka
Fixed existing tests https://github.com/openmrs/openmrs-test-3refapp/pull/33
2022-11-15
Attendees: Grace, Jayasanka, Irene
Jayasanka:
https://talk.openmrs.org/t/evaluation-of-our-current-qa-pipeline/37931
2022-11-08
Attendees: Joshua, Daniel, Grace, Jayasanka, Christine
Jayasanka:
Went through current QA implementations
Issues with current E2E setup
Developer engagement is low
It's not providing immediate feedback for developers
Do not get enough developer attention
Reasons might be:
Tests are not running against PRs
The current process is not a part of the development workflow
E2E tests are maintained by QA team, not O3 developers
One possible solution would be:
Come up with a repository specific E2E test
Tests runs on PR so that developers can fix issues / update tests within the PR itself
Run tests on deployments
Come up with good documentation of E2E expectation and best practices
Goal:
To make E2E tests a part of development workflow
Improve developer engagement
Immediate feedbacks
Level up the confidence
This week:
Try to come up with a POC
2022 October
2022-10-25
Attendees: Joshua,Kdaud, Jonathan thembo and abert namaya
Technical updates:
Joshua:
Working on the following issues: https://ci.openmrs.org/browse/REFAPP-D3E
All tests in the above link are running in bamboo.
Next week: look into o3 smoke tests such as patient registration, login, offline tools, form in works spaces. They will run in github actions.
In o3 the following tests are failing: Patient registrations and clinical visits.
Things to note:
Aim to have stable tests
2022 September
2022-09-20
Attendees: Joshua, Jayasanka, Juliet, Pasindu, Herman
General updates
Had a review on Joshuwa's PR
2022-09-06
Attendees: Joshua, Christine and Jayasanka
Regrets: Irene & Juliet
Recording:
Agenda:
General updates
Joshua was working on the clinical visit which is correcting the banner issue.
Link to clinical visit https://github.com/openmrs/openmrs-test-3refapp/pull/9
QA Github actions is also failing in addition to the Bamboo which has issues with core.
OpenMRS 3.0: There are 11 workflows currently present.
Jayasanka is currently reviewing 3 tickets that need to be merged.
Pasindu is working on the closing report for the GSOC project.
2022 August
2022-08-30
Attendees: Joshua, Christine, Juliet, irene , Daniel, herman and tendayi
Regrets:
Recording:
Agenda:
General updates
QA in OpenMRS 3.0
The docker 03 was resolved and is now working.
Ideas for engaging devs is to have a notification system in Slack so that developers are aware when something breaks.
Developers prefer to use the Dev3 server to carry out tests as it is easier to run a docker on the server.
Links to reference:
thread for reducing failures in docker https://talk.openmrs.org/t/how-to-reduce-openmrs-3-x-docker-failures/37390
workflow to use to automate the process https://talk.openmrs.org/t/what-workflow-should-be-employed-to-spot-out-breaking-commits-in-esm-repos/37419
patient chart not working https://talk.openmrs.org/t/what-workflow-should-be-employed-to-spot-out-breaking-commits-in-esm-repos/37419
Daniel: Looking into the QA CI failure.
Irene: Ticket Merge: https://github.com/openmrs/openmrs-contrib-qaframework/pull/441
2022-08-23
Attendees: Joshua, Christine, Daud, Tendayi and Juliet
Regrets:
Recording:
Agenda:
General updates
Docker o3 issue was resolved but is still failing in the CI pipeline.
Joshua will follow up with Rafal so as to resolve this issue.
GSOC will be ending in mid September.
QA CI Pipeline is still failing. Daud and Sharif are still looking into the issue.
Herman: Working on the location management issue .
2022-08-16
Attendees: Daud, Sharif, Joshua, Pasindu, Daniel, Christine, Herman, Ruth.
Regrets: Irene
Recording:
Agenda:
Technical updates:
Sharif/Daud:
Looking QA CI Pipeline is currently failing. https://ci.openmrs.org/browse/CONTRIB-QA-1646/log
The CI is failing to build but tests are passing in Github actions.
There are also other tests that are taking long to build. Roughly the tests take 1hr 20mins.
Proposals include:
Breaking down the tests to shorter tests.
Automatically running only the required tests as opposed to all the tests that are in place.
Joshua
Still has an issue with Docker instance.: https://talk.openmrs.org/t/the-patient-chart-component-is-loading-forever-in-local-docker-instance/37186/
Advised to reach out to Dennis for assistance
Pasindu:
Working on the manual testing document:
Also has an issue with the docker instance.
2022-08-09
Attendees: Irene, Daud, Sharif, Joshua, Jayasanka, Pasindu, Gajindu, Daniel, Herman
Regrets:
Recording:
Agenda:
Technical updates:
Gajindu, a new member brought on board by Jayasanka to do manual testing for 3.x
There's a failing test, but it has been marked as fixed on JIRA.
TODO: Kakumirizi Daud followup with Ian and Brandon, to understand how/when changes are being deployed on dev3 server
Irene Nyakate- Worked on https://github.com/openmrs/openmrs-contrib-qaframework/pull/427
and PR was merged hereMade another PR for the appointment workflow https://github.com/openmrs/openmrs-contrib-qaframework/pull/441
Herman: Has an on-going pull request on Location Management workflow.
Pasindu:
Worked on updating the cypress version we are using for 3.x e2e automated testing. pr - https://github.com/openmrs/openmrs-test-3refapp/pull/10
Working on extending test scenarios for the 3.x testing.
Make a pr to test logout function in o3. pr - https://github.com/openmrs/openmrs-test-3refapp/pull/11
RefApp BDD testing:
More one ticket for Refapp 2.x BDD, still on the board, members encouraged to pick and work on it to clear our board
UAT:
More tickets are still on the board, members encouraged to pick and work on them so the kanban can be clean
OpenMRS 3 testing:
Joshua Nsereko is following up on The Patient chart component is loading forever in local (docker) instance. by reaching raff
A.O.B: Praying for peace to prevail in Kenya even after elections
2022 July
2022-07-12
Attendees: Christine, Irene, Sharif, Jonathan,, Pasindu, Jayasanka, Juliet, kdaud, Grace potma, Herman
Regrets:
Recording:
Agenda:
2022 June
2022-06-28
Attendees: Christine, Irene, Sharif, Jonathan,, Pasindu, Jayasanka, Juliet, kdaud, Grace potma, Herma
Regrets:
Recording:
Agenda:
OpenMRS 3 testing:
There seems to be multiple testing initiatives such from ICAP and Rwanda
Grace checking to with Todd on the testing
Pasindu creating a CI pipeline with a QA dashboard.
Also migrating to the 3.0 test to the new repository: https://github.com/openmrs/openmrs-test-3refapp
2022-06-21
Attendees: Christine, Irene, Sharif, Jonathan,, Pasindu, Juliet, kdaud, Grace potma, Jen Antilla
Regrets:
Recording:
Agenda:
O3 testing
O3 Pipeline visual (yeah, it's chaotic, but I'm trying to fix that)
https://talk.openmrs.org/t/adjustment-to-3-x-frontend-process-test-environment/36496
2022-06-14
Attendees: Christine, Irene, Sharif, Jonathan,, Pasindu, Juliet, Daniel, herman, Grace
Regrets:
Recording:
Agenda:
Technical updates and challenges:
Irene:
Tickets worked on:
Issues created from the UAT on the login and clinical workflows
Advise on the ticket: QFU-2: Visit Note
Create a ticket for viewing a visit note.
Combine the functionality save a visti note as a PDF and Print PDF to one test such as downloading visit note.
Facing challenge: https://pastebin.com/pX7GMTyE
Joshua:
Facing a challenge with the docker image:
OpenMRS 3 testing
OpenMRS 3.x Requirements Rubric (QA Spreadsheet) https://docs.google.com/spreadsheets/d/1jsK-Zo8vJfFs3d2yp_CAxV1bHujYKsmslBDWnorZYDM/edit#gid=0
Interested team members to take part in testing: Irene, Jonathan and herman
2022 May
2022-05-24
Attendees: Christine, Irene, Sharif, Jonathan, Herman, Pasindu, Juliet, Daniel, Abert
Regrets:
Recording:
Agenda:
Happy FHIR patient domain update
https://github.com/openmrs/openmrs-module-fhir2/pull/402
This will run on every instance of a pull request on docker.
Integration test will check on ensuring the system does on break on every pull request.
FHIR integration runs successfully in OpenMRS with an actual patient data.
Patient Domain: OpenMRS is integrated with FHIR and at its core.
Adjustment to 3.x Frontend Process - “Test” Environment
https://talk.openmrs.org/t/adjustment-to-3-x-frontend-process-test-environment/36496
2022-05-17
Attendees: Kdaud, Christine, Irene, Sharif, Jonathan, Herman,
Regrets:
Recording:
Agenda:
2022-05-17
Attendees: Kdaud, Christine, Irene, Sharif, Jonathan, Herman,
Regrets:
Recording:
Agenda:
2022-05-10
Attendees: Kdaud, Christine, Irene, Sharif, Jonathan, Herman,
Regrets:
Recording:
Agenda:
QA presentation: Juliet and Irene to share a final draft of the presentation on Thursday.
Technical updates:
Joshua Nsereko:
OpenMRS 3 Servers:
https://dev3.openmrs.org/openmrs/spa/login
https://openmrs-spa.org/openmrs/spa/login
https://talk.openmrs.org/t/adjustment-to-3-x-frontend-process-test-environment/36496
2022 April
2022-04-26
Attendees: Kdaud, Juliet, Christine, Joshua, Jonathan,
Regrets:
Recording:
Agenda: Call cancelled due to no quorum
2022-04-12
Attendees: Kdaud, Juliet, Christine, Joshua, Jonathan,
Regrets:
Recording:
Agenda:
April 2022 meeting presentation:
Juliet working on the video presentation.
Achievements to include: Platform tests, Selenium-cucumber migration and UAT for automated tests.
2022-04-05
Attendees: Kdaud, Juliet, Abert Namanya, Christine, Jennifer, irene, daniel , sharif
Regrets:
Recording:
Agenda:
User acceptance testing
Sprint Board: https://issues.openmrs.org/secure/RapidBoard.jspa?rapidView=251&view=detail&selectedIssue=QFU-1
Instructions:
Pick a card you did not work on or automate.
Review the reference application and write up the steps of the specified workflow as indicated on the card. Use doc or spreadsheet.
Cross-check the steps you provided with the BBD steps written on the automation test and provide your findings.
Once done move the card from in-progress to a verification column in which the QA support team will review and verify your findings.
If the team is in agreement, the card will be moved to done.
Performance testing tools:
Christine to look into additional tools for comparison and help in decision making.
Technical :
Sharif
Working on API test for FHIR2
Juliet:
My updates: - Had a sync with sharif on this ticket https://issues.openmrs.org/browse/RATEST-323 which was closed because all scenarios are worked on. - Tried out https://issues.openmrs.org/browse/QFU-5
Daud
working on
2022 March
2022-03-29
Attendees: Kdaud, Juliet, Abert Namanya, Christine, Jennifer, Jonathan, Daniel , Irene
Regrets: Grace Potma
Recording:
Agenda:
User acceptance testing
Sprint Board: https://issues.openmrs.org/secure/RapidBoard.jspa?rapidView=251&view=detail&selectedIssue=QFU-1
Verification meetings: 5th & 12th April 2022
Performance testing tools:
JMeter: https://jmeter.apache.org/
Advantages:
Can load different types of applications including databases.
Java based can be intergrated into the QA code base.
Opensource
Disadvantage
High learning curve.
Other tools information:
Technical updates
Sharif
Working on failing issues on the CI.
Daud
Ressurected the OCL test and as well added one more platform test known as Platform Testing Intallation. These tests are now being reflected on the dashboard
Juliet:
Working on the patient management.
Currently stuck on the browser drivers.
Jonathan:
Working on the visit note
faced with failures with Qa server hence have resorted to SDK and will soon to raise up the PR course.
Irene:
2022-03-22
Attendees: Daniel, Jenifer, Potma, Daud, Sharif, Juliet, Sharif, Jonathan, Irene
Regrets: Christine
Recording:
Agenda:
Quick updates:
Call timing to be retained as follows: 8:30pm IST | 6pm Nairobi | 5pm Cape Town | 3pm UTC | 11am Boston | 8am Seattle
April Community meeting will take place on 20th
Presentations and demos are welcome.
User Acceptance testing of the automated tests
The Sprint will kick off on Thursday 24/03/2022
Grace Potma to come up with a talk post concerning with performance testing for RefApp 3.x
Finding out an appropriate tool that can be used to carry out performance testing on a system: Responsiveness and workload
Technical updates
Irene Nyakate:
Encounter management test PR https://github.com/openmrs/openmrs-contrib-qaframework/pull/381 has one approval waiting for more to get merged
Still looking into Appointment workflow test that is failing in CI
Juliet:
Working on
Jonathan:
Working on
Sharif:
Working on
2022-03-15
Attendees: Christine G, Grace P, Christine , Pasindu, Kumuditha, Sumedha, Juliet, Irene Nyakate
Regrets:
Recording:
Agenda:
Quick updates:
Call timing to be retained as follows: 8:30pm IST | 6pm Nairobi | 5pm Cape Town | 3pm UTC | 11am Boston | 8am Seattle
April Community meeting will take place on 20th
Presentations and demos are welcome.
User Acceptance testing of the automated tests
Create a sprint planning
Develop the criteria
Create a spreadsheet.
Perform an internal review by conducting a UAT.
Requirements: Volunteers, access to the BBD steps and tracking spreadsheet.
Technical updates
Irene Nyakate
Looking into Appointment workflow test whose PR had been merged but caused a build failure so it was reverted and I am currently looking into it
https://github.com/openmrs/openmrs-contrib-qaframework/pull/323
Encounter management workflow - Made a PR https://github.com/openmrs/openmrs-contrib-qaframework/pull/381 , was unstable but I fixed it and it is now passing, I am attending to a few reviews and awaits merging.
2022-03-08
Attendees: Daniel, Daud, sharif ,Juliet Wamalwa , Abert Namaya, Christine Gichuki
Regrets:
Recording:
Agenda:
Quick updates:
Call timing. DST change on 13 March 2022
QA support call will move 9:30pm IST | 7pm Nairobi | 6 pm Cape Town | 4pm UTC | 11am Boston | 8am Seattle
April Community meeting.
Presentations and demos are welcome.
Technical updates
Jonathan:
Working on
Juliet:
Working on
Sharif:
Working on
2022-03-01
Attendees: Christine, Irene, Sharif, Anjula, Kumiditha, Daud, Herman, Joshua, Piumal, Pasindu, Juliet, Jonathan
Regrets:
Recording:
Agenda:
Dockerisation
Technical updates
Technical updates
Gracebish:
Has not progressed much. Trying to find out how to install and configure mysql and tomcat on ubuntu 20.04. This has blocked her from successfully setting up sdk.
Getting support from Irene and Sharif will share documentation on linux setup
Noah:
Have a PR https://github.com/openmrs/openmrs-contrib-qaframework/pull/380. Requesting for review.
Irene Nyakate
Appointment management workflow test- PR has one approval and waiting for merging - https://github.com/openmrs/openmrs-contrib-qaframework/pull/323
Encounter management workflow - Made a PR https://github.com/openmrs/openmrs-contrib-qaframework/pull/381 , test still unstable on CI, but I am looking into it.
Daud:
Added platform UI tests and now running on every push done openmrs-core, distro-referenceapplication and qaframework
Herman:
working on
andPR for the first ticket is at https://github.com/openmrs/openmrs-contrib-qaframework/pull/364 with build failures that is being figured out
2022 February
2022-02-22
Attendees: Christine Gichuki, Sharif, Jennifer Antilla, Deb , kdaud, Kumuditha Karunarathna, Sumedha Karunarathna, Irene Nyakate, Daniel, Juliet
Regrets: herman, jonathan
Recording:
Agenda:
Quick updates:
QA blog is live :https://openmrs.org/what-we-do/blog/
Appointment management workflow:
Technical updates
Irene Nyakate
Appointment management workflow successfully passing in CI following a commit made today- https://github.com/openmrs/openmrs-contrib-qaframework/pull/323
Also Working on -
Dockerisation.
A request has been made to the team working on the 3.x dockerization to share a demo and recommendations when converting tests to run in docker.
Kumuditha Karunarathna, Sumedha Karunarathna
Ian have added the missing data in the docker MYSQL database and the team is working on migrating the remaining tests to run in a dockerized environment.
2022-02-15
Attendees: Christine Gichuki, Kdaud, Jennifer Antilla, Grace potma, Irene Nyakate, Daniel, Piumal Rathnayake, Pasindu Rupasinghe, Kumuditha Karunarathna, Anjula Samarasinghe, GraceBish, Joshua Nsereko, noah
Regrets: Sharif, Juliet and Herman
Recording:
Agenda:
Quick updates:
Review and share your feedback on the QA blog post.
Patient Record workflow by Irene Nyakate - https://www.youtube.com/watch?v=WRBQQ5WntXo
Technical updates
Irene Nyakate
- Still working on the Appointment management workflow -
Test runs well but still changing some element selectors
Demo provided but will be played next week due to time constraints
Daud added platform installation and set up wizard tests. See
Currently working on platform tests running immediately on every openmrs-core commit.
Piumal Rathnayake, Pasindu Rupasinghe, Kumuditha Karunarathna, Anjula Samarasinghe
Working on migrating RefApp 3.x E2E tests to run in a dockerized environment.
Currently facing an issue with some missing meta data in the docker image and Ian is working on adding those data.(https://talk.openmrs.org/t/creating-a-pre-initialized-mysql-docker-database/34285/7?u=piumal1999)
2022-02-08
Attendees: Christine Gichuki, Jennifer Antilla, Abert Namaya, Kumuditha Karunarathna, Anjula Samarasinghe, Sumedha Karunarathna, Pasindu Rupasinghe , Juliet , Irene, Daniel, Sharif, Jonathan, Herman,Daud
Regrets:
Recording:
Agenda:
Quick updates:
Additional tests are available on the QA board: https://issues.openmrs.org/secure/RapidBoard.jspa?rapidView=240
Note taking:
The note-taking will be a joint effort where each member present will log their presence, updates and any discussions brought up.
To access the notes page click on this link:OpenMRS Quality Assurance Support Team
Login to the wiki and click on the edit button.
Navigate to today's notes section and proceed to indicate your notes.
Once done click on the update button.
Technical updates
Irene Nyakate
Pull request https://github.com/openmrs/openmrs-contrib-qaframework/pull/333 for has been merged
Still working on https://github.com/openmrs/openmrs-contrib-qaframework/pull/323.
whose PR resides hereThe test passes locally but fails on GitHub, it is highly unstable.
Looking into using other element selectors as opposed to xpath and css selectors.
Will do a demo for the two tickets next week.
Sumedha Karunarathna
User setting tests fails due to some bugs
The logout button doesn’t appear in the UI sometimes (random occurrences), which causes the test to fail.
After clicking the logout button it doesn’t redirect back to the login page(random occurrences)
Juliet Wamalwa
Failing to get suitable selectors for some buttons on this PR https://github.com/openmrs/openmrs-contrib-qaframework/pull/280.
Will have a sync with daudi on the way forward.
Anjula Samarasinghe, Kumuditha Karunarathna, Pasindu Rupasinghe, Piumal Rathnayake
Working on running RefApp 3.x E2E tests in a dockerized environment
Currently facing an issue with some missing meta data in the docker image https://talk.openmrs.org/t/creating-a-pre-initialized-mysql-docker-database/34285/4?u=anjisvj
Herman
currently working on
which is catering for joining up on the legacy selenium tests about visits.the pull request is at https://github.com/openmrs/openmrs-contrib-qaframework/pull/348/ .
also shared a challenge with the openMRS SDK which daniel will be lookung into
2022-02-01
Attendees: Sharif, Irene Nyakate, Kdaud, Juliet, Pasindu, Gracebish, Lilian Mathu,herman, jennifer
Regrets:
Recording:
FHIR IG
Documentation to review :
The FHIR squad is currently looking into how to set the FHIR IG testing approach
Important links:
2022 January
2022-01-25
Attendees: Sharif, Irene Nyakate, Jonathan, Kdaud, Tendo Martyn, Juliet, Sumedha karunarathna,
Regrets:
Recording:
Updates:
Juliet:
PR:https://github.com/openmrs/openmrs-contrib-qaframework/pull/280
Working on the subscription module facing challenges with the private and protected URL in the automation code.
Needed clarity on when to use public static and private URLs.
Useful links:
Irene:
Working on appointment management workflows and is currently working on the reviews
Challenges: The tests are unstable especially where the xpath is being used. trying to find a better selector for locating the elements.
Visit feature management in which she has already combined 8 out of the 9 tests.
PR: https://github.com/openmrs/openmrs-contrib-qaframework/pull/323
Sharif:
Working on implementing the tests to run on Docker instead of being dependent on the browser.
Herman:
Worked on the tests below which have been merged.
https://github.com/openmrs/openmrs-contrib-qaframework/pull/329
https://github.com/openmrs/openmrs-contrib-qaframework/pull/320
https://github.com/openmrs/openmrs-contrib-qaframework/pull/316
3.X test:
Kumuditha is working on dockerised test on patient search and will be sending in a pull request. This is proof of concept which lead to all the other test being dockerised.
GraceBish: working on the ticket 302
FHIR IG
Proposals on engaging and understanding with the work:
Review available documentation.
Attend the FHIR squad calls
2022-01-11
Attendees: Grace Potma, Grace Nakiguli, Jonathan
Regrets:
Recording:
Migrated the E2E test to O3 server
Reverted the changes
Irene:
Pull request needs review: https://github.com/openmrs/openmrs-contrib-qaframework/pull/298
2021
2021-11-09
Attendees:
Regrets:
Recording:
Call timing:
QA call to be taking place 6pm EAT /8:30pm IST/7:00am Seattle
Palladium Implementation QA Implementation support
There will be weekly meetings every Thursday at 3pm EAT/5:30pm IST/4am Seattle.
Would like a proof of concept by end on this quater.
Heroku application:
Con: only allows manual deployment.
Discussion on the tool is on going here: https://talk.openmrs.org/t/suitable-tool-for-auto-deployment-of-application-on-github/34974/15
Technical updates
3.X updates:
Platform Updates:
Kdaud added for tests now 2 two are pending
Irene is working on feedback from her pull request.
Ivan is having challenges on the Mark patient as deceased.
Juliet
https://talk.openmrs.org/t/automated-tests-for-the-ocl-module/34657/22
Sharif:
working on migration scripts
There is ongoing work with integration with the sonar cube.
2021-10-19
Attendees: Sarah Elder, Christine, Juliet, Jonathan, Kumuditha, Jayasanka, Piumal, Kdaud, Irene, Tayebwa Noah, Jen, Pasindu, Daniel, Herman, Sharif.
Regrets: Grace
Recording:
QA OHRI boot camp session.
Session Content
Learning Activity | Topics | Duration | Resources |
Webinar Presentation | Overview of Quality Assurance at OpenMRS | 1 hour | |
Reading | Quality Assurance Automation Framework:Basics | 1 hour | |
Reading and Videos | Quality Assurance Automation: Reference application 3.x (Cypress-Cucumber Integration) | 2 hours |
Need:
Technical support to help with answering technical questions on October 26 at 7:30pm IST | 5pm Nairobi | 4pm Cape Town | 2pm UTC | 10am Boston | 7am Seattle.
Technical updates.
3.X updates:
Link to the slide deck:
2021-10-12
Attendees: Anjula, Christine, Herman22, Piumal, Jayasanka, Kumuditha, Jonathan,Irene Nyakate, Sharif, Pasindu, Daniel, grace potma, Noah, Piumal, Sarah elder, kdaud, Tendo
Regrets: Jennifer
Recording:
Test runs per PR commit
Currently the tests are not running in all the PRs.
The tests are running on the QA Ref app server and would need to be configured to run on snapshot modules.
https://github.com/openmrs/openmrs-module-registrationapp/pull/36
To do: Look into having tests running on every PR especially for the Ref app 2.x and 3.x.
Technical Updates
No major issues.
2021-10-05
Attendees: Anjula Shanaka, Irene, Jonathan, Kumuditha, Tendo, Juliet wamalwa, Jayasanka, Piumal Rathnayake, Pasindu, Jen Antilla, Heshan, Noah Ndacyayisenga, Herman 22, sarah Elder
Regrets:
Recording:
Quick updates
OpenHIE is currently on-going: 5-8 October 2021.
OHRI boot camp QA session: October 18th to 21st.
Platform testing
There are key features, like referrals, that will push the platform release.
The QA support team is working on pending API tickets. So far 6 have been completed.
Useful link: https://docs.google.com/spreadsheets/d/1vrVYIjVZqxzS2FHmD63KGV2wqvpJN-x-k77atS6TtIM/edit#gid=0
Technical updates
QA framework on bamboo is failing hence the failure chrome tests.
3.X test plan: https://docs.google.com/spreadsheets/d/1qTN15YLmOn9QxLNM-uxahtU-b06KbZ1s1aSUGGwKkSw/edit#gid=1115838130
Sharif
Contining work on migrating the QA pages and refactoring the QA pages to a module.
The chrome driver has been upgraded which requires 94.4 chrome browser.
Useful link: https://chromedriver.storage.googleapis.com/index.html?path=94.0.4606.41/
Joshua:
Had a meeting with Sarah to get an understanding on sonar cube.
There is a talk thread about the findings: https://talk.openmrs.org/t/sonar-integration-for-code-quality-and-security/34789
Recommendation shared: reviewing sonar cloud.
Herman:
Working on the Issue 224
2021-09-28
Attendees: Juliet Wamalwa, Gracebish, Jayasanka, anjula, Jonathan, sharif, Noah, Irene, Pasindu, Tendo, Daniel,Joshua Nsereko,
Regrets:
Recording:
Quick updates
OpenHIE happening next week: 5-8 October 2021.
OHRI boot camp QA session: October 18th to 21st.
Platform testing
Useful resource:
Talk post on the analysis: https://talk.openmrs.org/t/test-coverage-for-our-rest-api/34671/23
Current tool in use is REST-ASSURED
Has dependencies that would need to be installed.
Technical updates
Irene: working on:
https://issues.openmrs.org/browse/RATEST-223
Has an issue which she is working with sharif to resolve
https://issues.openmrs.org/browse/RATEST-204
This is dependant on 223.
Juliet:
Working on the RATEST 234 and RATEST 236
Noah:
working on deleting allergies and conditions.
Jonathan:
https://github.com/openmrs/openmrs-distro-referenceapplication/pull/569
Test is failing on eclipse but runs on the command line.
Sharif:
Migrating the QA pages and refactoring the QA pages to a module.
Facing challenges with dependencies.
Kdaud
Working on the RESTAPI.
Useful Link: https://docs.google.com/spreadsheets/d/1vrVYIjVZqxzS2FHmD63KGV2wqvpJN-x-k77atS6TtIM/edit#gid=0
Joshua
Looking into the use of Sonar Cube.
2021-09-21
Attendees: Juliet, Jonathan, Jen, Christine,kdaud, Sarah elder,Noah,Sharif , Daniel.
Regrets: Grace P
Recording: https://iu.mediaspace.kaltura.com/media/t/1_mya6oa6q
Platform Testing
Possible tools:
Swagger
Karate
Jmeter
Postman
Things to consider when evaluating the tools:
Sustainability
Conformance to standards and guidelines.
Reusability of existing resources
Technical updates
Security testing update:
Joshua working on a video on how to automate for XXS dependencies.
Pull request: https://github.com/openmrs/openmrs-contrib-qaframework/pull/132
Proposed used OWAS- Zapp for the versatility of code but there are many pages.
Initial idea was to write a single script that tests multiple pages. However this may use the same effort as conducting manual testing.
In order to eliminate already tested fields, it seems you will have to write an automated test that covers all the XXS vulnerability.
Resources:
Irene:
RATEST 223: Working on this since last week and is currently working on fixing the ticket.
Juliet:
Learning cucumber and Selenium
Working on: https://github.com/openmrs/openmrs-contrib-qaframework/pull/132
Jonathan:
working on
Sharif:
Working on the running reports test.
The challenge is that reports are only accessible on legacy UI. DId a talk post available here: https://talk.openmrs.org/t/migrating-pages-and-tests-from-refapp-distro-utills-from-uitest-into-qaframework-module/34703/10
Tests will be migrated into one module. This will be worked on in the next few weeks.
Talk post available here: https://talk.openmrs.org/t/migrating-pages-and-tests-from-refapp-distro-utills-from-uitest-into-qaframework-module/34703/10
Kdaud:
Added two test: User account and location management.
Noah:
working on the clinical work flow improvement to include adding and deleting allergies and conditions on the patient dashboard.
2021-09-14
Attendees: Juliet, Jonathan, GraceBish, Sharif, Tendo, Irene, kdaud, Grace Potma, Jen, Herman,Irene, Tendo, Daniel,Christine
Regrets:
Recording: https://iu.mediaspace.kaltura.com/media/t/1_ioezph2c
Technical updates
Juliet: Had to postpone APK concept dictionary management. Currently trying to fix some of the workflow in OCL.
Jonathan: Learning on cucumber and Selenium. Requesting for intro tickets.
Irene: Still working on the following tickets:
Vital and triage extension ticket: RATEST-204
Update editVitals functionalities on editNotePage: RATEST-223
There is an existing page with the functionality: https://github.com/openmrs/openmrs-distro-referenceapplication/blob/master/ui-tests/src/test/java/org/openmrs/reference/page/PatientCaptureVitalsPage.java
Advised to add the edit element on the same page other than adding another page.
Sharif:
Working on a ticket that broke the CI but has provided a solution.
Kdaud:
Working on the user account ticket.
Looking into failing tickets that had been recently resurrected.
Looking Into 3.X tests that were failing.
Looking into improving platform tests.
Gracebish: claimed the ticket: https://issues.openmrs.org/secure/RapidBoard.jspa?rapidView=240&view=detail&selectedIssue=RA-1896,
Herman: working on ticket RATEST 220
Implementing the QA framework in other Java modules(OCL)
Focus has mainly dictionary manager.
Need to focus OCL module.
Platform testing
There are tests that need to be done for Alpha and Beta release.
List of endpoints that need to be tested: https://docs.google.com/spreadsheets/d/1vrVYIjVZqxzS2FHmD63KGV2wqvpJN-x-k77atS6TtIM/edit#gid=0
Proposal:
Identify the endpoints that will be most affected by the 2.5 release.
Example REST WS Test coverage: https://github.com/openmrs/openmrs-module-webservices.rest/tree/master/omod-1.8/src/test/java/org/openmrs/module/webservices/rest/web/v1_0/controller/openmrs1_8
Next steps:
Tendo to bring up the issue of automation with Platform team.
Cross-check existing automated tests and identify gaps.
Review the technical LOE needed for automation.
2021-09-07
Attendees: Jayasanka, Jonathan, Sharif, Gracebish, Kdaud, Christine, GraceP, Jen Antilla, Pasindu, Ivan , Joshua, Tayabwe, Sarah , Irene.
Regrets: Juliet
Recording: https://iu.mediaspace.kaltura.com/media/t/1_7nlbcxig
Quick Updates:
Virtual 3.0 Bootcamp commenced today.
For more information, check out the following: https://talk.openmrs.org/t/towards-a-virtual-openmrs-3-0-developer-bootcamp-hackathon/34569
QA Board Higlights:
Added tickets include:
RATEST-226: New Test: Patient Dashboard Editing Patient Demographics.
RATEST-225: New Test: Patient Dashboard adding/deleting Allergies and conditions
RATEST-224: E2E Test: Running reports.
Technical Updates:
3.0 Framework:
Had two failing tests.
Given tests are failing in github actions from time to time , the team should try to run the tests on Bamboo.
Daud to create a ticket and assign Jayasanka and guide him on setting on Bamboo.
2.0 framework:
Sharif:
Working on the
Registration and patient search workflow test.
Registration is complete and merged.
Vitals and triage for the 3.0 framework
Coveralls support.
Challenge was activating Coveralls using Github.
Ivan:
Working on finding the pager head ticket.
Irene:
Working on the
Vital and triage extension ticket: RATEST-204
Update editVitals functionalities on editNotePage: RATEST-223
Tayebwa:
Encountering challenges in setting up the development environment.
.
2021-08-31
Attendees: Christine, Jayasanka, Jen Antilla, Joshua, Grace potma, sharif, pasindu Rupansinghe, Daniel, Kdaud
Regrets:
Recording: https://iu.mediaspace.kaltura.com/media/t/1_wcvytwwb
Quick Updates:
Updated QA Onboarding page: OpenMRS Quality Assurance Support Team
Report any issues or share recommendations:
Annual OpenMRS conference : 24th Nov - 2 Dec 2021
Abstract Deadline: Friday, September 17, 2021.
Blockers when using Cypress on the 3.0 Framework
Set up depends on the internet where the set has to be pointed to the SPA server and loading of Cypress resources.
2 Main Problems:
#1 (worst): It is difficult to run test locally. So, difficult to develop tests, because:
takes a lot of time. E.g. 2-3 mins to load a single page.
takes a lot of resources. E.g. 30MBs for a single scenario, and devs often using a data plan for internet access, or have a bandwidth limit.
When the tests are run, Cypress downloads its resources every time (Cypress clearing browser cache with each scenario, and sometimes single test ("feature") has multiple scenarios). This results in it taking a long time. (2-3 year issue in Cypress communities! No option to keep the cache.)
This is not a problem with 2.x - if we had an isolated environment, would solve this problem. Tried hack downloading all resources and then creating an import map.
#2: Random failures. Sometimes when running on GitHub Actions, the test fails randomly because resources are not getting loaded correctly. (Going to keep video recording if test fails. Thanks Pasindu!)
TODO: Action item: Jayasanka to create a Talk thread. If no clear path to unblock, can also share with SPA and MF slack communities (so many JS devs there who surely have wrangled similar issues w/ Cypress).
Technical Updates:
Herman: Using a Windows platform. Seems QA the framework does not work well in windows.
Jonathan: Still on-boarding and acquitting with the QA framework.
Joshua: aiming at looking into security tickets,
Ivan: working on issues arising on the submitted ticket. Ticket working on is patient deceased.
Pasindu: Working on resolving 3.0 framework tests failing due to Github actions. Solution being implemented is screen recording which can be reviewed later
Juliet: Working with Cypress and cucumber on a test focused on adding concepts. Aiming to completely tomorrow and make a presentation on the OCL call.
Gracebish: Worked on a duplicate ticket.
Sharif:
Kdaud: Will start working on the coveralls ticket.
2021-08-24
Attendees: Christine, Sarah Elder, Jayasanka, kdaud, Sharif, Jonathan, GraceBish, Gracepotma, Pasindu
Regrets: Jennifer.
Recording: https://iu.mediaspace.kaltura.com/media/t/1_0lxg0dym
Quick Updates:
Updated QA Onboarding page: OpenMRS Quality Assurance Support Team
Report any issues or share recommendations:
Technical Updates
OpenMRS Security:
Need volunteers as GSOC students are finalising their work.
Members currently supporting the security include Jonathan, PATH and Sarah.
Sarah is a security expert who carried out research on OpenMRS Security. Methods used to identify SonarQube but did not find cross-side scripting. Other methods used included
Static analysis tools like SonarQube, coverity Scan(propriety software.)
Dynamic testing: Provided the list we currently have in spreadsheet.
Manual testing through exploratory testing.
There is a journal that has been submitted which Sarah will share with Grace and Sharif.
To do: Review duplicate tickets.
Review of the QA status dashboard:
2021-08-17
Attendees: Christine, Jayasanka, Sharif,Daniel,Irene,Juliet,Kdaud, Jonathan, Muwanga Erastus, Ivan , Joshua ,GraceP
Regrets: Jennifer
Recording:
Technical Updates
Summary
Test coverage is now 95% form 88%.(Old Selenium tests)
Currently only 3 tests are pending.
Review of the QA status dashboard:
Keypoints:
The registration and search workflow is still work-in progress.
Challenges include selenium dependencies.
Recommendation shared is to run the test on bamboo in the event it is passing on a local instance to identify the challenges.
Sharif and Kdaud to have a look at the dependencies.
Reff APP 3.X: There are challenges with the github actions.
Upgrade QA Dashboard to provide a detailed description of the displayed status,
Dictionary Manager: Writing tests on adding concepts.
Current blocker: Rest API fetching concepts.
xss vulnerability training video (Sharif Magembe)
There is a complied list of XSS vulnerability issues done by GSOC students.
Anyone interested to work on this can reach out to Sharif Magembe
Ownership of gaps identified in pyramid review.
The identified Gaps are to be added to Jira for easy tracking: https://issues.openmrs.org/secure/RapidBoard.jspa?rapidView=240
2021-08-10
Attendees: Jayasanka, Grace P, Grace N, Jen, Ivan N, Jonathan Kaweesi, Jan, Sharif, Daniel, Ian, Irene, Jan, Pasindu Rupasinghe
Regrets: Christine
Recording: https://iu.mediaspace.kaltura.com/media/t/1_bj25on6m
Notes & Recordings now at om.rs/qanotes
Technical updates from devs
General Framework update: Writing workflow test cases 1 (by @kdaud)
Hooks: A hook is a built tag in run test class, Login workflow can either have its own defined hook , workflows always have given step definitions , then a hook is used to trigger those step definitions but mostly hooks are defined in before or after ,methods
Tags: A tag is a way of identifying tests & add metadata to the scenario, e.g.
3.x:
Dockerizing issues due to connectivity, Webservices module not running, github workflow challenges. Trying to complete workflows as much as possible.
User Settings workflow completed
Challenging to test on local b/c not loading sometimes even on local server
Problems: SPA envi is sometimes unstable - workflows fail because SPA doesn't get loaded. "Go offline" notification covers things up and blocks tests. Random errors where some things aren't loading.
2.x:
Remaining Legacy Tests: https://ci.openmrs.org/browse/REFAPP-UI-435/test
Ticket unblocking - Ivan https://talk.openmrs.org/t/patient-appointment-request-issue/34295
Finish the OpenMRS QA Pyramid & Automation Inventory (a review of what we have, vs where we have automation gaps to address, beyond frontend E2E tests)
Linting: ways to embed in auto git-hub
XSS gap: For xss security automations, we still need some effort from devs , the only challenge we have is that some devs are still not familiar with reproducing xss vulnerabilities. Some xss vulnerabilities which would be simple to automate have been covered which is is limiting number of getting started guides ,Preparing a simple automated xss vulnerability vedio for us to get started probably next week we should be having it on the call
→ Next week: xss vulnerability training video (Sharif Magembe)