SMART Guideline Implementation: ANC DAK

SMART Guideline Implementation: ANC DAK

Summary of the Problem

  • WHO expert groups want to get best-practice guidelines out into the real world, fast, and update those guidelines as medical knowledge changes. This currently takes years.

  • 2 Central Hypotheses:

    • 1) The OpenMRS 3 framework allows content like that in the ANC DAK to be quickly created into a new sample "ANC package"; and, 

    • 2) Understanding In-Country Content Decision Makers' needs and workflows is mission-critical for successful DAK & O3 package adoption even beyond ANC.  

  • OpenMRS, AMPATH, Mekom, and PIH are being supported by Digital Square's Notice F Award to coordinate design of a DAK-Based OpenMRS 3.x ANC Package that:

    • meets ANC DAK core dictionary, functional, and non-functional requirements

    • has the decision support component of the ANC DAK

    • has program indicators

    • Design: Design related deliverables include published results from user research/assessment and designs for whatever we prioritise.

Links to Know

  • Key Contacts: @suruchi dhungana (Product Manager) & Paul Adams (UX Designer)

  • Communication: Slack channel #anc (most discussion and updates are happening in slack)

  •  Issue Tracker: Jira Board here (all issues with label "ANCDAK")

  • Designs: Pending

  • Timeline: June 2022-June 2023

The ANC DAK contains the content needed to execute WHO-recommended ANC care guidelines, such as: workflows, medical codes, decision support rules, metrics, and functional requirements. 

Our 3-Prong Approach

Open Questions

 

  • How do we expect the ANC DAK content to be used in the real world? 

  • How does content decision making happen in countries: In Ministries? In Implementations? (i.e. how people decide what content/care pathways should be applied at their sites)

2023 Roadmap 

 

Jan-Feb

Mar-Apr

Apr-May

Jun-July

Aug

Identify & Prep Users for Interviews: ANC Staff/Care providers

Target countries to engage for user interviews: Sierra Leone, Zimbabwe, Ethiopia...)

Status: DONE 

PIH Mekom AMPATH OHRI

Start Interviews: ANC Staff

Status: IN PROGRESS 

SONDER FELLOW

Data Optimization Pt 1: Need engine to optimize data extraction to just the 1 patient of interest

Status: IN PROGRESS 

OMRS FELLOW

 

Data Optimization Pt 2: Need engine to optimize data extraction to just the 1 careplan / relevant data of interest

Status: IN PROGRESS 

OMRS FELLOW

 

Blocker: Careplan Output Bug: Patients who don't qualify are being assigned risk flags by engine

Status: IN PROGRESS 

OMRS FELLOW

Milestone:

COMMUNITY DEMO OF PROTOTYPE 

1st week March

Trigger Logic Definition

Status: IN PROGRESS 

OMRS Mekom/Sonder

 

UX Results: Publish results from UX assessments of ANC Staff and Content Decision Makers

Status: IN PROGRESS 

SONDER FELLOW

Publish Designs for ANC UX

Status: Not Started 

SONDER 

 

Usability testing

Status: Not started 

SONDER 

____

Status: X 

WHO Does it? 

END

 

Detail  ANC UX Design Activities timeline

  • Research synthesis and OOUX work will be completed by March 10th

  • Between March 6th and 24th, hoping to be working on mock-ups

  • By March 31st, we’ll have research summary document, and a design prototype to test

  • Probably have a bit of down time over Easter weekend then which is 6-12 of April

  • But before and after that test the prototype with users remotely

  • Usability testing will be happening at the latest, the week of April 17th

  • Iterate and apply learnings to the prototype / mock-ups to have something to be finished with in early May

 

Detail  ANC UX Design Activities timeline

  • Research synthesis and OOUX work will be completed by March 10th

  • Between March 6th and 24th, hoping to be working on mock-ups

  • By March 31st, we’ll have research summary document, and a design prototype to test

  • Probably have a bit of down time over Easter weekend then which is 6-12 of April

  • But before and after that test the prototype with users remotely

  • Usability testing will be happening at the latest, the week of April 17th

  • Iterate and apply learnings to the prototype / mock-ups to have something to be finished with in early May

 

2022 Roadmap Archive

August

Sept

Oct

Nov

Dec

2023...

FHIR IG Deep Dive w/ Bryn Rhodes & FHIR Squad 

Explored existing L3 resources and whether automating intake of a FHIR IG might be valuable approach. (Notes) Outcome: Decided not to have a FHIR IG-heavy approach. 

Status: DONE 

Joined WHO SMART Implementers' call group

Raise awareness among the WHO working group of our work on this project, and address early questions about materials available and what user research had already been done. (Notes)

Status: DONE 

Gap Analysis of Functional & Non-Functional Requirements 

Gap Analysis here

Status: DONE



Identify & Prep Users for Interviews: ANC Staff/Care providers

Target countries to engage for user interviews: Sierra Leone, Zimbabwe, Ethiopia...)

Status: In Progress 

PIH Mekom AMPATH OHRI

Identify & Prep Users for Interviews: Content Decision Makers

Status: In Progress 

PIH Mekom AMPATH OHRI

Sample Code Set in OCL + Qnr in O3

Need to pick a Qnr. Start by picking a preferred DS rule/care plan. OCL Code Set

Status: DONE 

FELLOW

Review of Key Functional Gaps with Team 

Gap Analysis here

Status: DONE

FELLOW

1st set of Feedback

Initial feedback to share with WHO DAK team. (Doc here)

Status: DONE

FELLOW

Start Interviews: Content Decision Makers

Status: Not Started 

SONDER FELLOW

Test Automation plan

Likely less about FE E2E tests rather than scaleably useful ones, eg (1) OCL-related tests / concept conflict notifications +/- logs, and (2) O3 test framework/test pipeline improvements.

Status: Not Started 

 FELLOWS

Present 1st set of Feedback

Initial feedback shared with WHO DAK team. (Doc here)

Status: Not Started 

FELLOW

UX Results: Publish results from UX assessments of ANC Staff and Content Decision Makers

Status: Not Started 

SONDER FELLOW

Prototype Pkg

O3 ANC MVP Package released (scope: limited concepts, forms, widgets, & clinical view)

Status: Not Started 

TBD 

Start Interviews: ANC Staff

Status: Not Started 

SONDER FELLOW

 

Publish Designs for ANC UX

Status: Not Started 

SONDER 

Publish Designs for Content Management Flows

Status: Scope? 

SONDER 

UAT & Findings Documentation

Status: Not Started 

SONDER 

Plan for Reports

Add to ANC O3 Package

Status: Not Started 

TBD 

Decision Support Plan

eg leverage opensource Decision Support Engine (depending on business viability indicators of that asset by Jan 2023; will also need confirmation / work to cover any gaps in OMRS FHIR representation of the medical record)

Status: Not Started 

TBD 

Reports

Add Indicator Reports to ANC O3 Package

Status: Not Started 

TBD 

Data Viz

Demo indicators visualized w/ Superset

Status: Not Started 

TBD MEKOM?

 

 


User Contact Champions

These contact points are the ones our UX+PM team can reach out to in order to organize user research/interviews etc with ideal users. 

Sierra Leone: PIH (Maternal Centre of Excellence) - @Ellen Ball 

TBD - Haiti or Cambodia: (Hospital/NGO with ++deliveries) - @Dimitri R 

Ethiopia: Jen to f/u w/ UCSF/ICAP contacts

 


Actions & Decisions Log

Date

Action or Decision or Request for Information

Notes (Links, Comments, etc)

Date

Action or Decision or Request for Information

Notes (Links, Comments, etc)

2022.07.27

2 key findings so far: (1) content not meeting minimum expectations (PIH) eg clear fetal outcome; (2) FHIR IG confusing w/ ++ broken links. Considering focusing on creating tools that would ingest L3 (FHIR IG) content automatically into OMRS. 

UX Proposal submitted by Sonder here, proposing OOUX approach to research.

Reviewed types of Decision Support content: different information types & urgency types. Id'd gaps in existing UI Patterns in O3 to support ANC CarePlan outputs - these red gaps will be a focii for UX research, so output will be a complete toolkit.

Meeting: ANC DAK Product Vision & Roadmap Whiteboarding - All

Whiteboard: https://metroretro.io/board/LBUYIYVOLJML 

Recording

2022.08.18

After a ++helpful deep dive w/ Bryn Rhodes on the ANC FHIR IG: Decided we will not pursue a FHIR IG-based approach at this time. 2 main findings:

Decision Support Engine: Learned that Bryn’s team has created an opensource Decision Support Engine, now maintaining this, Google Android SDK group is their user at the moment. We could leverage this engine for our Decision Support needs (and OMRS could then bypass need for bespoke data model update for careplan support, b/c you don't actually need careplan support to make use of the engine). 

Gap in Content Decision Maker Persona/Research: Seems that ANC DAK has missed a key persona: country-level content decision makers. Eg the massive lift for them to consider all this content and reconcile it with their regional requirements, funder requirements, and current data collected. Decision: this will be a critical user for us to involve in user research.

FHIR IG review with Bryn Rhodes - All

Explored existing L3 resources and whether automating intake of a FHIR IG might be valuable approach. (Notes

2022.08.19

Identified 9 names who informed the ANC DAK who could be starters for interviews re. "real world use" of guideline content, developing understanding of market demand/market pain points. Need follow up plan for Sept. 

 List here - 9 of 70 listed as informants for ANC DAK are from implementer groups

2022.08.29

Knowledge base amidst WHO SMART working group on content management processes at Ministry or Implementer is unclear - still a grey-area. We should proceed with plan to understand this as it has huge implications for ANC Guidelines + any other future SMART guidelines. 

Joined WHO SMART Implementers' call group - Suruchi, Grace

Raise awareness among the WHO working group of our work on this project, and address early questions about materials available and what user research had already been done. (Notes)

2022.09.29

Ellen & Wamz pick 1-2 ANC care plans from DAK as our first ones to prototype in O3 with codes, forms, and widgets (Ideal: both valuable for end users to see in testing, and relatively low effort)

Current top candidates: Danger signs (1), Pre-eclampsia and HTN (17), HIV testing (8)

Need: would be helpful for our ANC grant group to do a small prototype to see the lift required to implement one of these ANC DAK Qnrs + Codes. Could also be a helpful asset for Suruchi & Paul Adams during user interviews. https://openmrs.slack.com/archives/C03GWFC9ZKQ/p1662577762775669

TODO

Contacted WHO - Nat to confirm no updated spreadsheet w/ more CIEL code mappings

Currently ~40 needed medical codes have mappings to CIEL in "ANC.End"; all others have no reference to CIEL in the spreadsheet resource (Web annex A: Core data dictionary). @Andrew Kanter has a version with CIEL maps (not 100% complete)

TODO

Assign champion per country to i.d. people to interview/test

 

TODO

Review together the OHRI MCH Mindmap (to understand OHRI MCH goals & needs)

 

2022.09.13

  • Request to Ellen & Dimitri: Gather list of contacts now

  • Jen to f/u re contracting

 

2022.09.23

Grace met in person w/ Jembi, Regenstrief, and CDC-HQ officers in S. Africa - discussed SMART Guidelines ++. Much interest in and alignment with our 3-prong strategy (staff research, content research, engine prototype). Intellisoft Botswana interested in supporting w/ Content Decision Makers for user research → followed up.

There is growing interest by PEPFAR in wanting to fund HIV SMART L2 implementation - all very interested in this OMRS grant's work. All folks talked with agreed big need to understand in-country content reconciliation workflows, concern that alert UI to end users needs to not overwhelm esp. when ANC+HIV+NCD etc get combined, and all are +++ interested in technical findings re using the CQL engine. 

2022.09.23

Suruchi has begun work to implement the O3 Qnrs and Codes in OCL for the Preeclampsia Care Plan.

 

2022.09.27

Shared update on 3-fold plan (staff research, content decision maker research, and CQL engine prototype plan) with the Implementing Smart Guidelines working group with multiple WHO and DPG representatives present.

Learned: Ona seems to be implementing now as well. Google Android SDK increasingly leveraging too. A member Kashya has possibly found a way to bypass needing to "save" a FHIR Qnr - notes and screenshots here.

2022.09.27

Emailed Jose & Bryn about contact for support re. trialing the CQL engine.

 

2022.09.27

Design Roadmap discussion - Jen Grace Ciaran Paul.

 

2022.09.28

Team meeting. Picked a Decision Support set for prototyping: High risk & educational: Pre-ecclampsia

Could re-use some parts from the PLIR project that were sending data from OMRS to other server (packaging to send fhir resource from OMRS to a different FHIR server); also triggered a measure written in CQL on that FHIR server. 

Followed up on support from Mozzy re recent OMRS cmty work on something involving CQL: Later versions of the Hapi FHIR JPA Server (5.3.0 +) come with an embedded CQL engine . https://talk.openmrs.org/t/anc-dak-setting-up-a-prototype-with-the-cql-decision-support-engine/37630/4

 

2022.09.30

Intro interview w/ Dr. Astrid

2022.10.07

Discussion w/ Derek Ritz 

 

2022.10.11

 

2022.10.12

Digital Square Check-in

 

2022.10.14

Interview w/ Dr Astrid

2022.10.26

ANC DAK SMART call

2022.11.08

ANC Squad call with WHO Reps

  • How are adaptations documented internally in an organization? WHO Team working on way to capture adaptations → Would help in reflection. WHO supporting some country implementations with adapting guidelines nationally. eg some countries have strong PMTCT-based guidelines. Two-way learning. 

  • Unclear how indicators are being changed at the country level. "Want to learn how people are using the resources we put out" → any draft report = of interest. 

  • Tool for helping policy makers adapt the ANC guidelines so they can update their policies.

2022.11._

Meeting with Alex Goel (company & CDS builder tools using Encender)

 

2022.11.10

Meeting with Google Health - FHIR SDK team

Recording

2022.11.__

Debrief w/ Derrick Ritz

 

2022.11.10