Usability Study Tools

  1. DRAFT - usability test orientation and template

 

The assessment of how readily users can accomplish system tasks provides invaluable feedback on whether the system is meeting its objectives. Usability testing does not have to be extensive or complicated in order to be effective. Thoughtful choice of tasks and users can provide useful insight without undue burden.

Tasks should align with the most important objectives and problem solving needs of the system implementation, it does not have to be inclusive of every possible user interaction. Fruitful tasks can be tested with minimal training or instruction and allow for users to possiblly lose their way. It can be useful to include tasks that knowingly introduce error, such as missing or invalid information, or require the user to navigate across more than one system component.

Users ideally represent the perspective and experience with similar systems, but it is not always essential to find actual end users. For basic system tasks especially (or example, registering a patient) subject matter expertise can be waived. It can be helpful to be mindful of user bias, and test with users with a range of experience with the system or similar systems, including novice users.

The following is a suggested template for organizing tasks and data collection.

Draft in progress notes

  • Add suggestion to have user think out loud

 

Field

Definition and notes

Field

Definition and notes

Task

This is what you would like users to be able to accomplish in the system.

User instruction

The instruction lists details, such as specific test patient IDs, or specific data to add or modify. It may also include guilding steps, but these should be minimal to determine if the UX is intuitive enough without significant user support.

Outcome

Breifly, w hether the user was able to complete the task, and if so, how long it took. This could also capture how many steps, whether the user needed guidance, or other indicator of how easily the task was accomplished. If the user could not complete the task,

Sample outcome examples:

  • User could not start the task

  • Completed without assistance

  • Partially completed

  • etc.

Process notes

Detail misconceptions, missteps, or other alternatives to the intended path to complete the task, including where the user could go no further (at all or without guidance).

Conclusion

Final problem definition and/or recommendation to address issues.

 

Example

 

 

 

 

 

 

 

 

 

 

 

Test scenario

Examples: Patient registration, patient visit flow, prescribe and dipense, patient status & history, continued care

Roles

Examples: Clerk, nurse, doctor, specialist

Task

User instruction

Outcome

Process notes

Conclusion

Registration examples

Update patient contact information

Update the phone number of Test, Test IDA12345 to 555-555-555

 

 

 

Mark patient deceased

Record that NCD patient test, test has died of X

 

 

 

Register a new patient (provide information)

Add new patient (provide data)

 

 

 

Patient status and continued care examples

Determine if patient test, test is pregnant

 

 

 

 

Update the medication for patient test, test from X to Y

Change the medication for TB patient test, test from X to Y during a follow up visit

 

 

 

See the history of patient viral load

Determine how long the HIV viral load for patient test, test has been undetectable