Presentation
MDD2 - A Framework for Effective Notetaking of Complex System and Device Interactions During Usability Testing
DescriptionNote taking is a fundamental part of usability testing, in which it allows human factors specialists to capture observed findings and it facilitates data analysis. Some devices and systems are more complex than others and thus, require a different approach during usability testing to ensure we sufficiently evaluate the system and capture robust data for subsequent analysis and reporting. I would like to propose a framework for effective notetaking of complex systems and device interactions. A complex device or system may require us as human factors specialists to change our notetaking approach. For example, an in-vitro diagnostic system involves additional components and multiple steps to complete tasks. In preparation for evaluating a complex system or device, the test team could reconsider how they group and categorize the use steps in their notetaking tool (or datasheet) to ensure all relevant tasks – particularly critical ones – are evaluated. As system and interaction complexity increases, it is important to consider if there are workflows that are evaluating the same tasks and condensing them in the notetaking tool to facilitate data analysis. During testing, some systems may pose spatial challenges for the test team, such as having difficulty viewing a small component or a display the participant is interacting with. As such, special setups and audio/visual equipment are needed to ensure the test team can capture the participant's actions. Test teams, typically consisting of a moderator and at least 1 data analyst, might also split tasks that could be difficult for one person to observe alone. Test teams can also leverage a complex system’s functionality to minimize participant fatigue during long test sessions (e.g., by scheduling breaks while the device processes large amounts of data). The framework will include case studies from usability tests of different complex systems and devices, as well as describe how different test teams adapted their notetaking to the system or device. The framework will also mention important considerations and suggestions on how to effectively approach notetaking before, during, and after usability testing.
Event Type
Poster Presentation
TimeTuesday, March 264:45pm - 6:15pm CDT
LocationSalon C
Digital Health
Simulation and Education
Hospital Environments
Medical and Drug Delivery Devices
Patient Safety Research and Initiatives