Presentation
MDD14 - Human-Centered Design for Engineering in the Environmental Exposure Domain: Case Study of a User Interface for Electrochemical Detection of Mn in Drinking Water
DescriptionSummary
The proposed work reports on the application of a human-centered design approach for the development of an interface (app) for electrochemical detection of Manganese (Mn) in drinking water at the point-of-use (POU). Engineering devices for point-of-use (POU) applications in the field of environmental exposure, still lack a systematic human-centered design approach throughout their development cycle. Objective is to outline with a practical case study a framework to bridge the gap between the technical requirements (engineering) and the user requirements (human factors).
Heavy metals contamination poses a significant threat to public health. Heavy metals are introduced in the environment both from geogenic and anthropogenic sources and they are not degradable (Tchounwou, Yedjou, Patlolla, & Sutton, 2012). Drinking water is one of the major sources of heavy metal exposure for the general population (EPA,2018). Moreover, heavy metals are recognized as systemic toxicants, with the potential of affecting multiple organ systems. In particular, Mn is an essential element required for physiological functions, but harmful when present in excess. Recent evidence (Lucchini et al., 2017) suggests that Mn exposure from drinking water at levels once considered safe might cause cognitive and motor impairments in adults and children. The presented case study addresses the growing need for more widespread and accessible monitoring of Mn in drinking water. It focuses on the development of an app (GUI) to be combined with the analytical system and guide non-trained or minimally trained users to the procedure for the electrochemical detection of Mn. Details about the engineering aspects of the analytical procedure can be found in previous publication (Boselli et al., 2021).
Our framework offers a human-centered approach alternative to the techno-centered approach. Key features are the active engagement of a multi-disciplinary research and development team as well as potential end users throughout the development cycle of the app. The R&D team includes engineers, human factors experts, environmental and occupational health exposure clinicians, user experience designers and lab technicians. Integration of iterative feedback from non-trained end users and the diversity of backgrounds and experiences already encompassed within the R&D team allow for analysis of the system from different perspectives throughout the stages of the development process. We envision that implementation of a human-centered approach throughout the development cycle of the app for electrochemical detection of Mn in drinking water will allow its effective usability for POU applications by non-trained users. Development of a ready-to-use platform will encourage more frequent monitoring of Mn in drinking water. Moreover, this approach can be extended to development of electrochemical systems for other heavy metals detection in environmental and biological matrices.
Methods
The overall framework consisted in an iterative design, prototyping and testing, and evaluation process with continuous engagement of relevant stakeholders (R&D team members and end users). The engineering team proposed a low-fidelity prototype of the user interface and outlined the essential requirements (Boselli et al., 2021). Heuristic evaluation (heuristic evaluation #1) was then conducted by the human factors and public health experts under the guidance of both cognitive performance indicators (Wiggins & Cox, 2010) and Nielsen’s 10 usability heuristics (Nielsen & Molich, 1990). Two lab technicians as representative end users were involved at this early stage of the interface design. They were presented with static screenshots of the prototype interface over a Zoom interview. System usability scale (SUS) and a complementary survey (REDCap) were used as metrics for their feedback assessment. Outcomes from this first iteration of R&D team discussions, heuristic evaluation and usability study guided substantial changes in the interface design and helped broaden the perspectives of the engineering team. Key changes included the following ones: 1) improvement in guiding elements, 2) removal of non-essential and user distracting features, 3) increase in visibility of system status, and 4) better usage of color coding. Team members then re-evaluated the updated interface (heuristic evaluation #2). Findings were discussed and prioritized by 3 team members over virtual design sessions. Software tools (Miro, Zoom) were leveraged to mimic in a virtual format a collaborative environment. Subsequent iterations of the process involved elicitation of end user feedback and R&D team (human factors expert and engineering) collaborative interface redesigning effort. Formative usability studies were conducted in an asynchronous way. An interactive medium-fidelity prototype of the interface was created (justinmind prototyping software). Users were asked to freely interact with the prototype and answer comprehensive questions and specific functionalities via an online survey (REDCap). Relevant metrics used to inform successive design iteration were SUS, feature importance (informational elements, guiding elements, and descriptive elements) and rating of the visual experience. To increase the depth of understanding of user acceptance and overall experience when interacting with the interface, sentiment analysis of 3 key interface descriptors indicated by users was leveraged. A Lexicon-based sentiment analysis approach was considered for this study. It is hypothesized that this approach allows for rapid and meaningful comparison of users’ attitude towards the interface.
Results / Discussion
The proposed project outlines engineering of electrochemical devices for POU applications in the public health domain as an innovative area of application of human factors methodologies and techniques. In this field, support of the users’ tasks is still essential for the successful completion of the measurement procedure. An approach uniquely focused on the functional aspects is no longer enough to deliver usable and useful products that require direct involvement of non-experienced end users. The proposed case study seeks to outline a framework to overcome this limitation. User feedback from successive usability studies has informed us on usability issues and features to prioritize and improve during the iterative design process. Moreover, SUS is found not effective in capturing a holistic users’ perspective on the interface. Sentiment analysis is therefore presented as a valuable complementary metric to standard quantitative measures to deepen the R&D team’s understanding of the user perception towards the system and provide a more generalizable tool independent of the specifics of the technology. Even though implementation of a human-centered design approach appears more time-consuming and requires an additional effort, it is our purpose to advocate for its inclusion during the development process of effective and efficient engineering solutions deployable for POU applications to non-trained or minimally trained end users. Envisioned benefits include the increase in accessibility to sensing technologies relevant to limit environmental exposure of the general population to harmful heavy metals.
The proposed work reports on the application of a human-centered design approach for the development of an interface (app) for electrochemical detection of Manganese (Mn) in drinking water at the point-of-use (POU). Engineering devices for point-of-use (POU) applications in the field of environmental exposure, still lack a systematic human-centered design approach throughout their development cycle. Objective is to outline with a practical case study a framework to bridge the gap between the technical requirements (engineering) and the user requirements (human factors).
Heavy metals contamination poses a significant threat to public health. Heavy metals are introduced in the environment both from geogenic and anthropogenic sources and they are not degradable (Tchounwou, Yedjou, Patlolla, & Sutton, 2012). Drinking water is one of the major sources of heavy metal exposure for the general population (EPA,2018). Moreover, heavy metals are recognized as systemic toxicants, with the potential of affecting multiple organ systems. In particular, Mn is an essential element required for physiological functions, but harmful when present in excess. Recent evidence (Lucchini et al., 2017) suggests that Mn exposure from drinking water at levels once considered safe might cause cognitive and motor impairments in adults and children. The presented case study addresses the growing need for more widespread and accessible monitoring of Mn in drinking water. It focuses on the development of an app (GUI) to be combined with the analytical system and guide non-trained or minimally trained users to the procedure for the electrochemical detection of Mn. Details about the engineering aspects of the analytical procedure can be found in previous publication (Boselli et al., 2021).
Our framework offers a human-centered approach alternative to the techno-centered approach. Key features are the active engagement of a multi-disciplinary research and development team as well as potential end users throughout the development cycle of the app. The R&D team includes engineers, human factors experts, environmental and occupational health exposure clinicians, user experience designers and lab technicians. Integration of iterative feedback from non-trained end users and the diversity of backgrounds and experiences already encompassed within the R&D team allow for analysis of the system from different perspectives throughout the stages of the development process. We envision that implementation of a human-centered approach throughout the development cycle of the app for electrochemical detection of Mn in drinking water will allow its effective usability for POU applications by non-trained users. Development of a ready-to-use platform will encourage more frequent monitoring of Mn in drinking water. Moreover, this approach can be extended to development of electrochemical systems for other heavy metals detection in environmental and biological matrices.
Methods
The overall framework consisted in an iterative design, prototyping and testing, and evaluation process with continuous engagement of relevant stakeholders (R&D team members and end users). The engineering team proposed a low-fidelity prototype of the user interface and outlined the essential requirements (Boselli et al., 2021). Heuristic evaluation (heuristic evaluation #1) was then conducted by the human factors and public health experts under the guidance of both cognitive performance indicators (Wiggins & Cox, 2010) and Nielsen’s 10 usability heuristics (Nielsen & Molich, 1990). Two lab technicians as representative end users were involved at this early stage of the interface design. They were presented with static screenshots of the prototype interface over a Zoom interview. System usability scale (SUS) and a complementary survey (REDCap) were used as metrics for their feedback assessment. Outcomes from this first iteration of R&D team discussions, heuristic evaluation and usability study guided substantial changes in the interface design and helped broaden the perspectives of the engineering team. Key changes included the following ones: 1) improvement in guiding elements, 2) removal of non-essential and user distracting features, 3) increase in visibility of system status, and 4) better usage of color coding. Team members then re-evaluated the updated interface (heuristic evaluation #2). Findings were discussed and prioritized by 3 team members over virtual design sessions. Software tools (Miro, Zoom) were leveraged to mimic in a virtual format a collaborative environment. Subsequent iterations of the process involved elicitation of end user feedback and R&D team (human factors expert and engineering) collaborative interface redesigning effort. Formative usability studies were conducted in an asynchronous way. An interactive medium-fidelity prototype of the interface was created (justinmind prototyping software). Users were asked to freely interact with the prototype and answer comprehensive questions and specific functionalities via an online survey (REDCap). Relevant metrics used to inform successive design iteration were SUS, feature importance (informational elements, guiding elements, and descriptive elements) and rating of the visual experience. To increase the depth of understanding of user acceptance and overall experience when interacting with the interface, sentiment analysis of 3 key interface descriptors indicated by users was leveraged. A Lexicon-based sentiment analysis approach was considered for this study. It is hypothesized that this approach allows for rapid and meaningful comparison of users’ attitude towards the interface.
Results / Discussion
The proposed project outlines engineering of electrochemical devices for POU applications in the public health domain as an innovative area of application of human factors methodologies and techniques. In this field, support of the users’ tasks is still essential for the successful completion of the measurement procedure. An approach uniquely focused on the functional aspects is no longer enough to deliver usable and useful products that require direct involvement of non-experienced end users. The proposed case study seeks to outline a framework to overcome this limitation. User feedback from successive usability studies has informed us on usability issues and features to prioritize and improve during the iterative design process. Moreover, SUS is found not effective in capturing a holistic users’ perspective on the interface. Sentiment analysis is therefore presented as a valuable complementary metric to standard quantitative measures to deepen the R&D team’s understanding of the user perception towards the system and provide a more generalizable tool independent of the specifics of the technology. Even though implementation of a human-centered design approach appears more time-consuming and requires an additional effort, it is our purpose to advocate for its inclusion during the development process of effective and efficient engineering solutions deployable for POU applications to non-trained or minimally trained end users. Envisioned benefits include the increase in accessibility to sensing technologies relevant to limit environmental exposure of the general population to harmful heavy metals.
Event Type
Poster Presentation
TimeMonday, March 254:45pm - 6:15pm CDT
LocationSalon C
Digital Health
Simulation and Education
Hospital Environments
Medical and Drug Delivery Devices
Patient Safety Research and Initiatives