의료진을 위한 정신건강 모바일 애플리케이션의 사용자 인터페이스 디자인 및 사용성 평가: 간호 정보학적 관점
User Interface Design and Usability Evaluation of a Mental Health Mobile Application for Healthcare Workers: A Nursing Informatics Perspective
Article information
Abstract
목적
팬데믹 동안 소진된 의료진들의 정신건강 지원의 필요성이 대두됨에 따라 개인 맞춤형 중재의 중요성은 더욱 강조되었다. 본 연구는 간호 정보학에 초점을 맞춘 의료진들을 위한 모바일 정신건강 어플리케이션의 사용자 인터페이스(UI) 디자인 요소를 도출하고, 사용성을 평가하는 것을 목표로 하였다.
방법
사용자 요구사항을 반영하고 간호 정보학 원칙을 바탕으로 한 UI 디자인 요소를 강조하여 mHealing app의 인터페이스를 개발하였다. 사용성 시범 테스트는 건강 정보 기술 사용성 평가 척도(Health-ITUES)를 사용하였다.
결과
간호 정보학 교수 1명을 포함한 6명의 간호사가 간호 정보학 관점에서 의미 있는 통찰을 나누고 UI 디자인 도출 및 사용성 시범 테스트에 참여하였다. mHealing app은 자가 진단 도구로 측정한 사용자의 정신건강 상태에 따라 맞춤형 콘텐츠를 제공하고 상담사와의 연결을 지원한다. UI 디자인은 사용자 중심의 기능과 직관적인 안내를 우선시하며 팬데믹 동안 의료진들이 겪는 특수한 문제들을 해결하고자 한다. 사용성 시범 테스트에서 Health-ITUES에 따른 효과, 지각된 유용성 및 용이성 측면에서 높은 점수를 받았다.
결론
간호 정보학 원칙에 의한 UI 디자인 요소에 초점을 맞춰 개발된 mHealing app은 COVID-19와 같은 팬데믹 동안 의료진들의 정신 건강 관리 요구를 효과적으로 다룬다. 간호 정보학 교수 1명을 포함한 6명의 간호사가 사용자 중심 접근 방법을 통해 직관적인 UI로 설계한 mHealing app이 추후 구현된다면, 의료진의 정신건강에 긍정적인 영향을 미칠 수 있을 것으로 기대된다.
Trans Abstract
Objectives
The critical need for accessible mental health support for healthcare workers during pandemics underscores the importance of tailored interventions. This study aimed to derive user interface (UI) design elements and evaluate the usability of a mobile mental health application specifically crafted for healthcare professionals, focusing on nursing informatics.
Methods
The mental healing app (mHealing app) interfaces were developed, emphasizing UI design elements derived from user requirements and guided by principles of nursing informatics. Usability was assessed using the Health Information Technology Usability Evaluation Scale (Health-ITUES).
Results
Six nurses, including one specializing in nursing informatics, participated in both UI design derivation and usability pilot test, providing valuable insights from a nursing informatics perspective. The mHealing app offers personalized content delivery and facilitates connections to counselors based on users’ mental health states, supported by a self-diagnosis tool. The UI design prioritizes user-centered features and intuitive navigation, addressing healthcare workers’ unique challenges during pandemics. In the usability pilot test, the app scored high in impact, perceived usefulness, and ease of use, according to Health-ITUES.
Conclusions
The mHealing app, developed with a focus on UI design elements informed by nursing informatics principles, effectively addresses the mental health care needs of healthcare workers during pandemics, particularly COVID-19. Engaging six nurses in usability pilot test, including one specializing in nursing informatics, the app demonstrates a user-centered approach and intuitive UI, promising a meaningful impact in clinical settings.
INTRODUCTION
The World Health Organization (WHO) has stated that the 21st century is the “ era of epidemic” [1]. Indeed, various infectious disease outbreaks have emerged, such as severe acute respiratory syndrome (SARS) in 2002, novel swine-origin influenza A (H1N1) in 2009, and Middle East respiratory syndrome (MERS) in 2015. In 2019, the coronavirus disease (COVID-19) emerged in Wuhan City, Hubei Province, China, exhibiting differences in pathogenesis and lethality [2].
As the COVID-19 pandemic unfolds, the escalating number of patients exacerbates the shortage of healthcare workers, negative pressure isolation rooms, medical equipment, and supplies [2,3]. Furthermore, healthcare workers have been overloaded with updating information on COVID-19 and making important decisions for the increasing number of critically ill patients [4]. Additionally, they feared being exposed to the virus despite wearing sufficient personal protective equipment [5]. Some healthcare providers were perceived as carriers of infection, resulting in demands for them to refrain from going out, and their families faced societal stigma where others were reluctant to have them attend school or work. This often led to them self-isolating to avoid transmitting the virus to their family [4]. In particular, these workers experience heavy mental burdens when isolated patients project their aggravated psychological state, such as sadness and fear, onto them [5,6]. In the workplace, common stressors frequently cited among healthcare workers include work pressure, moral distress, and work schedule [7]. These factors are typically experienced as stressors by nurses even under normal circumstances, but their impact likely intensified during the pandemic. All these circumstances and conditions can lead to burnout, low quality of sleep, depression, anxiety, and stress in healthcare workers, which could compromise the quality of patient care and threaten patient safety [8,9]. Therefore, it is necessary to deal with healthcare workers’ mental health, as it affects their attention, understanding, and decision-making [10].
In 2024, 54,546 mobile health (mHealth) apps were available in the Google Play Store [11]. Although there are numerous mental health care apps, there are no criteria to determine whether the apps are suitable and beneficial for the end user, including patients and healthcare workers [12]. Due to the pandemic, mHealth apps are more important than in-person offline health programs, as apps are more scalable and easily available [13]. The use of mental healthcare apps has improved the emotional state of healthcare workers [14]. Moreover, user-centered design enables the creation of user-tailored services by thoroughly understanding the user's environment, characteristics, and preferences, making it easier to identify what users need [15,16]. However, it is likely that universal and general mental health apps have not fully grasped the specific challenges faced by healthcare workers during a pandemic. This study aims to investigate existing apps and design the structure and user interface (UI) of the mental healing app (mHealing app) specifically tailored to the needs of healthcare workers during a pandemic. Additionally, the app is designed with the potential to be adapted for online environments in the future.
METHODS
This study was guided by the Method for extracting User Needs (MUN) in the Method of App Selection based on User's Needs (MASUN) [17,18]. Researchers who want to design the mHealth app can easily use this method to design app structures and UIs reflecting app users’ needs without requiring assistance from professional app developers. To design an application, it is imperative to first identify the target user and situation. Based on this user and situation, ideas are generated. These ideas serve as the foundation for developing personas and scenarios, with careful consideration given to the needs and priorities of the personas. Subsequently, a draft of the app is created and reviewed, culminating in the finalization of the version. In this study, the designed app's usability was virtually evaluated using a tool called Health-ITUES (Figure 1). It has been used to design apps for women experiencing menstrual discomfort [19], obese children and their caregivers [20], and people with disabilities [21]. In this study, six nurses, including one specializing in nursing informatics with experiences ranging from 4 to 27 years in senior and tertiary care settings, participated in designing the mHealing app. Their diverse backgrounds enriched the app's design process.
Step 1: Targeting user & situation
We discussed who will use the app and our situation to create an app that people need. Six nurses shared their clinical experiences and discussed current health issues. Demographics were provided to understand the background of the six nurses (Table 1). In addition, we searched for and reviewed mobile apps to select a target situation and app users. Thereafter, we looked for apps currently developed for us. We selected only apps that are searchable on both Android and iOS platforms.
Step 2: Brainstorming and mind mapping
Brainstorming helps develop ideas and deepen understanding of subjects. Mind mapping generates new ideas derived from core thinking [22]. In particular, group mind mapping, a systematic and flexible method for organizing the complexity of a given problem, is a collaborative process already used in various health-related projects [23]. In this study, the participants conducted group brainstorming and mind mapping about the target situation and the user.
Step 3: Development of persona and scenario
Researchers can deeply understand various target users using the persona method, influencing user-centered designs [24]. In addition, it could be a guideline for building UI's for users with particular health needs [24]. In this study, two personas who will use the mHealing app were created, the scenarios were written, and the needs and features of the mHealth app that the personas required were listed.
Step 4: Needs list and priority consideration
The needs list is the standard for menus and features that should be included when designing the app structure and UI. The list was categorized by developed personas and scenarios in Step 3.
Step 5: Draft version of app structure and UI design
A draft version of the app structure and UI of the mHealing app was designed to reflect the needs list derived in Step 4. It was designed with paper and pen to make it simple and easy for participants from non-computer majors to express themselves. After this, the app structure was described using draw.io (https://app.diagrams.net/), a web-based software capable of flowcharting. UI was designed using Mangoboard (https://www.mangoboard.net), a web-based software capable of creating mobile UI. A mobile app designer revised the app UI.
Step 6: Review
Six nurses reviewed the draft versions of the mHealing app structure and the UI. Additionally, two more professional computer engineers (Ph. D., bachelor) reviewed the app structure four times to ensure accuracy. Based on their feedback, modifications were accordingly made.
Step 7: Final version of mHealing app user flow
After the reviews, user flow was derived based on the app structure flowchart and UI. The user flow, expressed through a flowchart, is a schematic of the app structure and UI for intuitive visibility. It is a blue-print for mobile apps and is a standard document throughout the software development process [25].
Step 8: Application usability pilot test by the Korean Health-ITUES
The usability (whether it is an easy-to-use and useful technology) is evaluated by users’ satisfaction and acceptance of the technology [26]. Health-ITUES has the advantage of being customizable to measure the usability of various mHealth apps [27]. In this study, the Korean Health-ITUES was used to evaluate the usability of the mHealing app virtually, based on user flow and UI, by six nurses. Health-ITUES has 20 items, scored on a five-point Likert scale ranging from strongly agree (5) to strongly disagree (1). It scores on impact, perceived usefulness, perceived ease of use, and user control, with Cronbach's alpha of 0.81 to 0.95 reliability at the time of development.
RESULTS
Step 1: Targeting user & situation
Across two discussions, six nurses shared opinions on the most necessary health issue to solve based on their experience working in their clinical background. Finally, “ mentally exhausted healthcare workers caring for COVID-19 patients,” who can use mobile apps, were selected as the target users and situation.
Six nurses sought to understand the current landscape of mental health apps for healthcare workers and analyze their content for development insights. We conducted searches using keywords “ mental health” in Korean and English according to our designated target users. 32 apps were found in the Google Play store when searching for “ mental health” using a Korean keyword, while 30 apps were found when searching for “ mental health” using an English keyword (Figure 2). After screening apps available on App Store, ten apps were included in the characteristics of the app summary (Table 2). Among these apps, ‘ Smiling Mind’ has menus for healthcare workers as meditation content. However, finding an app that provided mental healthcare targeted at healthcare workers wasn’ t easy.
Step 2: Brainstorming and mind mapping
Six nurses used brainstorming and mind mapping to identify the health issues of target users and generate ideas for overcoming them (Figure 3). Six nurses were divided into two groups to discuss the target user and situation. Several topics emerged, among which we selected mental health as a problem we could address.
Step 3: Development of persona and scenario
Persona A
Head of the infection control team at a general hospital who lives in Jongno-gu, Seoul, Jungmin Kim (45-year-old, female).
Persona B
A nurse at a 700-bed general hospital who lives in Jongno-gu, Seoul, Yeyoung Lee (29-year-old, female).
Appendix shows details of personas and scenarios.
Step 4: Needs list and priority consideration
Needs list of Persona A
a. Self-diagnosis to measure stress level (① Emotional labor measurement tool, ② Stress level measurement tool).
b. Mental health care based on The Myers-Briggs Type Indicator (MBTI), and the approach to care methods tailored to MBTI character types (introversion and extroversion).
c. Recording the pre- and post-use states and evaluating the effectiveness of care.
d. Various care methods based on MBTI personality types and online connections with experts and nearby hospitals or facilities based on selected user location, if necessary.
e. Online community: Communication with other app users to form a social consensus.
Needs list of Persona B
a. Choosing care methods depends on users’ mental states, situations, and preferences.
b. Enabling use at home or in the workplace through an online method (instead of a mental clinic or external location).
c. Providing methods for overcoming job stress unique to healthcare workers.
d. Sharing users’ assessments of how much stress was relieved through this content (e.g., the number of likes for each piece of content).
When considering Persona A's needs, we realized that our lack of expertise in MBTI classification might make it difficult to apply it to the development of mental healthcare apps. Consequently, excluding the MBTI, the app's content was divided into psychological states classified according to the article that scoped the impact of the pandemic on healthcare workers’ wellness [10]. The mHealing app addresses the following mental health conditions— stress, depression, and anxiety. The stress section has two tools. The Nurse Job Stress Tool [28] provides relative rankings of respondents rather than diagnosing stress conditions absolutely, while the Korean Job Stress Measuring Tool (KOSS) [29] classifies individuals who need counseling. The depression section has the Center for Epidemiologic Studies-Depressed Mood Scale (CES-D), which is the most commonly used tool in the literature analysis of domestic nurses’ depression [30]. The anxiety section includes the Beck's Anxiety Inventory (BAI), as used in a prior study that measured nurses’ anxiety [31].
Step 5: Draft version of app structure and UI design
The app structure was designed as a flowchart by combining the user needs list (Figure 4). Thereafter, a draft version of the mHealing app was designed. The app operates on a membership basis if users choose. Depending on the user's perceived mental distress, assessments are conducted, and if the scores exceed a certain threshold, counseling is recommended as a priority (counseling is available regardless of assessment scores). Users can access information about or indirectly experience topics such as food, travel, exhibitions, and concerts online. They can also engage in activities like games, meditation, and music. There are features for chatting with others facing similar concerns or keeping a diary. Finally, there is a feature for evaluating the program or app.
Step 6: Review
An app user registration feature was added so that users could track and review their mental health state. Through the notification, users can receive the results of the measurement tools and customized programs based on the thoes results. In addition, the app consists of various forms of healing content, not only text and images but also games, music, and videos.
Step 7: Final version of mHealing app user flow
The user flow of the mHealing app is presented in Figure 5.
Step 8: Application usability pilot test by the Korean Health-ITUES
The usability pilot test results, based on feedback from six nurses, showed the app's impact score at an average of 4.5 out of 5, perceived usefulness at 4.4, perceived ease of use at 4.7, and user control at 3.7 (mean scores and standard deviations were rounded off to the nearest hundredths) (Table 3).
DISCUSSION
In the first step of the app design process (targeting user and situation), healthcare workers caring for isolated, stressful patients were selected as target users. Nurses must continually develop their professional expertise, uphold patients’ rights, maintain teamwork through effective communication with colleagues, enhance job performance, and demonstrate nursing competencies such as problem-solving abilities [32]. However, nurses experienced significant stress and burnout during the pandemic due to their roles in managing the outbreak [33]. When nurses are under job stress and experience burnout, these competencies are not adequately utilized, leading to negative impacts on patient safety [34], and a decline in the quality of care [35]. Healthcare workers have been further drained by the moral stress and disenchantment caused by the challenges of providing care with inadequate clinical resources [7]. The pandemic has left them exhausted, increasing the need to care for their mental health [4].
While mental health apps have been developed for various professional groups, the unique challenges faced by healthcare workers, especially nurses, during crises like the COVID-19 pandemic necessitate a tailored approach. Unlike other professions, healthcare workers are in constant contact with suffering and critically ill patients, which heightens emotional and psychological strain. Moreover, the moral distress from making life-and-death decisions under resource constraints is particularly pronounced in healthcare settings.
Therefore, the mHealing app is designed to support healthcare workers’ mental health in any crisis, serving as a versatile tool in various high-stress healthcare settings. This app differs from those used in other professions by addressing specific stressors such as prolonged exposure to trauma, moral distress, and the high stakes of patient care, which are less prevalent in other job environments. By focusing on these unique aspects, mHealing app aims to provide more effective and relevant mental health support for healthcare workers, particularly nurses, ensuring they can maintain their essential competencies even under extreme stress.
A review of existing mental healthcare apps indicates a wide range of users, with menus limited to meditation, music, or stretching. However, it is essential to reflect on users’ needs to significantly impact using the mHealth app [36]. The customizable mHealing app is based on the needs and mental health conditions of healthcare workers caring for isolated, stressful patients. The app allows users to connect to psychiatrists according to their needs and conditions and choose programs such as diaries, chats, meditation, games, music, concert/exhibition information and viewing, food recipe videos, eating shows, and traveling indoors.
Nurses and scholars with experience caring for COVID-19 patients in the infection control team and dedicated COVID-19 hospitals participated in the design stage of the mHealing app. With end users participating in overall app development from the beginning to the evaluation stage, the user-centered design has been proven to be effective in terms of accessibility, usability, credibility, and effectiveness in the development of mHealth apps [15,16]. In other words, the mHealing app is expected to be accessible, usable, credible, and effective for its target users.
During the persona development stage, we crafted two personas representing key user groups: the head of the infection control team and a nurse in the COVID-19 ward, ensuring the app addresses diverse needs within healthcare settings. Ward nurses who take care of COVID-19 patients are exhausted as they need to be aware of the latest updated information and, under stress regarding possible infection, have to resolve the increased demands of patients in isolated environments and treat an increasing number of critically ill patients [5,6]. During a new infectious disease epidemic, members of the infection control team suffer from increased mental exhaustion due to overwork, responsibility, and limitations of capacity [37]. Therefore, these two personas are accurate representatives of mHealing app users. The personas are suitable for developing mental healthcare apps to relieve the mental exhaustion of healthcare workers during a pandemic.
The mHealing app was assessed using the Health-ITUES. The assessment confirmed that the mobile health app is effective, useful, and easy to use [26]. The tool has proven reliable and valid in evaluating the usefulness of mHealth technology in community-based adults with chronic diseases [27]. In this study, as a result of the pilot test, the app was confirmed by receiving high scores in all areas of effectiveness, usability, and control. Impact, perceived usefulness, and perceived ease of use averaged more than 4 points. The user control part was less than 4 points, but it is because it is assumed to be used. In this assessment, impact and perceived usefulness received relatively high scores, representing expectations and effects for the program and thus reflecting the authors’ needs and priorities. In addition, perceived ease of use shows the user's ability to utilize the app. Thus, the selected target was an appropriate representation of the end user. In contrast, it seems necessary to supplement the items of user control. This is related to the user's interaction with the app after using it. As the app was assessed virtually in this study, user control could be re-evaluated and supplement the app after its implementation.
The study has a few limitations. In the targeting user & situation stage, we were unable to search for existing apps using a variety of keywords. Future studies would benefit from referencing apps found using a broader range of keywords. In addition, when discussing the range of mental health, the app structure and UI were categorized based on participants’ experiences and personas due to the lack of clear standards and scope for mental healthcare apps. In future studies, we expect to develop an app that will follow the advice of mental health professionals. Furthermore, this study proposed a mental health app for healthcare workers during the pandemic, but the occupational group of personas was not diverse and was limited to nurses. If various healthcare workers, such as doctors and radiologists, participate in the design stage of an app, it could provide more tailored mental healthcare.
Using the app to understand the mental state of healthcare workers is a useful way to care for their mental health in situations where social distancing is necessary due to the pandemic. In addition to the pandemic, healthcare workers are always exposed to the risk of mental exhaustion. Future studies should consider actual application development and verification of its effect on those exposed to exhaustive situations, such as healthcare workers caring for patients as usual and during a pandemic.
ACKNOWLEDGEMENTS
The authors thank Dr. Chan Hee Park for reviewing and providing advice on user flow.