Physiotherapists supervised 1 session per week via videoconference software (Zoom) that was downloaded to the participants’ smartphone
a For mixed methods designs, only the data collection, data analysis, and participants from the qualitative component are described.
b LBP: low back pain.
c TRAK: Taxonomy for the Rehabilitation of Knee Conditions.
d N/OPSC: Neurosurgical and Orthopaedic Physiotherapy Screening Clinic.
e MDS: multidisciplinary service.
f ACL: anterior cruciate ligament.
g GP: general practitioner.
h GLA:D: Good Life with Osteoarthritis in Denmark.
i RE-AIM QuEST: Reach, Effectiveness, Adoption, Implementation, and Maintenance Qualitative Evaluation for Systematic Translation.
j TMD: temporomandibular disorder.
Study | Criteria from the Mixed Methods Appraisal Tool: qualitative studies | Total number of stars (based on the qualitative component) | |||||
1.1 | 1.2 | 1.3 | 1.4 | 1.5 | |||
Aily et al [ ], 2020 | 0 | 1 | 1 | 1 | 1 | *** | |
Arensman et al [ ], 2022 | 1 | 1 | 1 | 1 | 1 | ***** | |
Barton et al [ ], 2022 | 1 | 1 | 1 | 1 | 1 | ***** | |
Bossen et al [ ], 2016 | 1 | 1 | 1 | 0 | 1 | **** | |
Button et al [ ], 2018 | 1 | 1 | 1 | 1 | 1 | ***** | |
Martínez de la Cal et al [ ], 2021 | 1 | 1 | 1 | 1 | 1 | ***** | |
Cottrell et al [ ], 2017 | 1 | 1 | 1 | 1 | 1 | ***** | |
Dehainault et al [ ], 2024 | 1 | 1 | 1 | 1 | 1 | ***** | |
Dunphy et al [ ], 2017 | 1 | 1 | 1 | 1 | 1 | ***** | |
Egerton et al [ ] | 1 | 1 | 1 | 1 | 1 | ***** | |
Eriksson et al [ ], 2011 | 1 | 1 | 1 | 0 | 1 | **** | |
Ezzat et al [ ], 2022 | 1 | 1 | 1 | 1 | 1 | ***** | |
Ezzat et al [ ], 2023 | 1 | 1 | 1 | 1 | 1 | ***** | |
Farzad et al [ ], 2023 | 1 | 1 | 1 | 1 | 1 | ***** | |
Geraghty et al [ ], 2020 | 1 | 1 | 1 | 1 | 1 | ***** | |
Hasani et al [ ], 2021 | 1 | 1 | 1 | 1 | 1 | ***** | |
Hinman et al [ ], 2017 | 1 | 1 | 1 | 1 | 1 | ***** | |
Hjelmager et al [ ], 2019 | 1 | 1 | 1 | 1 | 1 | ***** | |
Kairy et al [ ], 2013 | 1 | 1 | 1 | 1 | 1 | ***** | |
Kelly et al [ ], 2022 | 1 | 1 | 1 | 1 | 1 | ***** | |
Kingston et al [ ], 2015 | 1 | 1 | 1 | 1 | 1 | ***** | |
Kloek et al [ ], 2020 | 1 | 1 | 1 | 1 | 1 | ***** | |
Lamper et al [ ], 2021 | 1 | 1 | 1 | 1 | 1 | ***** | |
Lawford et al [ ], 2019 | 1 | 1 | 1 | 1 | 1 | ***** | |
van der Meer et al [ ], 2022 | 1 | 1 | 1 | 1 | 1 | ***** | |
Östlind et al [ ], 2022 | 1 | 1 | 1 | 1 | 1 | ***** | |
Palazzo et al [ ], 2016 | 1 | 1 | 1 | 1 | 1 | ***** | |
Passalent et al [ ], 2022 | 1 | 1 | 1 | 1 | 1 | ***** | |
Pereira et al [ ], 2023 | 1 | 1 | 1 | 1 | 1 | ***** | |
Petrozzi et al [ ], 2021 | 1 | 1 | 1 | 1 | 1 | ***** | |
Poolman et al [ ], 2024 | 1 | 1 | 1 | 1 | 1 | ***** | |
Renard et al [ ], 2022 | 1 | 1 | 1 | 1 | 1 | ***** | |
van Tilburg et al [ ], 2022 | 1 | 1 | 1 | 1 | 1 | ***** | |
van Tilburg et al [ ], 2023 | 1 | 1 | 1 | 1 | 1 | ***** | |
De Vries et al [ ], 2017 | 1 | 1 | 1 | 0 | 1 | **** |
a 1.1=Is the qualitative approach appropriate to answer the research question?
b 1.2=Are the qualitative data collection methods adequate to address the research question?
c 1.3=Are the findings adequately derived from the data?
d 1.4=Is the interpretation of results sufficiently substantiated by data?
e 1.5=Is there coherence between qualitative data sources, collection, analysis, and interpretation?
An overview of CFIR constructs or subconstructs influencing implementation of digital health services for patients with musculoskeletal conditions in the primary health care setting, with the sources and reliability rating, is presented in Table 3 . An overview of the data synthesis supported by illustrative quotes, is presented in Table 4 .
CFIR domain, construct, and subconstruct | Studies | Reliability | ||||
Innovation source | [ , , ] | High | ||||
Relative advantage | [ - , - , - , - ] | High | ||||
Adaptability | [ - , , - , , , - , , , , , ] | High | ||||
Complexity | [ - , , , - , , , , , , , , ] | High | ||||
Design quality and packaging | [ , , , , , , , , , , , , ] | High | ||||
Cost | [ , , , , , , , , , ] | High | ||||
Patient needs and resources | [ , , - , , , , - , - , , - ] | High | ||||
External policy and incentives | [ , , , , , , ] | High | ||||
Networks and communications | [ , , ] | High | ||||
Tension for change | [ , , , , , , ] | High | ||||
Compatibility | [ , , , , - , , , ] | High | ||||
Learning climate | [ , ] | High | ||||
Available resources | [ , , , , , , , , - , , , - , , , ] | High | ||||
Access to knowledge and information | [ - , , , ] | High | ||||
Knowledge and beliefs about the intervention | [ , , , - , - , , , ] | High | ||||
Opinion leaders | [ ] | Medium | ||||
Key stakeholders (health care professional) | [ , , , ] | High | ||||
Executing | [ ] | Medium |
a CFIR: Consolidated Framework for Implementation Research.
CFIR domain, construct, and subconstruct | Barriers (–) and facilitators (+) with illustrative quotes | ||||
Innovation source | ] | ||||
Relative advantage | ] | ||||
Adaptability | |||||
Complexity | |||||
Design quality and packaging | |||||
Cost | |||||
Patient needs and resources | |||||
External policy and incentives | |||||
Networks and communications | |||||
Tension for change | |||||
Compatibility | |||||
Learning climate | |||||
Available resources | |||||
Access to knowledge and information | |||||
Knowledge and beliefs about the intervention | |||||
Opinion leaders | |||||
Key stakeholders (health care professional) | |||||
Innovation source (high reliability).
Commercially neutral digital health services may facilitate implementation according to health care professionals because logos of, for example, pharmaceutical companies could indicate economic instead of public health interests [ 42 , 56 ]. A link with an institution with a good image, such as a specialized hospital, may also be a facilitator to implementation, according to health care professionals, because it promotes trust [ 53 ].
When patients or health care professionals experience a relative advantage of digital health services over usual care, this may facilitate implementation. Mentioned relative advantages were promoting adherence [ 28 - 30 , 33 , 43 , 49 , 53 , 61 , 62 ] , self-management [ 29 - 31 , 33 , 34 , 36 , 40 , 42 - 44 , 47 , 48 , 53 , 59 ] , empowerment [ 34 , 42 , 44 , 48 , 53 , 55 ] , motivation through support [ 28 , 31 - 33 , 37 , 38 , 43 , 53 , 59 - 61 ] , access to health care [ 29 , 34 , 36 , 38 , 40 , 41 , 44 , 45 , 47 - 50 , 52 - 54 , 56 , 60 , 62 ] , creating societal awareness [ 56 ] for specific health problems, and a continuous care chain [ 33 , 36 , 39 , 42 , 44 , 55 , 61 ]. The integration of digital health and therapy sessions (blended care) is described by patients and health care professionals as a facilitator because the digital health service can then be tailored to patient’s needs, complementary therapy can be offered, and self-efficacy can be enhanced [ 28 - 30 , 32 , 35 , 39 - 44 , 48 , 52 , 53 , 56 , 62 ]. However, there were also some concerns among health care professionals that quality of care may be reduced because, for example, physical examination may not be as thorough compared to usual face-to-face care [ 30 , 32 - 34 , 36 , 38 - 44 , 52 , 54 , 57 ] . On the contrary, some health care professionals believed that extra time and encouragement for the patient through a digital health service may result in better treatment outcomes. Advantages and disadvantages related to the patient–health care professional relationship were also experienced as both barriers and facilitators to implementation by patients and health care professionals [ 29 - 31 , 33 , 34 , 40 , 41 , 44 , 47 , 50 , 52 , 53 , 55 ]. Patients reported, for example, that when having health concerns, they prefer face-to-face reassurance over reassurance through a digital health service. Physiotherapists also had some concerns about creating a professional relationship if there are none or less face-to-face sessions. In contrast, they experienced that consulting via telephone forced them to focus on effective conversations, which allowed them to talk at a more personal level with patients. In addition, privacy and safety concerns may be barriers to implementation [ 36 , 40 , 42 - 44 , 52 ]. During the COVID-19 pandemic, safely providing health care from home was reported as a facilitator for implementation.
Both health care professionals and patients agreed that adaptability of digital health services to fit the local context may be an important facilitator to implementation. Digital health services that are flexible to tailor to specific patient needs and suitable for various groups or subgroups of patients facilitate implementation [ 28 - 34 , 39 , 41 , 42 , 44 - 46 , 48 , 50 , 52 - 54 , 56 , 57 , 59 , 61 , 62 ]. Another facilitating determinant was an evolving intervention [ 43 , 56 , 61 ]. Use of a digital health service may increase if its content changes and information and features are continuously updated.
Complexity of digital health services that affect implementation is mostly linked to usability . Facilitating determinants concerning usability may be easy installation; easy to use; simple design and interface; simple navigation; visual support of text; and a not too wordy, manageable content [ 28 - 30 , 37 , 40 , 43 - 45 , 48 , 50 , 51 , 53 , 56 , 59 , 60 ]. Barriers concerning usability may be functional limitations of digital health services used in health care compared to those available on the commercial market. Another facilitating determinant to implementation was sufficient health care professional management for patients , such as updating relevant links and personal plans or the provision of technical aid by health care professionals to reduce complexity [ 28 , 53 , 55 ].
Experienced excellence in design quality and packaging of digital health services, such as variety and range of content and functionalities [ 29 , 30 , 32 , 35 , 37 , 45 , 53 , 59 , 61 , 62 ] , persuasive design [ 45 , 53 , 56 ] , and modality [ 33 , 34 , 40 , 45 , 53 , 61 ], may facilitate implementation according to both patients and health care professionals. Some mentioned functionalities are personal plans, exercise logs with speech notes as an alternative to text input, information modules with educational videos alongside written information, a progress dashboard with milestones, email or chat support, reminder tools, and feedback functions. An app was preferred over a website as modality, in particular, because of offline functionalities of an app.
Costs associated with digital health services may be a barrier to implementation. Next to direct costs, a potential reduced number of treatment sessions [ 29 , 46 , 52 , 55 , 62 ] may both be a barrier and facilitator to implementation. Potential loss of income because of substitution of treatment sessions was experienced as a barrier by health care professionals. However, reducing treatment sessions may be a facilitator to some health care professionals because of efficiency, and offering innovative interventions attracts new patients, which is a financial incentive. Some health care professionals mentioned that patient expenses for digital health services may be a barrier to implementation [ 29 , 34 , 40 , 41 , 47 , 54 ]. In addition, digital health services may improve access to care for patients living in remote areas and may save them travel expenses, which was experienced as a facilitator to implementation.
Patient needs and resources (high reliability).
Needs of patients may influence the participation in digital health. Personal traits of patients , such as poor digital literacy [ 28 , 33 , 42 , 45 , 46 , 49 , 51 , 52 ], poor communication skills [ 34 , 41 , 47 ], higher age [ 36 , 41 , 42 , 44 , 45 , 56 ], lack of motivation [ 28 , 31 , 35 , 38 , 42 , 44 , 45 , 51 , 53 , 58 , 61 ], maladaptive illness perceptions [ 36 , 61 ], and feeling depressed [ 61 ], may be barriers to adherence or participation and therefore to implementation of digital health in primary care. Moreover, entertaining strategies for performing exercises, such as exercises in a video game, might improve engagement according to patients, which facilitates implementation [ 61 ].
Broad acceptance of digital health by patients, health care professionals, and health service funders creates trust for health care professionals that implementation is worthwhile. Therefore, acceptance by these stakeholders , or even the demand by stakeholders such as patients, may be an important facilitator to implementation [ 29 , 31 , 32 , 44 , 54 ]. The absence of health care guidelines [ 44 , 46 ], standards, or protocols in using digital health and strict privacy regulations [ 41 ] may be barriers to implementation. Another barrier to health care professionals may be a lack of external financial incentive if the digital health intervention aims to substitute treatment sessions [ 62 ].
Networks and communications (high reliability).
Effective, useful, and timely channels of communication between health care professionals involved in the use of a digital health intervention may be facilitators to implementation [ 39 , 52 , 54 ]. An example is the quality and quantity of communication between a general practitioner and a care support team that provided remotely delivered interventions in a multidisciplinary intervention. Another facilitator is some sort of personal relationship between health care professionals that are involved in using a digital health service [ 54 ].
Health care professionals and patients agreed that there is a need for change, which was a facilitator to implementation of digital health. Problems that create a tension for change are poor accessibility to health care [ 49 , 52 , 57 ] because of for example medical comorbidities, poor health literacy or inconvenient appointment times, large distance to health care service, high burden of health care on health care professionals, no availability of a (specialized) health care professional, and the need for trustworthy information [ 56 ] .
Integrating digital health services into usual care requires change of treatment routines, which may be a barrier to implementation, specifically because of lack of knowledge and practice to adapt routines, lack of confidence, and resistance to change of health care professionals [ 29 , 30 , 39 , 44 , 46 - 48 , 51 , 52 , 54 ]. Positive experiences with integrating digital health services into usual care may lead to more acceptability and may overcome this barrier. Moreover, incompatibility with other initiatives and guidelines may be barriers to implementation [ 54 ]. There are many initiatives and guidelines for management of musculoskeletal conditions, and whenever these are incompatible with a digital health service, treatment routines may become complicated and confusing. In addition, incompatibility with existing payment structures may lead to inequity of care and was a barrier to implementation according to health care professionals [ 54 ]. Health care professionals mentioned that information incongruence could be another barrier to implementation [ 54 ]. Safety may be affected when patient advice and information, provided by health care professionals and via digital health services, are incongruent and as a consequence cause the health care professional to spend extra time and effort to deal with conflicting messages.
The extent to which health care professionals feel as essential, valued, and knowledgeable partners in the implementation process creates a better climate for implementation. Facilitators to implementation of digital health services may be support from colleagues and that the professional autonomy of health care professionals was maintained [ 45 , 46 ].
Available resources, including the availability of suitable infrastructure, may facilitate the implementation of digital health. Technology-related issues may be a barrier to implementation [ 32 , 33 , 36 , 38 , 40 , 43 , 48 - 51 , 53 , 55 , 60 ]. Both patients and health care professionals mentioned several technology-related issues, including troubles with initially setting up or operating the technology, insufficient battery life, poor or no internet connection, poor video quality, and audio problems. Moreover, time may both be a barrier as well as a facilitator to implementation [ 28 , 30 , 33 , 41 , 45 , 46 , 51 , 52 , 56 ]. Some health care professionals perceived digital health services as time saving, whereas others perceived it as an additional burden. This issue involves the lack of time to familiarize with, set up, personalize, and use the technology as well as the time investment required from health care professionals to assist patients. In addition, the lack of a quiet physical space for health care professionals as well as patients specifically for telerehabilitation may be a barrier to implementation [ 33 , 44 , 52 , 61 ]. Moreover, the lack of electronic health records may be a barrier to implementation [ 33 ].
Access of health care professionals and patients to knowledge and information about the use of digital health services may be an important determinant that influences implementation. A health care professionals’ training before using the digital health intervention may be a facilitator to implementation [ 41 , 44 - 47 , 52 , 60 ]. Access for patients to explore the digital health intervention before a consultation and clear instructions in the form of a manual, webinar, videos, or face-to-face support were facilitators to implementation [ 30 , 32 , 40 , 43 , 44 , 46 , 51 ].
Health care professionals’ acceptance of a digital health intervention may both be a facilitator and barrier [ 29 , 33 , 42 , 44 - 47 , 52 , 54 , 60 , 62 ]. Resistance to change of health care professionals may be a barrier to implementation, but if health care professionals trust that their efforts to embrace change will be worthwhile, this may facilitate implementation. Most health care professionals are open to digital health services, as long as they have appropriate training and time to familiarize with the intervention and its content. If experiences with a digital health intervention exceeds health care professionals’ expectations, this results in intrinsic motivation for the digital health intervention, which promotes implementation. The feeling of maintaining professional autonomy and confidence of health care professionals in being able to deliver the digital health intervention may also facilitate implementation. Concerns about patient information confidentiality, the belief that a digital health intervention will not be as good as face-to-face care, and providing digital health for conditions perceived as low priority may be barriers to implementation related to health care professional acceptance. Moreover, concerns that health care professionals’ job satisfaction may diminish may be a barrier to implementation [ 48 , 54 , 60 ]. However, if digital health services enable more contact with patients, this is experienced as a promotion of health care professionals’ satisfaction. Another contribution to satisfaction was that digital health services may lead to less physically demanding care compared to usual care, which all may facilitate implementation.
Engaging—opinion leaders (medium reliability).
Peer opinion leaders exert influence through their representativeness and credibility. When new digital health services are presented to a health care professional by a coworker who vouches for it ( peer opinion leader ), this may facilitate implementation [ 56 ].
Involvement of health care professionals in the implementation of digital health services is a facilitating determinant to implementation that promotes confidence in digital health services [ 60 ]. Furthermore, the willingness of health care professionals to try digital health services may facilitate implementation [ 52 ]. Organizational uncertainties among key stakeholders, such as questions like “Who does it?” and “Who pays for it?” may be barriers to implementation [ 54 ]. In addition, setting up a technical support team may lead to feelings of support by the health care professional, which may facilitate implementation [ 50 ].
Executing the implementation of digital health services might require some justification and delegation to key involved stakeholders, such as gym staff [ 60 ]. This may be a barrier to implementation as, for example, content of the digital health intervention (eg, specific gym exercises) may not always be conventional.
In this systematic review, barriers and facilitators to the implementation of digital health services for people with musculoskeletal conditions in the primary health care setting were identified and synthesized according to the CFIR. Barriers and facilitators were identified within all 5 CFIR domains, and almost all constructs or subconstructs of the CFIR with synthesized barriers or facilitators had high reliability. Various stakeholders are involved in the implementation of digital health services for patients with musculoskeletal conditions in the primary care setting. The current determinant analysis provides a generic overview of barriers and facilitators that may be considered by stakeholders, such as digital health intervention developers, health care professionals, health care organizations, health policy makers, health care funders, and researchers, to design fitting implementation strategies [ 63 ]. As stakeholders mainly have influence on barriers and facilitators in specific CFIR domains, main results for stakeholders will be presented and discussed accordingly.
Identified barriers and facilitators that may especially be important for developers are from the domain “digital health service characteristics.” Facilitators within this domain include the flexibility of digital health services to tailor to specific patient needs, suitability for various subgroups, and high usability. Digital health service developers can consider these facilitators when developing and evaluating their product by using, for example, an eHealth framework, such as the Center for eHealth Research Roadmap [ 64 ]. An example of an existing digital health service that uses some of these facilitators is eHealth platform Physitrack, which was experienced by physiotherapists as user friendly, accessible, and helpful in providing personalized care [ 65 , 66 ]. Intervention design with nonoptimal usability was also identified as a barrier to implementation in other contexts, just as costs [ 14 - 17 ]. In this study, financial aspects, such as loss of income for health care providers because of potential substitution or patient expenses, were also shown to be important barriers to implementation for this specific context. Financial strategies to overcome these barriers when implementing digital health services for the context of patients with chronic illnesses living at home, such as changing the (patient) billing systems and fee structures, were suggested in previous research and may be relevant for developers to consider [ 67 ].
Identified barriers and facilitators that are especially important to health care professionals are from the domain “digital health service characteristics” and “outer setting.” A facilitator within the domain “digital health service characteristics” is the relative advantage of digital health over usual care, such as promoting adherence, self-management, empowerment, and access to health care. Important barriers are the concern that digital health services might negatively affect patient–health care professional relationship and quality of care, experienced additional burden of digital health services, and change of treatment routines. Existing workflow was also shown to be an important barrier in other contexts [ 16 ]. To use these facilitators and overcome these barriers, health care professionals might consider using previously developed implementation strategies used in another context, such as conducting educational meetings to train and educate colleague health professionals or conducting cyclical small tests of change [ 68 ]. Personal traits of patients, such as digital literacy, maladaptive illness perceptions, poor communication skills, and lack of confidence in the patient’s own physical ability, are barriers from the “outer setting.” An example of a previously developed tool for physiotherapists is the use of the Checklist Blended Physiotherapy [ 69 ]. This clinical decision aid to support the physiotherapist in the decision of whether a digital health service should be an integral part of physiotherapy treatment for an individual patient might be a strategy, which has yet to be evaluated.
Identified barriers and facilitators that are especially important to health policy makers are mostly from the domain “outer setting.” The lack of health care guidelines and lack of an external financial incentive were identified as barriers. The World Health Organization developed guideline recommendations on digital health services that can be used to develop guidelines for local contexts [ 9 ]. Changing reimbursement policies and clinician incentives are financial strategies that may are recommended to health policy makers [ 67 ]. Moreover, broad acceptance of digital health services by patients, health care professionals, and health service funders creates trust for health care professionals that implementation is worthwhile, which may facilitate implementation.
Identified barriers and facilitators that are especially relevant to health care organizations are mostly from the domain “inner setting.” Providing access to knowledge and information about the digital health intervention was found to be an important facilitator. In addition, an opinion leader and involvement of health care professionals facilitates implementation. Therefore, it is suggested that health care organizations consider implementation strategies, such as developing and distributing educational material as well as identifying and preparing champions, and inform local opinion leaders to develop stakeholder interrelationships [ 68 ]. Important barriers to overcome are technology-related issues and incompatibility with other initiatives, guidelines, and existing payment structures. Organizational uncertainties, such as questions like “Who does it?” and “Who pays for it?” are barriers to implementation that health care organizations must mainly overcome. To overcome these barriers, health care organizations are suggested to consider new sources of funding, involve executive boards, and try to form or join an innovation network [ 68 ].
Researchers can use the generic overview of barriers and facilitators of all domains to prioritize them for a local context, develop implementation strategies, test them, and systematically evaluate implementation outcomes. This is important because determinants are specific to the local context, and local contexts are ever changing [ 19 ].
Although several studies have identified barriers and facilitators to the implementation of digital health services in other settings than primary care or complex interventions in the primary care setting, this is the first systematic review of studies identifying and analyzing the facilitators and barriers of digital health services for people with musculoskeletal conditions in the primary health care setting. The results of this study are consistent with findings in other settings or the general health care setting [ 70 ]. Although the findings on the level of CFIR domains or subdomains are comparable to other contexts, the nuance in the description of the identified barriers and facilitators are mostly specific to primary care for patients with musculoskeletal conditions.
A strength of this systematic review is that all included articles had a mixed methods or qualitative design, and end-user perspectives of both patients and health care professionals were included, which led to a rich description of barriers and facilitators. However, it is important to note that many of the included studies did not follow a structured implementation process, and it was not possible to discuss whether implementation duration influenced the participants’ perspectives. Another strength is the use of the CFIR. Synthesizing according to the CFIR makes our findings easier comparable to other implementation studies and supports the use of common terminology in this field. Despite the careful execution of this study, there are some methodological considerations. The quality of the qualitative component was assessed by presenting stars. Cutoff values were determined by the authors; however, these cutoff values are arbitrary, which may have influenced the interpretation of the quality of included articles. In addition, a reliability rating was used to indicate confidence in the findings. While this approach took consistency and quality of the studies into account, we acknowledge that tools such as GRADE-CERQual were not used, which assesses confidence in findings from a more comprehensive perspective, considering factors such as coherence and adequacy. Incorporating GRADE-CERQual or similar methods in future research could enhance confidence in findings of a qualitative data synthesis [ 71 ]. The context of this review was digital health services, the primary care setting, and musculoskeletal conditions. People with musculoskeletal conditions are one of the largest patient groups in the primary health care setting. Although this patient group is very heterogenous, there are some transcendent key recommendations for patients with musculoskeletal conditions in primary health care, which makes the context sufficiently specific to inform relevant stakeholders [ 72 ]. Specific types of digital health services researched in the included articles were also very heterogenous. Therefore, it was not possible to specify barriers and facilitators to implementation for different types of digital health services. This should be considered when developing implementation strategies for specific digital health services. This systematic review provides a generic overview, and reliability was presented on the level of subconstructs and not on the level of individual determinants. Therefore, a prioritization of determinants should be carried out for the local context, as a first step in designing implementation strategies [ 19 ].
This systematic review provides an extensive description of the barriers and facilitators to the implementation of digital health services for people with musculoskeletal conditions in the primary health care setting. The findings are based on the synthesis of 35 qualitative and mixed methods articles through the CFIR. Barriers and facilitators were identified across all 5 CFIR domains, and nearly all constructs or subconstructs of the CFIR with synthesized barriers or facilitators had high reliability. This suggests that the implementation process can be complex and requires implementation strategies across all CFIR domains. Stakeholders, such as digital health intervention developers, health care professionals, health care organizations, health policy makers, health care funders, and researchers, can consider the identified barriers and facilitators to design tailored implementation strategies after a prioritization has been carried out in their local context.
The authors would like to thank the authors of all data used in the review.
The data sets generated and analyzed during this study are available from the corresponding author on reasonable request.
None declared.
Search strategy.
Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) checklist.
Consolidated Framework for Implementation Research |
Mixed Methods Appraisal Tool |
Edited by A Mavragani; submitted 13.06.23; peer-reviewed by J Ross, LA Gomes; comments to author 07.10.23; revised version received 01.12.23; accepted 10.04.24; published 27.08.24.
©Mark Leendert van Tilburg, Ivar Spin, Martijn F Pisters, J Bart Staal, Raymond WJG Ostelo, Miriam van der Velde, Cindy Veenhof, Corelien JJ Kloek. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 27.08.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.
Scientific Reports volume 14 , Article number: 19597 ( 2024 ) Cite this article
120 Accesses
1 Altmetric
Metrics details
In ophthalmology, artificial intelligence methods show great promise due to their potential to enhance clinical observations with predictive capabilities and support physicians in diagnosing and treating patients. This paper focuses on modelling glaucoma evolution because it requires early diagnosis, individualized treatment, and lifelong monitoring. Glaucoma is a chronic, progressive, irreversible, multifactorial optic neuropathy that primarily affects elderly individuals. It is important to emphasize that the processed data are taken from medical records, unlike other studies in the literature that rely on image acquisition and processing. Although more challenging to handle, this approach has the advantage of including a wide range of parameters in large numbers, which can highlight their potential influence. Artificial neural networks are used to study glaucoma progression, designed through successive trials for near-optimal configurations using the NeuroSolutions and PyTorch frameworks. Furthermore, different problems are formulated to demonstrate the influence of various structural and functional parameters on the study of glaucoma progression. Optimal neural networks were obtained using a program written in Python using the PyTorch deep learning framework. For various tasks, very small errors in training and validation, under 5%, were obtained. It has been demonstrated that very good results can be achieved, making them credible and useful for medical practice.
Introduction.
Artificial intelligence (AI) is currently one of the fastest-evolving fields, notable for its diverse techniques and applications areas. Modern medicine requires the acquisition, analysis, and processing of large amounts of data to address complex clinical tasks. In this context, AI serves as a valuable tool for clinicians, which aids in therapeutic decision-making and provides predictions that extend beyond available data.
Artificial neural networks (ANN) are modelling and classification tools with the ability to learn different types of relationships from available data. They can approximate any continuous nonlinear function, and are effective for modelling complex nonlinear systems. ANNs draw inspiration from biological neurons and the structure of the nervous system. A biological neuron comprises three main components: the cell body, dendrites, and axon, with synapses facilitating connections. These elements have artificial counterparts in the basic units of neural networks. An artificial neuron receives inputs, possibly from other neurons, each associated with a connection weight. It calculates a weighted sum of these inputs and then applies an activation function to compute the output, which can be further transmitted to other neurons.
Glaucoma is a chronic, progressive, irreversible, multifactorial optic neuropathy that mainly affects elderly people, requiring early diagnosis, individualized treatment, and lifelong monitoring.
There are many approaches in the literature that report the study of glaucoma evolution using neural networks, original articles, and numerous reviews. Mainly, there are two categories of approaches based on the data’s origin: from images or medical records , with the former being more numerous given the ease and accuracy of image acquisition. There are specific AI algorithms for segmenting and automatically enhancing ocular images from optical coherence tomography (OCT) and processing fundus images.
On the other hand, using data from medical records is more laborious because it requires comprehensive datasets, but, by processing these data with AI algorithms, more information can be obtained, useful for the ophthalmologist, as the dataset can include numerous analyses, possibly influencing glaucoma.
The most common use of artificial intelligence techniques in ophthalmology has been in the early diagnosis of glaucoma when there are diagnostic doubts. Neural networks, in particular, have played a significant role in determining the need for early antiglaucoma therapy to prevent disease progression.
The first studies on using ANNs in interpreting incipient perimetric lesions in glaucoma belong to Anton et al. 1 . The authors concluded that neural networks can differentiate incipient lesions caused by glaucoma from those caused by other diseases with 97% accuracy.
In 2005, Bowd et al. 2 used two algorithms (RVM—Relevance Vector Machine and SVM—Support Vector Machine) for classifying healthy eyes and eyes affected by glaucoma, using information based on the retinal nerve fiber layer (RNFL) and thickness measurements obtained through scanning laser polarimetry (SLP).
Previously, the same author 3 had used different artificial intelligence tools to determine the evolutionary changes in the visual field in glaucoma patients and predict the glaucoma stage. Similar concerns were held by Simon et al. 4 , Hernández et al. 5 , Grewal et al. 6 , Parsaei et al. 7 , who used various artificial intelligence tools (neural networks with different learning algorithms) to determine possible visual field progression in glaucoma patients.
Zhu et al. 8 developed a neural network using a Bayesian-type function to establish the relationship between structure and visual function in glaucoma; the results showed that the network could improve the prediction of visual function. Based on the analysis of the specialized literature, they showed that diabetes is an individual risk factor for the development of open-angle glaucoma.
An interesting study on the utility of ANNs in ophthalmology is found in a doctoral thesis at UMF Iași 9 . For the first time, artificial neural networks are used to demonstrate the existence of a relationship between glaucoma and diabetes, as well as in predicting the progression of diabetic ocular changes (diabetic retinopathy) in patients with glaucoma and diabetes. The constructed neural models demonstrated the possibility of using them in predicting mean deviation (MD) deterioration, with the best results obtained using Jordan Elman-type neural networks 10 .
In a recent review, Devalla et al. 11 discuss the role of AI in glaucoma diagnosis and prognosis. They show that while early studies relied on simple ANNs to detect glaucoma using perimetric data (visual field), modern deep learning (DL) systems have successfully exploited high-resolution images from fundus photography and OCT. The use of AI algorithms can help, by collecting data from multiple tests, to detect anomalies, and perform relevant screenings. This reduces the workload for clinicians, minimizes diagnostic errors, and improves the quality of care for glaucoma patients. This will lead to early detection of glaucoma and promote research and development of new drugs in treatment. Also, pre-perimetric changes can be identified, likely leading to advances in research and clinical practice.
Bizios et al. 12 conducted a study comparing artificial neural networks and support vector machines for glaucoma diagnosis, measuring the thickness of the retinal nerve fiber layer obtained with OCT. Both algorithms provided satisfactory results.
Yousefi et al. 13 developed a DL-based algorithm that detected visual field (VF) progression earlier than conventional strategies. Although lowering intraocular pressure (IOP) has proven to be therapeutically effective in delaying glaucoma progression, some authors have shown that disease progression is still inevitable, suggesting that optimal treatment regimens for different forms of glaucoma have not yet been achieved.
Guangzhou et al. 14 published a study addressing the task of optic disc classification in glaucoma. A total of 163 eyes from 105 glaucoma patients were utilized, divided into training and testing datasets, to establish classification criteria to aid clinical assistance in glaucoma management. Ocular images were obtained using optical coherence tomography techniques and retinal perfusion was investigated using laser flowgraphy. A total of 91 parameters were extracted from each eye, and general patient information was included. Classification methods tested in the study included neural networks, naive Bayes classifiers, support vector machines, and gradient boosted decision trees. The results of the performance comparison of the three classification methods showed that neural networks achieved the best classification with an accuracy of 87.8% using only nine ocular parameters.
The study of glaucoma progression, through simulation with artificial intelligence tools, consisted of structural , functional , or mixed approaches .
Functionally, several studies have been conducted aiming to compare the performance of various machine learning classifiers with global indices from STATPAC and human experts 15 , 16 , 17 .
Visual fields are used as input data, and the classifiers’ ability to predict the development of abnormal fields in subsequent examinations of hypertensive eyes (OHT) with initially normal visual fields is evaluated, as well as to identify and quantify areas of progression in standard automated perimetry fields 18 .
In addition, some studies compare the performance of machine learning algorithms with traditional algorithms in detecting glaucomatous visual field defects. The studies employ various techniques such as multi-layer perceptrons (MLP), support vector machines (SVM), Gaussian classifiers (MoG), generalized Gaussian classifiers (MGG), variational Bayesian independent component analysis models (vB-ICA-mm), and deep convolutional neural networks (CNN) 19 , 20 . Results indicate that machine learning algorithms can improve STATPAC global indices and identify glaucomatous changes earlier in standard visual fields, sometimes up to 3.92 years earlier than traditional methods.
It is concluded that machine learning algorithms have the potential to reduce testing time by decreasing the number of visual field location measurements. Moreover, the results show that machine learning algorithms have higher diagnostic performance compared to traditional algorithms, and the proposed glaucoma progression index based on CNN and machine learning outperforms global, regional, and point indices in detecting longitudinal visual field progression in glaucoma.
On the other hand, various studies have focused on detecting structural progression in glaucoma by analysing OCT and fundus images with AI and DL algorithms.
The first study mentioned was conducted by Christopher et al. 21 , which used PCA to identify new glaucoma-related structural features based on SS-OCT images. This study obtained significantly higher accuracy for glaucoma detection with an AUC of 0.95.
The second study, conducted by Medeiros et al. 22 , used a deep learning convolutional neural network to predict average RNFL thickness based on fundus photographs, achieving good performance in discriminating glaucomatous eyes from healthy eyes.
Devalla et al. 11 reviewed the role of AI in glaucoma diagnosis and prognosis, discussing the advantages and challenges of using AI systems in clinics and predicting potential areas of progress in the future in this field.
Another study, conducted by Ran et al. 23 , discussed the potential clinical impact of DL models and identified areas for future research.
In 2022, Hood et al. 24 described an automated method for detecting glaucoma without the need for a clinician’s judgment, using a simple anatomical artifact model to help distinguish artifacts from actual glaucomatous changes in OCT probability maps. In the same year, Li et al. 25 developed a deep learning system for the automatic detection of angle closure in AS-OCT images. The results showed that the deep learning system performed better compared to the one based on quantitative features.
Chaurasia et al. 26 conducted, in 2022, a meta-analysis to determine the overall performance of AI in glaucoma diagnosis and identify potential factors affecting their implementation. The results showed that AI algorithms performed well in detecting glaucoma.
The specialized literature contains various hybrid studies (functional and structural approaches) that have used artificial intelligence for diagnosing and managing glaucoma. The studies included various combinations of techniques, such as ANN, optical coherence tomography (OCT), standard automated perimetry (SAP), short-wavelength automated perimetry (SWAP), and confocal scanning laser ophthalmoscopy (CSLO).
As early as 1996, Brigatti et al. 27 used a two-layer back-propagation network to assign each eye an estimated probability of having glaucoma and correctly identified 88% of all eyes with 90% sensitivity and 84% specificity.
Another study conducted by Mardin et al. 28 used six different combinations of morphological data and visual field data to diagnose the disease, applying machine learning classifiers. The combination of Heidelberg Retina Tomograph (HRT), standard Octopus output (HRT/PERI1), and standard deviations (HRT/PERI2) achieved the highest sensitivity (95%) and specificity (91%).
Other studies 16 , 29 , 30 have investigated the use of structural and functional measurements, such as OCT and standard automated perimetry SAP, using machine learning classifiers to identify eyes with glaucoma with high accuracy. These studies have shown that the optimized combination of data can improve diagnostic accuracy. In addition, some studies have investigated the use of an ANN-based approach to differentiate the diagnosis of open-angle glaucoma from glaucoma suspicion without a visual field test 18 and found that this approach can be a cost-effective screening tool. Overall, these studies have shown that AI can be a powerful tool for diagnosing and managing open-angle glaucoma.
Modern AI algorithms are specifically adapted to extract significant features from complex and high-dimensional data for screening, diagnosis, management, and follow-up of glaucoma based on the interpretation of functional and/or structural parameters 12 , 31 .
Numerous other studies in specialized literature demonstrate the successful use of artificial intelligence tools in Ophthalmology, such as evaluating visual fields, optic nerves, retinal nerve fiber layers, thus providing better accuracy in identifying glaucoma progression and retinal changes in diabetes. The main advantages of using these techniques in medical diagnosis are: the ability to process large amounts of data, low probability of overlooking relevant information, and reduced time for diagnosing.
Singh et al. 32 , 33 , 34 , 35 , 36 have important contributions in identification of symptoms for glaucoma and glaucoma affected retinal images, using Machine Learning or Deep Learning Techniques. They show that important steps in applying machine learning techniques for automatic detection of glaucoma are retinal image acquisition, image preprocessing, feature extraction, classification of symptoms of glaucoma affected image, and evaluating the performance 33 . In order to overcome some difficulties related to conventional diagnostic methods utilized by ophthalmologists, Singh et al. 36 propose a computer-assisted diagnosis systems by using machine learning approaches to classify retinal pictures as “healthy” or “infected”. Different AI methodologies are explored for glaucoma detection: Differential Evolution based multi objective feature selection technique 32 , Particle Swarm Optimization 34 , 36 , Artificial Bee Colony, Binary Cuckoo Search, Random Forest, Support Vector Machine, used individually or in ensembles 36 . The efficiency of these methos has been proved by the obtained results—accuracy with value between 0.91 and 0.99.
The objective of the paper involves creating a database with medical records of glaucoma patients and formulating problems to determine relevant input and output parameters related to glaucoma progression. This includes selecting or developing suitable AI methodologies (artificial neural networks) and software, and comparing the effectiveness of different methods. Additionally, the results are compared with existing literature to highlight the benefits of simulations for glaucoma patients and ophthalmologists' decisions.
An important contribution of the research is the use of data from medical records, containing multiple information from investigations and visits, compared to most studies in the literature that address this topic and that use data from acquired images. The use of data from medical files allows the consideration of various information with possible influence in glaucoma. ANNs are developed using the NeuroSolutions and PyTorch frameworks. The best results are obtained in the second case, when the errors in the testing phase are very small, which gives credibility to the models and high chances that they can provide reliable and useful information to the specialist doctor. Therefore, the main original contribution of this work lie in the applied methodology, which includes extensive and diverse data extracted from the medical records of glaucoma patients, the formulation of problems to evaluate glaucoma progression, and the implementation of various neural network models using PyTorch .
The work is organized in the following sections: " Introduction ", experimental part that includes " Datasets " and " Modelling methodology ", " Results ", " Discussion ", " Conclusions " and References.
Most simulation approaches in the literature for studying glaucoma use data acquired from images. These have several advantages related to the fact that they are numerous and accurate since the images are obtained with high-performance devices, and any number of points desired by the user can be read from an image.
Much more difficult and, therefore, less used, is the collection of data from medical records, each entry representing a consultation and results of a whole set of tests. Time and accuracy are the major difficulties in building the dataset. However, once such a task is formulated and addressed, the advantages become evident through the information that can be obtained about the factors influencing the disease, its progression, and even the most suitable treatment.
In this paper, glaucoma, a chronic, progressive, irreversible, and multifactorial optic neuropathy, is analysed using data from medical records.
To create the dataset, medical records of glaucoma patients examined at Countess of Chester Hospital in the UK were used, and the study was retrospective, following patients who had at least three consecutive check-ups between 2018 and 2021 and underwent all necessary investigations to be included in the study. Precise inclusion and exclusion criteria 37 were established, and two distinct datasets were created.
Inclusion criteria for this study were: open-angle glaucoma or intraocular hypertension, with or without associated diabetes. Only patients who had the following investigations recorded at each of the three visits were selected: visual field assessment, macula and optic nerve OCT, intraocular pressure measurement on both eyes, visual acuity measurement, pachymetry, HbA1c measurement, and baseline IOP documented at the time of glaucoma diagnosis.
Criteria for the diagnosis of primary open-angle glaucoma (POAG) considered were: age over 40 years, IOP greater than 21 mm Hg without treatment at the time of diagnosis, open-angle in the anterior chamber upon gonioscopy, typical optic nerve damage in glaucoma (C/D ratio > 0.5), abnormal visual field (by Humphrey Field Analyzerperimetry), and retinal nerve fiber layer thickness impairment measured by Heidelberg OCT. Patients with ocular hypertension (OHT) were also included, with diagnostic criteria such as: age over 40 years, IOP greater than 21 mm Hg without treatment at the time of diagnosis, open-angle in the anterior chamber upon gonioscopy. These patients may have a normal visual field, normal optic nerve appearance (C/D ratio < 0.5), and normal retinal nerve layer thickness measured by OCT.
Our approach, based on modeling with artificial neural networks, starts with the following considerations regarding to normal values and deviations from them, for the quantities considered in the evaluation of glaucoma progression:
Mean Deviation (MD), with normal range greater than − 2 dB, measures the overall depression of the visual field. A value less than − 2 dB suggests abnormality, with more negative values indicating more severe loss.
Pattern Standard Deviation (PSD), with normal range close to 0 dB, indicates the irregularity of the visual field loss. Higher values suggest more localized defects; normal values are usually near 0, with higher values indicating glaucomatous damage.
Visual Field Index (VFI), with normal range of 100%, represents the percentage of normal visual function. Lower percentages indicate more significant visual field loss; normal values are near 100%, with lower values indicating more severe glaucoma.
Retinal Nerve Fiber Layer (RNFL), with normal range of 80–100 µm, is a critical indicator of glaucomatous damage. Values below the normal range suggest thinning due to glaucoma.
Intraocular Pressure (IOP), with normal range of 10–21 mmHg, is a significant risk factor for glaucoma. Values above 21 mmHg may indicate glaucoma or risk of developing it, although some patients with normal IOP can also have glaucoma (normal-tension glaucoma).
The medical investigations represented the 47 attributes, from which the inputs and outputs were selected for the modeling action, corresponding to the formulation of various problems through which the progression of glaucoma could be evaluated. Fifty patients were included in the database, each with three check-ups, resulting in 150 visits with 300 entries (for both eyes). These constitute the records or instances of the database. From this information, two datasets were formed: considering the visits of a patient as distinct records (dataset 1) and attributing these visits to the patient who performed them (dataset 2).
Compared to the modeling on dataset 1, where the values corresponding to each visit were considered as separate records (as if they belonged to different patients), in dataset 2 these values were attributed to the same patient, becoming additional inputs. The database thus configured includes 100 records (instances).
Various tasks were formulated in the sense of choosing different sets of input and output parameters because in this way there is the possibility of obtaining multiple and varied information. From this point of view, factors that may contribute to the progression of glaucoma were selected, such as: patient age, glaucoma age, intraocular pressure, central corneal thickness, phakic or pseudophakic status, as well as factors monitoring the severity of the disease: visual field values (VFI), mean deviation (MD), retinal nerve fiber layer thickness (RNFL). A binary encoding (0 and 1, Yes and No) was used to represent glaucoma progression. Inputs and outputs were different for different datasets, the distinct approaches aiming to obtain additional information about the studied conditions. Thus, modelling the dependence between functional and structural glaucomatous damage and common glaucoma risk factors was carried out in various ways, the results obtained providing information about the severity of the disease and recommended treatment. Alternatives for testing different influencing factors in glaucoma represent a study method of this condition, with possibilities to extract different information.
The tools used to monitor the evolution of glaucoma were artificial neural networks, designed using two methods: successive attempts with the NeuroSolutions program and an original implementation in PyTorch using the Python programming language.
Different types of neural models were tested, for which parameters that might influence the modelling results were varied: network topology, learning method, data partitioning into training and validation sets, transfer functions, the number of training epochs. The first model design method was based on trial and error , the error being evaluated at each variant, i.e., combination of parameters.
The first attempt to predict glaucoma progression using neural networks was based on the NeuroSolutions program, a specialized software product developed by Neurodimension . It allows the design, training, and validation of ANN models, as well as making predictions with them. Featuring a graphical user interface, the program can be easily operated by non-specialists who should nevertheless possess basic knowledge ANNs. It should be noted that the essential elements ensuring success in modelling are the quality of the dataset and the formulation of the task. Specifically, the data must be accurate, sufficiently large, and uniformly distributed across the investigated domain. In terms of task formulation, the inputs and outputs must be correctly chosen, considering the interdependencies and functional relationships between parameters.
A second methodology applied in this article is based on original programs written in Python using the PyTorch deep learning framework. PyTorch has implementations of several gradient-descent optimization algorithms, such as Adam (Adaptive Moment Estimation), RMSprop (Root Mean Square Propagation), or SGD (Stochastic Gradient Descent). In our case, the Adam algorithm was used. The parameters of the algorithm, such as the learning rate and regularization factor, should also be set. PyTorch has already implemented several loss such functions, but the choice here depends on the nature of the task. For example, for a classification task, the cross-entropy function can be used, while for a regression task, the mean square error can be used.
The training and prediction sections can be repeated a number of times to statistically estimate the performance of a combination of parameters. Both data partitioning into training and testing sets and optimization algorithm results are stochastic, so a statistical evaluation is beneficial.
In the case of both methods, different problems were formulated, aiming to track glaucoma progression through structural, functional, or combined (hybrid) parameters. By considering different input–output combinations, the attempts were made to highlight factors with significant influence on disease progression, these factors coming from data included in the patient files. In this way, through the predictions of neural models (credible predictions in the case of models with small testing errors), the ophthalmologist can have additional information and suggestions regarding the treatment to be followed.
The study was approved by the Ethics Commission of the University Hospital Sf. Spiridon Iasi, approval no. 38/24.04.2023 and Countess of Chester Hospital, Liverpool Rd, Chester approved no. 28.04.2023, in compliance with ethical and deontological rules for medical and research practice. The study was conducted in accordance with the Helsinki Declaration.
Informed consent was obtained from all subjects involved in the study.
Different tasks were formulated and solved on the two datasets, denoted 1 and 2, distinguished by differentiating the parameters corresponding to the three visits (dataset 2).
The following case studies were performed using dataset 1, which neglects the third visits.
Case study 1: modelling the dependence between functional and structural glaucomatous damage and common glaucoma risk factors. The factors that can contribute to glaucoma progression (patient age, glaucoma age, IOP, Base IOP, IOL, CCT) were selected as inputs and the variables that monitor the severity of the disease (VFI, PSD, RNFL) were selected as outputs. The lower the VFI, the higher the PSD, and the lower the RNFL values, the more advanced the glaucoma.
The testing plan included various neural network methodology options, evaluated by the mean square error ( MSE ) and the correlation coefficient ( r ). Specifically, we used neural networks with one or two layers and a variable number of intermediate neurons, different percentages for splitting data between training and testing sets (85–15%, 80–20%, 75–25%, 70–30%), training algorithms (backpropagation with momentum and Levenberg–Marquardt), and different numbers of training epochs (500, 2000, 10000, 20000).
An MLP(6:24:8:3) network (multilayer perceptron with 6 inputs and 3 outputs, and 2 hidden layers with 24 and 8 neurons) recorded very small training errors: an MSE ranging from 0.00012 (minimum) to 0.0163 (maximum), and an r ranging from 0.9493 to 0.99958. The average relative errors in training and testing phases for the three outputs were: 0.34% and 5.44% for VFI, 0.18% and 9.85% for PSD, and 1.96% and 14.79% for RNFL.
The results obtained are considered satisfactory in the context of formulating a complex task where the simultaneous prediction of three real-value outputs was sought: VFI, PSD, RNFL. But to increase the degree of confidence, other methods that improved the generalization capacity were further tested.
Case study 2: modelling the dependence between IOP, CCT, and the degree of visual field loss. In this study, a simpler model was sought with a single output, namely VFI. This parameter reflects the integrity of the visual field and extrapolates the degree of visual field loss in glaucoma. Three inputs were considered: baseline IOP, current visit IOP, and corneal thickness (pachymetry), as these three characteristics help to form an idea about the desired pressure control. The working parameters were: 75% of data for training and 25% for testing, the use of the Levenberg–Marquardt algorithm for training, the hyperbolic tangent ( tanh ) as the activation function, and different types of network architectures: multilayer perceptron, generalized feed-forward network, and Jordan-Elman network. The choice of the working characteristics for these models was made after comparing the results (i.e., errors) of successive trials.
The best ANN model was MLP(3:24:8:1) with an average percentage error of 0.20% in the training phase and 3.23% in the testing phase; these results can be appreciated as very good.
Figures 1 and 2 show the training and testing phases, respectively comparisons between VFI obtained from clinical observations and predictions of the best neural model.
VFI—comparisons between clinical observations and predictions of the MLP(3:24:8:1) network in the training phase.
VFI—comparisons between clinical observations and predictions of the MLP(3:24:8:1) network in the testing phase.
In Fig. 1 , corresponding to the training phase, the placement of the points on the line proves that the response of the neural network coincides with the VFI values obtained from clinical observations. Figure 2 reflects the fact that VFI obtained experimentally (from clinical observations, blue rectangles) has values close to those provided by the neural network (red rectangles). This being the testing phase, the good generalization capacity of the neural model is demonstrated, thus the high probability of predicting the evolution of glaucoma.
Case study 3: modelling the dependency between IOP, CCT, and the degree of optic nerve damage. Similar to the previous case study, the same inputs were maintained, namely baseline IOP, current visit IOP, and corneal thickness, and the output considered was the thickness of the retinal nerve fiber layers (RNFL), which reflects the degree of structural damage in glaucoma based on the same three inputs.
The best model, MLP(3:24:8:1), was obtained with MSE = 0.0000845, r = 0.9997, average training error = 0.11%, and average testing error = 5.44%, which also represent satisfactory results.
In this case, where RNFL was considered as the only output, the average testing error was 5.44%, compared to the modelling in case study 1, where RNFL was one of the three outputs, and the testing error was 14.79%. This improvement comes from changing the task formulation of mapping the inputs to outputs, which led to more accurate predictions.
Case study 4, inputs: patient age, patient sex, glaucoma age, diabetes age, HbA1c, B-IOP, IOP, IOL, CCT, output: VFI. The best model was MLP(9:36:9:1), obtained with MSE = 0.000001, r = 0.999984, and E p = 0.05%.
Case study 5, inputs: patient age, patient sex, glaucoma age, diabetes age, HbA1c, B-IOP, IOP, IOL, CCT, output: MD. The best model was MLP(9:36:9:1), obtained with MSE = 0.000004, r = 0.999933, and E p = 0.05%.
Case study 6, inputs: patient age, patient sex, glaucoma age, diabetes age, HbA1c, B-IOP, IOP, IOL, CCT, output: PSD. The best model was MLP(9:36:9:1), obtained with MSE = 0.000004, r = 0.999633, and E p = 2.088632%.
Case study 7, inputs: patient age, patient sex, glaucoma age, diabetes age, HbA1c, B-IOP, IOP, IOL, CCT, output: RNFL. The best model was MLP(9:36:9:1), obtained with MSE = 0, r = 1, and E p = 0.00265%. Figures 3 and 4 show graphical results for this case, specifically the training and testing phases for the best model. A correlation coefficient of 1 demonstrates that the model has well learned the relationships and patterns in the data (Fig. 3 ). In the testing phase, the r coefficient value is also close to 1, which gives credibility to the determined model (Fig. 4 ). The figures include the coefficient of determination R 2 as a performance metric, which is the square of the correlation coefficient r .
Experimental RNFL the predictions provided by an MLP(9:36:9:1) in the training phase.
Experimental RNFL and the predictions provided by an MLP(9:36:9:1) in the testing phase.
For cases studies 4–7, the presented results are very good, and the obtained models are relatively simple.
Dataset 2 includes information related to the progression of glaucoma in 50 patients aged between 50 and 94 years, 52% of whom are male, with a glaucoma history ranging from 0 to 28 years. In this case, the modelling was carried out under the following conditions. The input data considered were: VFI, MD, PSD, and RNFL, measured at each of the three evaluation visits for both eyes, and indexed as 1, 2, and 3. The output variable, glaucoma progression, was encoded as (1, 0) for “yes”(there is progression in glaucoma) and (0, 1) for “no” (there is no progression in glaucoma). Multilayer perceptron neural models were constructed with 12 inputs, 2 outputs, and one or two hidden layers of neurons. The number of neurons used in the hidden layers varied between 6 and 30. The tanh activation function and the backpropagation with momentum algorithm were used.
The best model, MLP(12:24:6:2), had the following performance in the training phase: MSE = 0.000223, r = 0.999782, and E p = 0.192070. For the testing phase, several results are given in Table 1 . The probability of a correct answer for the prediction of glaucoma progression was 93.3%, which is a satisfactory accuracy.
PyTorch is an open-source deep learning framework developed by Facebook’s AI Research lab. It provides a flexible and efficient platform for building and training neural networks. It supports computations on both CPU (central processing unit/computer’s processor) and GPU (graphics processing unit), which enables faster processing of large datasets. It has an intuitive design and a robust library of pre-built functions and models, which make it popular among researchers and practitioners in machine learning. One of its key features is the dynamic computation graph, i.e., a network where nodes represent mathematical operations and edges represent the data flow between these operations. This graph structure is essential for defining and optimizing complex computations in neural network models. Automatic differentiation is another fundamental feature of PyTorch . The “autograd” system automatically tracks all operations on tensors (multi-dimensional arrays) and enable the automatic computation of gradients during gradient-descent optimization such as backpropagation and its more advanced versions. By applying the chain rule to the computational graph, PyTorch efficiently calculates the derivatives needed to update model parameters. This capability simplifies the training process, making it more straightforward to implement and optimize deep learning models.
The first task to be solved uses dataset 2, the dataset where three visits were considered for a patient. In this case, there are 12 inputs: VFI 1 , VFI 2 , VFI 3 , MD 1 , MD 2 , MD 3 , PSD 1 , PSD 2 , PSD 3 , RNFL 1 , RNFL 2 , RNFL 3 , and the output of the model is represented by glaucoma progression, encoded by YES or NO. The configured dataset includes 100 records (instances).
The proposed architectures have two fully-connected layers with different number of neurons in the two hidden layers, using the tanh activation function. Since this a binary classification problem expressed using one-hot encoding, a softmax layer is used before the output. Softmax is a function that converts an array of real-valued numbers into a probability distribution.
The training algorithm is Adam (Adaptive Moment Estimation), a well-known optimization algorithm based on the principles of gradient descent. It computes individual adaptive learning rates for each network parameter using estimates of first and second moments of gradients. The specified learning rate is 0.001, which defines the size of steps taken to update the model parameters during training. A smaller learning rate, such as 0.001, implies smaller steps, often leading to more stable convergence. Weight decay is set to 10 −5 , serving as a regularization term during training. It helps prevent overfitting by adding a penalty to the model weights.
In order to determine the best architecture, fivefold cross-validation (CV) was implemented, meaning that in one iteration 80% of the data is used for training and 20% for testing. This methodology helps assess the generalization capabilities of the neural models. We also included a statistical approach of evaluating the architectures, running the CV process multiple times (in this case, 200 times). This decreases the influence of particular data splits in a single CV operation. The number of training epochs ranged between 50 and 100. It was observed that a larger number of epochs led to overfitting.
The best result was provided by a feedforward network, MLP(12:33:11:2), with two intermediate layers containing 33 and 11 neurons, respectively. The average error for the training phase was 0.09%, and 0.19% for testing, which represents a very good result.
After this process of identifying the best configuration, we used the process of splitting the data into 80% for training and 20% for testing, and selecting the model with the lowest testing error for prediction out of 20 repeated trials.
Another task to be solved with this method was modelling the evolution of glaucoma reflected by the values of the third visit. In this case, glaucoma progression was tracked by predicting the value of a specific parameter at the third visit of the patient included in the dataset. These parameters were, in turn, VFI 3 , MD 3 , PSD 3 , RNFL 3 , and IOP 3 . Considering 16 input sizes, 5 tasks were formulated and solved, corresponding to the mentioned outputs (Fig. 5 ).
Modelling glaucoma progression by predicting the results of the third visit.
The training methodology is similar, but in this case we are dealing with regression problems, therefore the architectures involve a fully-connected layer with 1 output instead of a softmax layer.
Table 2 displays the results of the runs, showing the best determined network along with the corresponding errors observed during the training and testing phases.
Next, some detailed results are presented, either in graphical format or in tables. For example, for MD 3 , Figs. 6 and 7 compare the experimental data (from the dataset) with those provided by the determined neural model, both for the training phase and for the testing phase, in an Microsoft Excel trendline format.
MD 3 experimental and obtained through neural modelling in the training phase.
MD 3 experimental and obtained through neural modelling in the testing phase.
In other words, comparing the experimental data with those provided by the best neural model involves evaluating the distance of the points from the straight line. The closer the points are to the straight line (or even on the line), it means that the values of the two datasets (experimental/investigations and prediction) are closer. The graphs also show the coefficient of determination R 2 whose value is close to 1.
The results presented in Table 2 (row 2) and Figs. 6 and 7 show that MD at the third visit can be approximated with an accuracy of 98.75% based on the values recorded at the previous visits.
For the PSD parameter (task 3 in Table 2 ), Figs. 8 and 9 show comparatively some of the training and testing data, this time through bar graphs.
PSD 3 experimental and obtained through neural modelling in the training phase.
PSD 3 experimental and obtained through neural modelling in the testing phase.
An accuracy of 99.25% for estimating PSD at the third visit represents a reliable prediction for this parameter.
For task 4, with the output being RNFL at the third visit, the comparison of the values from the dataset with those provided by the model (for a sample of data) is presented in table format (Table 3 ), which allows visualization and comparison of values for each pair of data.
As in the previous tasks, the RNFL prediction at the third visit can be made, based on the determined model, with very high accuracy, specifically 98.33%, which means a faithful estimation of the structural progression.
For the last task (noted 5 in Table 2 ), with the IOP output at the third visit, the experimental vs. NN comparisons are given in graphical form in Figs. 10 and 11 .
IOP 3 experimental and obtained through neural modelling in the training phase.
IOP 3 experimental and obtained through neural modelling in the testing phase.
Another proposed task consisted in developing a neural network model to check if, during the three visits, it was necessary to add more drops to control glaucoma or if surgical manoeuvres were needed to control pressure. Thus, 11 inputs were used: base IOP, IOP 1 , IOP 2 , IOP 3 , VFI 1 , VFI 2 , VFI 3 , RNFL 1 , RNFL 2 , RNFL 3 , and CCT, with a single output, TRATMOD (YES or NO): “YES” for the situation where it was necessary to add more drops to control glaucoma or surgical manoeuvres were needed to control pressure, and “NO” for cases that were stable.
The PyTorch program determined an MLP(11:25:2) model with an average training error of 0.40% and an average testing error of 0.70%, making only one wrong classification out of 100; thus, 99 instances were correctly classified.
For the first modelling methodology, namely determining neural networks through trial and error, different tasks were formulated, each type of modelling potentially contributing to obtain different information regarding disease progression and necessary treatment.
In these tasks, various types of neural models were tested, both structurally (one or two intermediate layers with different numbers of neurons) and parametrically (different transfer functions, training algorithms). Also, different variants (percentages) of data splitting into training and testing sets were tried, with performance evaluation in all cases based on errors (percentage, mean squared) or the correlation coefficient. Thus, the best model determination was done through trial and error.
For the tasks of dataset 1, a satisfactory generalization capacity was obtained, especially for the last four case studies containing a single output size, thus a simpler formulation.
Compared to the studies encountered in the literature addressing glaucoma through simulation using artificial intelligence tools, it is noted that these approaches use data extracted from OCT images 13 , 14 , 38 , 39 with relatively few parameters.
Considering the modelling results obtained on dataset 2 (which is, in fact, the complete dataset), namely one wrong answer out of 15 possible (95.33% correct answers), these are close to what other researchers have reported or even better. Shon et al. 40 predicted glaucoma progression based on visual field (VF) test information using neural networks and, although they had a much larger dataset than the one included in this study, they achieved 86.40% accuracy.
Shuldiner et al. 41 tested several artificial intelligence tools: support vector machine, neural networks, random forest, logistic regression, naïve Bayes, and hybrid models for predicting glaucoma progression, obtaining an accuracy of 72%. They included in the input data visual field parameters, MD (mean deviation), and PSD (pattern standard deviation). Logistic regression applied by these researchers to the available data highlighted the fact that the advanced age of patients and the high value of PSD can influence the rapid progression of glaucoma.
In recent studies, Anton et al. 42 , 43 demonstrated, using neural networks, that changes in visual field parameters, MD and PSD, are related to the influence of sleep apnoea syndrome on glaucoma.
Glaucoma causes visual disability, so it is crucial to find ways to predict its progression, enabling timely intervention to reduce its effects. Most existing studies in the literature rely on artificial intelligence tools to predict glaucoma progression based on spatial features embedded in fundus images 2 , 3 , 7 , 25 , 38 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 . All these studies demonstrate the ability of AI techniques to identify glaucoma and its progression from fundus images, suggesting that they can assist Ophthalmologists quickly and accurately. It can also be argued that artificial intelligence strategies can detect glaucoma progression earlier than conventional methods 48 , 51 . Most of these existing studies in the specialized literature, which are using fundus images report an accuracy of over 90% for predicting glaucoma progression. Compared to these, it is worth mentioning that the models developed in this paper use data collected from patients’ medical records.
Regarding the second modelling methodology, it included the implementation of a neural network design method, specifically a PyTorch program, which provides very good functional neural network models, i.e., network parameters. It is essential to note that very small errors were obtained during the testing phase, giving credibility to the models used in predicting glaucoma.
The program is flexible, allowing for the selection of the best values for the parameters; it works with: optimizer type, learning rate, weight decay, number of attempts, number of epochs, and data splitting into training and testing sets.
It was found that a larger network can provide better results; the same configuration, MLP(16:42:14:1), yielded very small errors in training and testing for all parameters for which predictions were made (VFI, MD, PSD, RNFL, IOP). The average testing errors were below 5%. A comparison can be made with previously reported results 37 obtained with the dedicated Weka machine learning software. In both cases, the same dataset (dataset 2) was used, and the same task was solved, answering the question of whether glaucoma had progressed, considering the same 12 inputs. The best result obtained with Weka was a MLP(12:8:1), which provided 92 correct answers out of 100 possible, so a relative error of 8%, compared to the network determined in PyTorch , with 99 correct classifications out of a total of 100 instances.
The PyTorch ANN models provided very good results for predicting the visual field parameters (VFI, MD, and PSD) based on previous visit investigations. In the literature, similar research 16 presents the possibility of making predictions for 24–2 visual field defects up to 5.5 years into the future. It is a complex approach, with a large number of parameters, based on deep learning neural networks that uses points from visual field images. Indeed, relatively small prediction errors are obtained, but, in our approach, the predictions for the visual field parameter values are smaller than those reported by Wen and colleagues 16 . Also, our methodology assumes the use of patient medical record data by a simple method.
When using AI models to analyze eye-related glaucoma illness datasets, several potential disadvantages and repercussions must be considered. The diversity of medical records means that more parameters may need to be considered for studying glaucoma progression than those offered by images alone. This paper uses such a diverse database as a challenge to find solutions that are accurate and methodologically sound. While it can be demonstrated that credible and useful results can be obtained with appropriate tools, several risks remain.
One significant risk is the potential for false diagnoses, including false-negative results, which can lead to missed diagnoses and delayed treatment. Such errors could have serious repercussions, including blindness if the glaucoma progresses untreated. If clinical decisions are based directly on AI system interpretations, the responsibility of the ophthalmologist becomes critical, necessitating the development of medico-legal protocols that involve both the clinician and the AI methods.
Additionally, there are limitations to using AI in clinical practice, such as patient mistrust in remote screening and doctors' dependency on technology. Despite these limitations, AI systems combined with ocular imaging in telemedicine could offer a cost-effective long-term solution to enhance screening efficiency and patient monitoring. This underscores the importance of integrating AI carefully and responsibly into medical practice to maximize benefits and minimize risks.
Glaucoma, a cause of irreversible blindness, represents a public health issue (global prevalence of 3.5%, affecting individuals aged between 40 and 80 years old and an estimation of 112 million cases worldwide by 2040). Early diagnosis and accurate monitoring of glaucoma progression are essential for controlling this disease and providing personalized treatment. In recent years, AI tools have been increasingly used for diagnosis, monitoring, and prognosis of glaucoma.
The initial trial and error method is simple but time-consuming. Moreover, it does not guarantee the determination of the best model. However, good results have been obtained, depending on the task formulated and the parameters considered.
Very good neural networks were obtained using the PyTorch deep learning framework. For various tasks, very small errors in training and testing, under 5%, were obtained. The networks can model both binary outputs, indicating whether glaucoma progresses, and real-valued outputs for variables that provide information on glaucoma progression (VFI, MD, PSD, RNFL, IOL). Predictions made by the PyTorch neural networks achieved over 98% accuracy for both functional (visual field parameters) and structural (retinal nerve fiber layer thickness) progression of glaucoma. This approach proved superior for developing efficient neural models to estimate the course of glaucomatous disease in clinical practice.
As future research directions, we propose testing the already developed software tools on additional datasets, as well as exploring other AI tools that are likely to be effective in simulation studies of glaucoma (for instance neuro-fuzzy technique).
The datasets used and analyzed during the current study, as well as the source code of the software, are available from the corresponding author on reasonable request.
Antón, A., Jordano, J. & Maquet, J. D. Sistema experto de diagnóstico de glaucoma. Archivos de la Sociedad Española de Oftalmologia 69 (1), 23–28 (1995).
Google Scholar
Bowd, C. et al. Relevance vector machine and support vector machine classifier analysis of scanning laser polarimetry retinal nerve fiber layer measurements. Invest. Ophthalmol. Vis. Sci. 46 , 1322–1329 (2005).
Article PubMed Google Scholar
Bowd, C. et al. Comparing neural networks and linear discriminant functions for glaucoma detection using confocal scanning laser ophthalmoscopy of the optic disc. Invest. Ophthalmol. Vis. Sci. 43 (11), 3444–3454 (2002).
PubMed Google Scholar
Simon, M., Alonso, L. & Alfonso, A. A hybrid visual field classifier to support early glaucoma diagnosis. Inteligencia Artificial Revista Iberoamericana de Inteligencia Artificial 9 (26), 9–17 (2005).
Hernández, G. E., Santos-García, G. & Inés, F. B. Identification of glaucoma stages with artificial neural networks using retinal nerve fibre layer analysis and visual field parameters. Innov. Hybrid Intell. Syst. 44 , 418–424 (2007).
Grewal, D., Jain, R., Grewal, S. & Rihani, V. Artificial neural network-based glaucoma diagnosis using retinal nerve fiber layer analysis. Eur. J. Ophthalmol. 18 (6), 915–921 (2018).
Article Google Scholar
Parsaei, H., Moradi, P. & Parsaei, R. Development and verification of artificial neural network classifiers for eye diseases diagnosis. in Proceedings of the 14th ICBME . 398–402 (2008).
Zhou, M. et al. Diabetes mellitus as a risk factor for open-angle glaucoma: A systematic review and meta-analysis. PLoS One 9 (8), e102972 (2014).
Article ADS PubMed PubMed Central Google Scholar
Anton Apreutesei, N. The influence of glaucoma on the ocular changes of diabetes. PhD thesis UMF Iași, (2015).
Anton Apreutesei, N. et al. Predictions of ocular changes caused by diabetes in glaucoma patients. Comput. Methods Progr. Biomed. 154 , 183–190 (2018).
Devalla, S. et al. Glaucoma management in the era of artificial intelligence. Br. J. Ophthalmol. 104 (3), 301–311 (2019).
Bizios, D., Heijl, A., Hougaard, J. L. & Bengtsson, B. Machine learning classifiers for glaucoma diagnosis based on classification of retinal nerve fibre layer thickness parameters measured by Stratus OCT. Acta Ophthalmol. 88 (1), 44–52 (2010).
Yousefi, S., Kiwaki, T. & Zheng, Y. Detection of longitudinal visual field progression in glaucoma using machine learning. Am. J. Ophthalmol. 193 , 71–79 (2018).
Guangzhou, A. et al. Comparison of machine-learning classification models for glaucoma management. J. Health Ing. 2018 , 1–8 (2018).
Bizios, D., Heijl, A. & Bengtsson, B. Trained artificial neural network for glaucoma diagnosis using visual field data: A comparison with conventional algorithms. J. Glaucoma 16 , 20–28 (2007).
Wen, J. C. et al. Forecasting future Humphrey visual fields using deep learning. PLoS One 14 , e0214875 (2019).
Article CAS PubMed PubMed Central Google Scholar
Sample, P. A. et al. Using machine learning classifiers to identify glaucomatous change earlier in standard visual fields. Invest. Ophthalmol. Vis. Sci. 43 , 2660–2665 (2002).
Sample, P. A. et al. Unsupervised machine learning with independent component analysis to identify areas of progression in glaucomatous visual fields. Invest. Ophtalmol. Vis. Sci. 46 , 3684–3692 (2005).
Goldbaum, M. et al. Comparing machine learning classifiers for diagnosing glaucoma from standard automated perimetry. Invest. Ophthalmol. Vis. Sci. 43 (1), 162–169 (2002).
Chan, K. et al. Comparison of machine learning and traditional classifiers in glaucoma diagnosis. IEEE Trans. Biomed. Eng. 49 , 963–974 (2002).
Christopher, M. et al. Retinal nerve fiber layer features identified by unsupervised machine learning on optical coherence tomography scans predict glaucoma progression. Invest. Ophthalmol. Vis. Sci. 59 (7), 2748–2756 (2018).
Article PubMed PubMed Central Google Scholar
Medeiros, F., Jammal, A. A. & Thompson, A. C. From machine to machine: An OCT-trained deep learning algorithm for objective quantification of glaucomatous damage in fundus photographs. Ophthalmology 126 (4), 513–521 (2019).
Ran, A. R. et al. Deep learning in glaucoma with optical coherence tomography: A review. Eye 35 (1), 188–201 (2021).
Hood, D. C. et al. Detecting glaucoma with only OCT: Implications for the clinic, research, screening, and AI development. Prog. Retin. Eye Res. 90 (9), 101052 (2022).
Article CAS PubMed Google Scholar
Li, F. et al. A deep-learning system predicts glaucoma incidence and progression using retinal photographs. J. Clin. Invest. 132 (11), e157968 (2022).
Chaurasia, A. K., Greatbatch, C. J. & Hewitt, A. W. Diagnostic accuracy of artificial intelligence in glaucoma screening and clinical practice. Glaucoma 31 (5), 285–299 (2022).
Brigatti, L., Hoffman, D. & Caprioli, J. Neural networks to identify glaucoma with structural and functional measurements. Am. J. Ophthalmol. 121 (5), 511–521 (1996).
Mardin, C. Y., Peters, A., Horn, F., Jünemann, A. G. & Lausen, B. Improving glaucoma diagnosis by the combination of perimetry and HRT measurements. J. Glaucoma 15 (4), 299–305 (2006).
Yousefi, S. et al. Monitoring glaucomatous functional loss using an artificial intelligence-enabled dashboard. Ophthalmology 127 (9), 1170–1178 (2020).
Nair, M., Tagare, S., Venkatesh, R. & Odayappan, A. Artificial intelligence in glaucoma. Indian J. Ophthalmol. 70 (5), 1868–1869 (2022).
Ittoop, S. M., Jaccard, N., Lanouette, G. & Kahook, M. Y. The role of artificial intelligence in the diagnosis and management of glaucoma. J. Glaucoma 31 (3), 137–146 (2022).
Singh, L. K. & Garg, H. Detection of glaucoma in retinal images based on multiobjective approach. Int. J. Appl. Evolut. Comput. 11 (2), 13 (2020).
CAS Google Scholar
Singh, L. K., Garg, H. & Pooja, A. Automated glaucoma type identification using machine learning or deep learning techniques. Adv. Mach. Intell. Interact. Med. Image Anal. 241–263 (2019).
Singh, L. K., Munish, K. & Shankar, T. A novel hybrid robust architecture for automatic screening of glaucoma using fundus photos, built on feature selection and machine learning-nature driven computing. Expert Syst. 39 , e13069 (2022).
Singh, L. K., Munish, K., Shankar, T. & Singh, R. Deep-learning based system for effective and automatic blood vessel segmentation from Retinal fundus images. Multimed. Tools Appl. 83 , 1–45 (2023).
Singh, L. K., Munish, K., Shankar, T. & Singh, R. Nature-inspired computing and machine learning based classification approach for glaucoma in retinal fundus images. Multimed. Tools Appl. 82 , 1–49 (2023).
Article CAS Google Scholar
Târcoveanu, F. E. et al. Classification algorithms used in predicting glaucoma progression. Healthcare 10 , 1831 (2022).
Elze, T. et al. Patterns of functional vision loss in glaucoma determined with archetypal analysis. J. R. Soc. Interface 12 (10), 1098 (2015).
Raja, C. & Gangatharan, N. Appropriate sub-band selection in wavelet packet decomposition for automated glaucoma diagnosis. Int. J. Autom. Comput. https://doi.org/10.1007/s11633-014-0858-6 (2015).
Shon, K., Sung, K. & Shin, J. Can artificial intelligence predict glaucomatous visual field progression? A spatial-ordinal convolutional neural network model. Am. J. Ophthalmol. 233 , 124–134 (2022).
Shuldiner, S. et al. Predicting eyes at risk for rapid glaucoma progression based on an initial visual field test using machine learning. PLoS One 16 (4), e0249856 (2021).
Anton, N. et al. Use of artificial neural networks to predict the progression of glaucoma in patients with sleep apnea. Appl. Sci. 12 (12), 6061 (2022).
Anton, N. et al. Assessing changes in diabetic retinopathy caused by diabetes mellitus and glaucoma using support vector machines in combination with differential evolution algorithm. Appl. Sci. 11 (9), 3944 (2021).
Wang, S. Y., Tseng, B. & Hernandez-Boussard, T. Deep learning approaches for predicting glaucoma progression using electronic health records and natural language processing. Ophthalmol. Sci. 2 (2), 100127 (2020).
Thompson, A., Jammal, A. & Medeiros, F. A review of deep learning for screening, diagnosis, and detection of glaucoma progression. Trans. Vis. Sci. Tech. 9 (2), 42–42 (2020).
Hemelings, R. et al. Accurate prediction of glaucoma from colour fundus images with a convolutional neural network that relies on active and transfer learning. Acta Ophthalmol. 98 (1), e94–e100 (2020).
Mirzania, D., Thompson, A. C. & Muir, K. W. Applications of deep learning in detection of glaucoma: A systematic review. Eur. J. Ophthalmol. 31 (4), 1618–1642 (2020).
Zafar, A. et al. A Comprehensive convolutional neural network survey to detect glaucoma disease. Mob. Inf. Syst. Hindawi 2022 , 3971516 (2022).
Mursch-Edlmayr, A. S. et al. Artificial intelligence algorithms to diagnose glaucoma and detect glaucoma progression: Translation to clinical practice. Trans. Vis. Sci. Tech. 9 (2), 55 (2020).
Belgacem, R., Malek, I. T., Trabelsi, H. & Jabri, I. A supervised machine learning algorithm SKVMs used for both classification and screening of glaucoma disease. N. Front. Ophthalmol. 4 (4), 1–27 (2018).
Li, Z. et al. Efficacy of a deep learning system for detecting glaucomatous optic neuropathy based on color fundus photographs. Ophthalmology 125 (8), 1199–1206 (2018).
Download references
This work was supported by Exploratory Research Project PN-III-P4-ID-PCE-2020-0551, no. 91/2021, financed by UEFISCDI Romania. Funding: Research Project PN-III-P4-ID-PCE-2020-0551, no. 91/2021.
Research Project PN-III-P4-ID-PCE-2020-0551, no. 91/2021.
Authors and affiliations.
Ophthalmology Department, Faculty of Medicine, University of Medicine and Pharmacy “Gr. T. Popa” Iasi, University Street No 16, 700115, Iasi, Romania
Filip Târcoveanu & Nicoleta Anton
Faculty of Automatic Control and Computer Engineering, “Gheorghe Asachi” Technical University of Iasi, 27 Mangeron Street, 700050, Iasi, Romania
Florin Leon
Department of Chemical Engineering, Faculty of Chemical Engineering and Environmental Protection “Cristofor Simionescu”, “Gheorghe Asachi” Technical University of Iasi, 73 Mangeron Street, 700050, Iasi, Romania
Cătălin Lisa & Silvia Curteanu
Faculty of Economic Science, “Vasile Alecsandri” University of Bacau, Calea Marasesti 156, 600115, Bacau, Romania
Andreea Feraru
Countess of Chester Hospital, Liverpool Rd, Chester, CH21UL, UK
You can also search for this author in PubMed Google Scholar
Conceptualization, N.A., F.T. and S.C.; methodology, N.A., F.T., S.C, F.L; software, formal analysis C.L, A.F; resources, data curation, validation F.T, N.A, F.L, S.C, K.A; investigation, F.T, K.A, N.A and F.L, visualization, supervision N.A, S.C; writing—original draft, writing—review and editing, N.A., S.C; project administration, funding acquisition S.C, F.L.
Correspondence to Silvia Curteanu or Nicoleta Anton .
Competing interests.
The authors declare no competing interests.
Publisher's note.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .
Reprints and permissions
Cite this article.
Târcoveanu, F., Leon, F., Lisa, C. et al. The use of artificial neural networks in studying the progression of glaucoma. Sci Rep 14 , 19597 (2024). https://doi.org/10.1038/s41598-024-70748-1
Download citation
Received : 10 May 2024
Accepted : 20 August 2024
Published : 23 August 2024
DOI : https://doi.org/10.1038/s41598-024-70748-1
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
By submitting a comment you agree to abide by our Terms and Community Guidelines . If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.
Sign up for the Nature Briefing: AI and Robotics newsletter — what matters in AI and robotics research, free to your inbox weekly.
Warning: The NCBI web site requires JavaScript to function. more...
An official website of the United States government
The .gov means it's official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you're on a federal government site.
The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.
NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.
StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing; 2024 Jan-.
Root cause analysis and medical error prevention.
Gunjan Singh ; Raj H. Patel ; Sarosh Vaqar ; Joshua Boster .
Last Update: February 12, 2024 .
The term "medical error" encompasses diverse events that vary in magnitude and can potentially harm the patient. According to the 2019 World Health Organization (WHO) Patient Safety Factsheet, adverse events due to unsafe patient care are among the top 10 causes of death and disability worldwide. However, understanding that healthcare delivery involves multiple variables in a dynamic environment with many critical decisions made quickly is essential to finding the underlying causes of adverse events. Reducing medical errors requires a multifaceted approach at various levels of healthcare. In the event of a sentinel occurrence or adverse patient outcomes, a thorough evaluation is warranted to prevent such events. Root cause analysis provides a method of assessment for these situations so that a system-based intervention can be implemented rather than blaming individual clinicians. Upon completing this activity, healthcare professionals will gain a comprehensive understanding that root cause analysis (RCA) is a mandated process for healthcare institutions to mitigate future errors and promote patient safety. By acquiring proficiency in RCA application and methodology, healthcare professionals can effectively drive changes and improvements within the healthcare setting, resulting in enhanced patient care and a reduction in medical errors. The course also highlights the interprofessional team's role in performing this analysis to prevent medical errors and improve clinical outcomes.
Medical error is an unfortunate reality of the healthcare industry and a continuously discussed topic due to its grave impact on patient care and outcomes. In a 1999 publication by the Institute of Medicine (IOM), it was highlighted that deaths resulting from medical error exceeded those attributed to motor vehicle accidents, breast cancer, or AIDS. [1] One study reported that approximately 400,000 hospitalized patients experience some preventable harm each year, while another estimated that >200,000 patient deaths annually were due to preventable medical errors. [2] [3] [4] Moreover, the reported cost of medical errors is wide-ranging, with some experts estimating healthcare costs of $20 billion each year, while others approximate costs of $35.7 to $45 billion annually from hospital-acquired infections alone. [2] [3] Subsequent reports that discuss potential etiologies of medical errors have blamed systemic issues. Others have focused attention on certain groups of patients that may be more vulnerable to medical error than others. [5] [6] Recently, the impact of medical errors on a patient's family members and healthcare professionals has been emphasized due to its effects on exacerbating burnout, poor work performance, mental health decline, and even suicidal ideation. [7] [8]
Though pinpointing the definitive cause of medical error in certain situations may be challenging, evaluating strategies that can be used to mitigate and prevent these adverse events from occurring in the first place is essential. One such method is root cause analysis, which has been shown to reduce clinical and surgical errors in various specialties by establishing a quality improvement framework. [9] This article will discuss the application of root cause analysis in medical error prevention and strategies for maintaining continuous quality improvement in the healthcare setting.
Sentinel Events and Root Cause Analysis
The Institute of Medicine defines a medical error as "the failure of a planned action to be completed as intended or the use of a wrong plan to achieve an aim." [1] Recognizing the differences between medical malpractice and medical error is essential. An adverse event in a healthcare setting may be attributed to medical error and not meet the threshold of malpractice or negligence. Medical errors generally result from the improper execution of a plan or improper procedural planning. Thus, the complexity of the occurrence of a medical error can range widely and manifest in any aspect of patient care, from hospital admission to discharge, as well as the outpatient setting. Medical errors may occur without directly harming the patient; however, even in these instances, evaluating the cause of any medical error, whether or not the patient is harmed, and developing guidelines and strategies to prevent future occurrences is critical. [10] [11]
The Joint Commission defines a sentinel event as any unexpected adverse event "involving death, serious physical or psychological injury, or the risk thereof. The phrase 'or the risk thereof' includes any process variation for which a recurrence would carry a significant chance of a serious adverse outcome." Sentinel events indicate the need for an immediate investigation to discover the cause and develop corrective measures. Moreover, the Joint Commission reviews all sentinel events that have resulted in unexpected mortality, significant permanent harm, or severe, temporary harm requiring intervention to sustain life, which they require all member healthcare agencies to report. [12] [13] These events are not only debilitating to patients but can also impact the livelihood of healthcare providers. Sentinel events are unrelated to the patient's underlying medical condition but are attributable to improper medical intervention or improper technique. For instance, if a patient receives medication and experiences an anaphylactic reaction, clinicians must determine whether the reaction was due to the medication or failure to review the patient's allergies before administration. Thus, these cases must be critically reviewed to delineate whether or not the etiology of the error was preventable, which is often a challenging task.
Root cause analysis (RCA) is a process for identifying the causal factors of a medical error that may result in a sentinel event. A standardized RCA process is mandated by the Joint Commission to determine the cause of medical errors and thus allow healthcare institutions to develop strategies to mitigate future errors. [13] Despite broad adoption in the business, engineering, and industrial sectors, RCA use in the medical field has been limited. The RCA process aims not to assign individual blame but to identify lapses in system-level processes that can be restructured to prevent patient harm and reduce the likelihood of future sentinel events. Thus, identifying the root cause of a medical error can better direct the need for additional training and resources.
Applying Root Cause Analysis
For accreditation purposes, the Joint Commission requires that healthcare institutions have a comprehensive process for systematically analyzing sentinel events. The RCA process is one of the most commonly utilized tools for this purpose. Through the RCA process, healthcare institutions attempt to identify all the contributing factors that led to an adverse event. Essentially, RCA investigations continually question why a medical error occurred until all underlying deficiencies in a system are found. RCA emphasizes lapses in system-level processes rather than individual actions. Following a sentinel event, a designated RCA team must be assembled to review and identify necessary changes at the systematic level that can improve performance and reduce the likelihood of a repeat sentinel event. [14] Failure to perform an RCA within 45 days of a sentinel event may result in the healthcare institution being placed on an accreditation watch, which is public information. Repeat violations may result in an onsite review by the Joint Commission that may jeopardize accreditation. [15]
An RCA's initial step is forming an interprofessional team to investigate and define the problem. Typically, a designated process is implemented to communicate with senior leadership throughout the investigation, establish internal target dates, and meet Joint Commission deadlines. After identifying the problem, the team should evaluate systematic factors contributing to the error. Throughout the process, collecting data regarding the potential underlying causes is essential. The team should propose and implement immediate changes so that a repeat sentinel event does not occur during the RCA process. While developing these interventions, the team should evaluate the list of root causes, consider their interrelationships, and explore risk-reduction and process improvement strategies to prevent future errors at the systematic level. Furthermore, the team should discuss the proposed process modification with senior leadership and key stakeholders and determine if they are acceptable. There are various models used to guide RCA inquiries. One model is referred to as "The Swiss Cheese Model." According to this framework, errors occur due to failures on 4 primary levels, classified as unsafe acts, preconditions for unsafe acts, supervisory factors, and organizational influences that can allow patient injury when lined up. Therefore, RCA teams work to identify breakdowns on each of these levels that led to an adverse event. [16]
The Joint Commission has also created a framework with a series of 24 questions to organize an RCA and as a general template to prepare the report submitted to the Joint Commission. The 24-question guide considers various situational factors that may have contributed to a sentinel event. This includes examining the systematic process, human factors, equipment malfunctions, environmental factors, uncontrollable external factors, organizational factors, staffing and qualifications, contingency plans, performance expectations, communication issues, and technology. [13] With detailed consideration of each of these topics, an in-depth analysis of the cause of the sentinel event can occur. Communication is one factor examined in several of the 24 questions, including communication within organizational structure, conveying messages effectively and efficiently, and ensuring a proper communication system. Environmental factors should also be examined to determine if any situational issues were ongoing during the sentinel event that may have impacted the outcome. Moreover, staffing is another issue that should be examined during an RCA review to determine if the staff were appropriately qualified, competent, and portioned for their assigned duties. [17]
After discussion, evaluation, and analysis, corrective actions should be developed, identifying areas for targeted improvement. While utilizing the 24-question framework, causative etiologies should be considered to help determine areas that can be restructured to reduce risk. The root cause analysis should be clear and precise while providing appropriate depth and scope. The Joint Commission has identified a series of adverse events subject to their purview. Primarily, this would be a sentinel event that has resulted in death or permanent loss of function unrelated to any underlying medical conditions, including: [17]
The finalized RCA report must follow a set standard to meet the Joint Commission's requirements, including:
Case Illustrations with Root Cause Analysis Interventions
The following cases illustrate various types of medical errors, the process of root cause analysis through which failures were identified, and how interventions were implemented in each situation to prevent similar errors in the future.
Case example 1
A 42-year-old primigravida woman at 34 weeks gestation was brought to the obstetric emergency department at midnight with complaints of severe headache, blurry vision, and right upper quadrant pain for the last 5 to 6 hours. She noted lower extremity edema and facial swelling that was gradually increasing. She has gestational hypertension and, 1 week ago, was prescribed labetalol 200 mg twice a day. On initial presentation, her blood pressure was 190/110 mm Hg on 2 separate occasions, 5 minutes apart. She had gained 2 kilograms since her last antenatal checkup in the clinic a week ago. The patient was diagnosed with severe preeclampsia. The senior obstetric resident ordered a loading dose of magnesium sulfate to prevent imminent seizure. The hospital protocol used an intravenous (IV) and intramuscular (IM) regimen where the patient received a 4 g IV bolus and a 10 g IM dose administered as 5 g in each buttock. The senior resident gave verbal orders for magnesium sulfate administration to the junior resident, who verbally communicated the order to the nurse.
The magnesium sulfate dosing regimen was complex, with multiple doses in different locations, and was incorrectly prepared by the nurse who felt rushed in an urgent situation. Because the chart displaying magnesium sulfate's preparation in the drug preparation room had faded, the nurse relied on her memory. As part of the protocol, the nurse recited the dosage to another nurse, who cross-checked it from a printed chart and noted the error in time. The senior resident also identified the error as the dose was communicated aloud, and the drug administration was stopped.
Case example 2 (The name and date of birth used in this example are for illustrative purposes and do not represent an actual patient. Any similarities if noted, are purely coincidental.)
Anna Joy, date of birth October 30, 1991, was a primigravida at 30 weeks gestation admitted to a busy obstetric ward with complaints of intermittent cramping abdominal pain. She had come from Spain to visit her sister, who was living in Boston. The patient's ability to communicate in English was limited, preferring to speak Spanish. However, her husband and sister were fluent in English and assisted with translation throughout the history, exam, and admission. The patient was seen by an obstetrician who advised routine threatened preterm labor evaluation and observation.
Another patient, Ann Jay, date of birth September 30, 1991, was 34 weeks gestation and admitted to the same ward for gestational diabetes mellitus with hyperglycemia. A consulting endocrinologist advised glucose monitoring and insulin administration. The nurse taking care of the patient was given orders, performed a finger-stick blood glucose check, and informed the endocrinologist about the results over the phone. The endocrinologist advised 6 units of regular insulin before lunch. After being told by the nurse that the patient was feeling decreased fetal movement, the admitting obstetrician recommended ongoing observation and fetal kick counts.
The family members of the first patient, Anna Joy, informed the nurse that they were going to lunch. The morning shift nurse later required a half-day leave because of personal issues and quickly handed her patients to another nurse. The ward was busy and running at full capacity. The new nurse decided to give the insulin injection first as the patient was about to receive her lunch. She did not know that Anna Joy preferred communication in Spanish. The nurse asked a few questions and rushed through patient identification with the help of 2 unique patient identifiers. She administered the insulin injection to the first patient, only realizing later that the insulin was supposed to be given to the second patient, Ann Jay. The attending obstetrician and the endocrinologist were informed. They took the necessary measures and closely monitored the patient for the next few hours; however, no adverse effects were noted.
Case example 3
A 26-year-old primigravida at 39 weeks gestation with no associated high-risk factors was admitted to a busy labor and delivery floor with labor pains. The patient was managed according to routine labor protocol. When the patient had reached a cervical dilatation of 4 cm, the cardiotocograph showed prolonged fetal bradycardia lasting for 3.5 minutes, which did not resolve with conservative interventions. The patient was transferred to the operating room for an emergent cesarean section. The baby was delivered in good condition, with no intraoperative complications. Before closure, the operating obstetrician asked the scrub nurse to perform a surgical count. The scrub nurse reported a missing gauze piece from the surgical trolley. Therefore, the scrub and the floor nurses performed additional counts several times. A second on-call obstetrician was summoned to assist the primary surgeon in checking the surgical field for the missing gauze piece. The surgical gauze had a heat-bonded barium sulfate marker embedded in the fabric to help with x-ray identification. An intraoperative x-ray was obtained to evaluate for a retained sponge, and the results were negative. After discussing the case with the department chief, the abdomen was closed. Due to the associated delays, the operative time was significantly lengthened, totaling 2 hours and 30 minutes.
Case example 4
A 25-year-old man presented for bilateral LASIK surgery at a same-day surgery center. The operating surgeon, a community-based surgeon not routinely operating at this facility, examined the patient, and informed consent was obtained preoperatively. The refractive error was -4 D for the right eye and – 5 D for the left eye. The plan was to remove the refractive error altogether. There was a timeout to ensure the correct patient and procedure. The LASIK procedure commenced by creating corneal flaps on both eyes, which was completed uneventfully. Then, the patient was adjusted on the operating microscope so that the first eye was directly under the excimer laser, and iris recognition was attempted before the laser-guided corneal power correction was performed. Though the machine did not recognize the iris pattern after 3 attempts, the surgeon decided to proceed. The technician thought this was rare as they had good iris recognition rates of >98% this month. However, he did not want to contradict the surgeon. Before the procedure, the circulating nurse noted that the patient's table was adjusted to the wrong side with the left eye under the laser instead of the right. She pressed the emergency stop button, and the treatment was terminated. After identifying the mistake, the surgeon and technician restarted the machine to treat the correct eyes in the correct sequence.
Case example 5
A community clinic treats approximately 110 patients daily. The clinic is run by 2 primary care physicians, with the assistance of 2 nurses and scribes. A 10-year-old boy was brought to the clinic by his parents due to a runny nose for the last 10 days. On examination, the primary care physician diagnosed allergic rhinitis and advised them to use over-the-counter cetirizine. One of the scribes had called in sick that day, so a secretary was assisting the physician. The physician advised the parents that cetirizine is an over-the-counter medication that could be obtained at their pharmacy of choice. After 2 days, the patient's mother returned to the clinic and reported that the child was lethargic. The clinic front desk staff told the mother they would convey this to the physician, who was very busy that day. The physician instructed the staff to inform the parents that somnolence was typical for children taking cetirizine and to keep the child at home for the next few days. The message was conveyed to the mother, who decided to take the child to another specialist as she was concerned by the sedation. The specialist noted that the child was taking a 10-mg cetirizine tablet twice a day, which is double the recommended amount.
Case example 6
All-Eyes Laser Center is a busy same-day ophthalmic laser center that performs multiple laser procedures daily but specializes in retinal and anterior segment lasers. A 60-year-old man, JM, suffered from chronic angle-closure glaucoma and had been advised to undergo a Yttrium-Aluminum-Garnett (YAG) laser iridotomy, which involves creating a small hole in the peripheral part of the iris to increase the aqueous flow between the anterior and the posterior chamber. This treatment is frequently performed to prevent an angle-closure attack and further glaucoma progression. This laser surgeon also does another laser procedure called a YAG capsulotomy in which the posterior capsule in a pseudophakic eye is lasered to create an opening to improve vision impaired by after-cataract posterior capsular opacity. The YAG laser device platform allows both procedures to be performed with one machine.
The day JM was scheduled for the YAG procedure was unusually busy at the laser center, and the surgeon was running behind schedule. There were 5 patients ahead of JM, and an approximately 2-hour delay was anticipated. With each patient, the typical practice before a YAG iridotomy procedure consisted of the nurse practitioner checking the patient history, confirming examination findings, and instilling 2% pilocarpine eye drops to cause constriction and ensure good exposure of the peripheral iris crypts. The laser surgeon would then perform the procedure, directing the laser to create a small iridotomy.
After JM was taken to the procedure room, a proper timeout was confirmed, including the correct eye and procedure. However, when the patient was positioned at the laser machine, the surgeon noticed that the pupil was dilated rather than constricted. The surgeon again verified the patient's tag and name and the correct procedure. Though the patient and the procedure were both determined to be correct, the surgeon believed attempting an iridotomy on a dilated pupil would be dangerous. Therefore, the procedure was not performed, and the patient was transferred out of the laser suite. The patient was informed of the error and instructed that he would be rescheduled for the correct procedure in a few days. The error was attributed to the nurse administering the wrong eye drop, secondary to high patient volume and practice inconsistencies.
The IOM identifies medical errors as a leading cause of death and injury. [1] According to the 2019 World Health Organization (WHO) Patient Safety Factsheet, adverse events due to unsafe patient care are among the top ten causes of death and disability worldwide. Preventable adverse events in the US cause an estimated 44,000 to 98,000 hospital deaths annually, which exceeds motor vehicle collision deaths. [1] Furthermore, in terms of health care, disability, and loss of productivity, medical errors are estimated to cost the community an additional 37.6 to 50 billion dollars. [1] The most severe consequences of medical errors are the adverse events patients and their families suffer. Therefore, utilizing RCA is critical to identify systemic flaws that led to a medical error so that corrective measures can be promptly implemented.
Types of Medical Errors
Healthcare professionals should be familiar with the different types of medical errors to understand better the adverse events that may be caused. Errors are not always due to human miscalculation or miscommunication, as outlined by the cases above. Some errors are inherent to clinical situations, such as patient falls in hospital settings and healthcare-associated infections. Common types of medical errors include surgical errors, diagnostic errors, medication errors, equipment failures, patient falls, hospital-acquired infections, and communication failures. [3] [18]
RCA helps healthcare organizations study events that resulted in patient harm or undesired clinical outcomes and identify strategies to reduce further medical errors and improve patient safety. Clinician participation in root cause analysis is vital as these initiatives recognize and address essential patient care aspects. Through a review of data gathered by the Joint Commission, the most common categories of clinical error resulting in patient death, which can be prevented through root cause analysis, have been identified. These sentinel events, which account for a significant proportion of morbidity and mortality within the hospital setting, include: [13]
Medical Error Prevention Measures
By identifying the deficiencies, failures, and risk factors that lead to an adverse event, corrective measures can be developed to prevent similar errors. Subsequently, individuals involved in every aspect of healthcare can help implement appropriate preventative strategies to reduce future medical errors and improve patient safety. [17] The following interventions are some strategies institutions have implemented to address these common systemic flaws.
Surgical Errors
Preventative measures for surgical errors have frequently consisted of adopting checklists, counting instruments, initiating antibiotic prophylaxis for deep vein thrombosis, and utilizing radio-frequency marked sponges. [3] Additionally, the performance of a surgical time-out has become a widespread strategy to reduce surgical errors. A time-out is a pause before a surgical procedure begins. The surgical team pauses and reviews the patient's identity, the consent form, the procedure being performed, and the correct anatomical structures and side involved, which should be marked on the patient's skin. If multiple procedures by separate surgical teams are planned, separate time-outs must be done. Surgeons and every surgical team member involved in the procedure must be present during the time-out, and any disagreement during the time-out should trigger an investigation by the surgical team until the discrepancy is resolved. [33]
Wrong-site surgery is a major cause of medical errors that can be mitigated through various preoperative safety checkpoints and has been the subject of a sentinel event alert by the Joint Commission. [13] [34] These errors have most commonly been noted in orthopedic surgeries. [35] Risk factors include several surgeons involved in surgical care or transfers to another surgeon for patient care, multiple procedures on a single patient, time constraint pressures, and unique circumstances requiring unusual or special positioning during a surgical procedure. [34] Wrong-site surgeries can easily be mitigated by ensuring proper preoperative measures, such as labeling the correct surgical site with an indelible pen or distinctively marking the nonsurgical site before the surgery. Intraoperative radiography can also assist in aiding the correct surgical site during the procedure.
Diagnostic Errors
Diagnostic errors such as misdiagnoses, delayed diagnostic test results, lack of staffing or physician availability, delays in order fulfillment, inadequate treatment, and delays within the emergency department can cause delays in medical treatment that may result in patient death and permanent injuries. Reducing diagnostic errors requires a comprehensive approach that implements various strategies due to the many factors that can lead to these errors. System-based safety checks and cognitive aids are often recommended as interventions to help prevent diagnostic errors. Cognitive aids include algorithms to help guide decision-making based on accepted guidelines, "trigger tools" within electronic health records that remind clinicians to consider differential diagnoses for commonly misdiagnosed conditions, and checklists to prevent the omission of critical steps. [11] [36] According to a 2015 New England Journal of Medicine article, trigger tools are essential in reducing this type of medical error. [36] Trigger tools are electronic algorithms that identify potential adverse events. This is accomplished by searching electronic health records and flagging specific occurrences. [36] The use of cognitive aids and trigger tools has been shown to decrease the rate of misdiagnoses in recent studies. [36] Addressing deficiencies through various other strategies (eg, device-based decision support, simulation-based training, and increased specialist utilization) may also help reduce diagnostic errors. [24] Though ingrained practice methods and physician overconfidence can attenuate the success of these interventions, fostering critical thinking and promoting "pause and reflect" methods have been found to help avert diagnostic errors, especially in cases with obscure clinical findings or unexpected clinical trajectories. [37] [25] Aside from encouraging critical thinking, opportunities for case discussions and second opinions should be made available for the treating providers. Healthcare facilities should also provide avenues for second opinions or interdisciplinary teams where cases can be discussed. [37] Other interventions to reduce diagnostic errors of commonly misdiagnosed conditions include simulation-based training, performance feedback, and encouraging the contributions of nurses, pharmacists, and other health professionals during patient care. [24]
Patient Suicide
Patient suicide is an unfortunate cause of death commonly seen in psychiatric care settings. [13] Several risk-reduction methods can be implemented for this adverse event, including ensuring a controlled environment free of hazardous materials, frequent patient observation, effective communication, adequate staffing in the facility, suicide assessment upon admission, regular psychiatric evaluation, and assessment for the presence of contraband.
Medication Errors
Medication administration errors are a common and avoidable adverse event that can occur at various patient care levels, involving many individuals in a multidisciplinary patient care team. [38] Barcode administration and handheld personal digital assistants increase medication administration safety by providing real-time patient information, medication profiles, laboratory values, drug information, and documentation. Moreover, electronic medication administration helps identify incorrect medications and orders that have been canceled or modified. However, circumventing barcode procedures decreases safety at the point of care. Automatic dispensing systems that quickly make drugs available to patients allow pharmacy clinicians to engage in other safety activities, such as medication reconciliation. Additionally, look-alike medications should be stored away from more dangerous medications. Hospitals can also standardize storage areas and avoid medication containers that have a similar appearance. Pharmacy clinicians should remove dangerous medications from floor stock and discard out-of-date drugs as a preventative measure. Other strategies include using color-coded intravenous lines, utilizing standard concentrations of vasoactive agents, labeling syringes immediately after preparation, and capitalizing the differences on the labels of medications with similar names. [11] [3]
Equipment Errors
Health professionals should be involved in setting and evaluating institutional, organizational, and public technology-related policies. Safety primarily can be improved by developing protocols for equipment maintenance, training, monitoring, and reporting adverse events related to technology. Additionally, clinicians should be educated in remaining vigilant despite clinical assistance by devices and able to manage equipment failure situations. [39] Unique connectors for anesthesia catheters and feeding tubes can be used to reduce the chances of tubing misconnections. [40] Furthermore, clinicians and support staff should always trace lines back to the origin before connecting or disconnecting devices or starting infusions and labeling high-risk catheters. [27] [28]
Hospital-acquired Infections
Changing the behaviors of healthcare team members is effective in reducing iatrogenic infections. Hand hygiene campaigns have been shown to decrease the number of nosocomial infection rates for various infections and should be universally endorsed. [41] Most healthcare facilities now employ specific protocols for minimizing central venous and urinary catheter use and using protective measures such as chlorhexidine for vascular catheter site care to reduce the incidence of healthcare-associated bloodstream infections, ventilator-associated pneumonia, and catheter-associated urinary tract infections. [3] Minimizing the duration of use of indwelling catheters has also effectively reduced the incidence of associated infections. [41] [3]
To decrease the risk of nosocomial infections, pharmacy-driven antibiotic stewardship programs should be regularly employed in all patients admitted to a healthcare facility. [42] Frequent skin assessment and evaluation by wound care teams with regular and focused nursing education and evidence-based treatments should be routinely employed to lower healthcare-associated pressure injuries. [43] The care of surgical sites should follow similar protocols, with some studies proposing chlorhexidine-impregnated dressings to decrease the incidence of surgical site infections. [3]
Patient Falls
Similarly, patient falls are a constant source of injury within healthcare facilities. Patients at high risk for falls should be identified, and appropriate safety precautions should be taken. Elderly patients tend to be prone to falls due to their age-related changes in vision or cardiovascular problems. Elderly patients also frequently have increased balance issues and muscle weakness over time, leading to ambulatory dysfunction. Having fall-prevention protocols in place, identifying potential high-risk areas within the home, and mitigating them through safety measures can improve patient safety and outcomes. [13]
Standardized protocols can reduce fall rates by ensuring a safe environment for risk-prone patients. Patient factors contributing to falls include advanced age, mobility impairment, and postsurgical effects. [31] Inadequate nurse staffing, an increased portion of staff made of new nurses, and increased shift hours are organizational factors that can lead to patient falls. [31] Implementing fall prevention protocols in hospitals and long-term care facilities has significantly reduced these errors. Furthermore, standardized fall risk assessments such as the Morse Fall Scale can decrease patient falls. [3] Institutional interventions such as staff education, patient mobility training with rehabilitation professionals, and nutritionist support have also been shown to reduce patient falls. [3] Other strategies include identifying patients at high risk for falls, providing patient safety companions, educating caregivers about fall prevention, and setting bed alarms and frequent safety rounds for all high-risk patients. [3]
Communication Errors
A courteous and respectful workplace where the interprofessional team collaborates promotes a safe work environment for all healthcare team members, families, and patients. Risk management committees and interprofessional task forces should work collaboratively on risk assessment and reduction. Joint education programs help providers and support staff learn roles and develop relationships to improve safety. The Joint Commission's Safety Goals require that for critical test results and verbal or telephone orders, a "read-back" verbatim to the practitioner by the person receiving and recording the result or order. The practitioner should then verbally acknowledge the accuracy of the order. [11]
Additionally, healthcare staff should avoid common errors in written communication, such as using nonstandard abbreviations, illegible handwriting, failure to question inappropriately written orders, and failure to complete correct specimen labeling. Therefore, staff should be encouraged to ask questions when uncertain and trained to double-check that the patient's name is spelled correctly and their correct date of birth is present. The Joint Commission requires healthcare professionals to use 2 or more patient identifiers when labeling, delivering, and maintaining specimens. Since this is a National Patient Safety Goal, The Joint Commission closely monitors healthcare institutions' adherence to this requirement as they prepare medications and transfusions and transfer patients from unit to unit. [11]
Clinicians should also follow well-communicated protocols that guide care and communication with patients. Age-associated hearing and cognitive decline increase the likelihood of communication errors regarding medications. Ensuring appropriate communication skills tailored to distinct patient groups is crucial in preventing such errors. Young children and infants are similarly prone to common medical errors due to the lack of direct participation in decision-making and patient care. Thus, specialized communication is needed to convey medical instructions to elderly and younger patients and their caregivers to ensure no lapses in communication. Providers should listen to patients' questions concerning how care is delivered. Concerns must be respected and accepted if care plans contradict established evidence-based medicine. Moreover, the Joint Commission has supported "speak up" initiatives, which encourage hospitals to inform patients about the importance of their contributions to the care they receive in preventing medical errors. To make patients active participants in avoiding medical errors, encourage patients to ask about unfamiliar tests, unplanned diagnostic tests, and medications and to verify the correct surgical site. [11] Additionally, skilled medical interpreters can be crucial in effectively communicating instructions and information to patients instead of family members, who may often be biased. Implementing standardized clinician-family communication at the patient bedside with family engagement and bidirectional communication also decreased the frequency of harmful medical errors and positively impacted the family experience. [44]
Communication errors during patient hand-offs can occur when incorrect information is passed to the receiving clinician, or pertinent information is omitted. [45] Several techniques developed to minimize errors when handing off patients include using electronic records and mnemonics (eg, situation, background, assessment, and recommendation [SBAR]) to address all pertinent information. [46] [47] The SBAR tool is considered a best-practice communication technique to deliver information in an organized and logical fashion during hand-off and critical patient care situations. [47] The US's National Academies of Sciences, Engineering, and Medicine also recommend that these hand-offs occur in real-time and allow the opportunity to ask and respond to questions regarding pertinent facts about patient care. [48] This principle should be used when discharging patients from the hospital as well. Clinicians should remember to perform a final bedside evaluation and review discharge instructions before sending any patient home, including giving the patient a thorough written follow-up plan, counseling on new medications, and instruction to return to the hospital or office for new or worsening symptoms.
Medical errors are undeniably an essential cause of patient morbidity and mortality within the United States healthcare system. These errors are prevalent at rampant levels, and the consequences of such errors can severely impact the patient, family members, and clinicians. The interprofessional healthcare team plays an invaluable role in preventing medical errors; team effort is crucial in identifying strategies and solutions to reduce the burden of medical error on the healthcare system. Nurses, pharmacists, rehabilitation professionals, nutritionists, and physicians are integral to the patient care team and crucial in preventing medical errors. Practitioners who work in error-prone environments must recognize their roles as healthcare team members responsible for reducing unnecessary errors. [49] The interprofessional team members comprising the RCA team should include professionals from all disciplines to ensure an effective investigation and implementation of corrective measures.
Clinicians should not hesitate to provide their peers with assistance in recognizing particular sources of common medical errors to deliver better patient care. Equal accountability and responsibility of all healthcare team members are critical in preventing errors and providing superior patient safety. [1] Quality assurance teams should employ RCAs with every sentinal event, especially in situations when the identification of medical errors becomes difficult or complex due to many underlying factors. RCAs can help identify factors within the healthcare delivery process that may impede the ability to provide quality patient care. Given the preventable nature of most medical errors, a thorough RCA can improve patient safety and allow healthcare organizations to serve as a model for others.
Healthcare professionals should be aware of common medical error sources and work as a team to identify possible risks when they become apparent. Doing so will increase the quality and efficiency of the healthcare industry and patient trust in the healthcare system. When an RCA is performed, the cooperation of all healthcare team members and clinicians involved in patient care is critical to understanding the underlying source of a medical error and identifying future strategies to mitigate such errors and improve patient outcomes.
Disclosure: Gunjan Singh declares no relevant financial relationships with ineligible companies.
Disclosure: Raj Patel declares no relevant financial relationships with ineligible companies.
Disclosure: Sarosh Vaqar declares no relevant financial relationships with ineligible companies.
Disclosure: Joshua Boster declares no relevant financial relationships with ineligible companies.
This book is distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) ( http://creativecommons.org/licenses/by-nc-nd/4.0/ ), which permits others to distribute the work, provided that the article is not altered or used commercially. You are not required to obtain permission to distribute this article, provided that you credit the author and journal.
Bulk download.
Your browsing activity is empty.
Activity recording is turned off.
Turn recording back on
Connect with NLM
National Library of Medicine 8600 Rockville Pike Bethesda, MD 20894
Web Policies FOIA HHS Vulnerability Disclosure
Help Accessibility Careers
Effective healthcare litigation outcomes hinge on multiple critical factors. Meticulous documentation and record-keeping are indispensable, as incomplete or inaccurate records can compromise credibility and influence case outcomes. Clear communication with patients is also imperative, enabling informed decisions and managing expectations. Qualified specialist witness testimony, thorough risk management strategies, and strong peer review and quality assurance processes are likewise pivotal. Furthermore, compliance with regulatory standards and objective, unbiased medical opinions are necessary to establish credibility and facilitate successful litigation outcomes. A thorough understanding of these factors is necessary to traversing the complexities of healthcare litigation.
Table of Contents
Meticulous Documentation and Record-Keeping
Accurate and detailed documentation of patient care and treatment is crucial in healthcare litigation, as it provides a verifiable record of events that can substantially impact the outcome of legal proceedings. Incomplete or inaccurate records can lead to adverse inferences, compromising the credibility of healthcare providers and potentially influencing the outcome of legal cases.
To ensure data integrity, healthcare organizations must implement robust documentation systems that capture accurate and comprehensive information about patient care. This includes maintaining detailed records of diagnoses, treatments, medications, and test results. Regular compliance audits are also essential to verify the accuracy and completeness of documentation, identifying any discrepancies or gaps that require correction. By prioritizing meticulous documentation and record-keeping, healthcare providers can demonstrate a commitment to quality care, reduce the risk of litigation, and ensure that their records withstand scrutiny in legal proceedings.
Effective communication with patients is a critical aspect of healthcare litigation, as it can substantially impact the outcome of legal proceedings. Setting clear expectations and establishing open communication channels with patients can help prevent misunderstandings and foster trust, thereby reducing the likelihood of litigation. By prioritizing clear and transparent communication, healthcare providers can proactively address patient concerns and mitigate potential risks.
In healthcare settings, establishing clear expectations with patients is vital, as it enables them to make informed decisions about their care and reduces the likelihood of misunderstandings that can lead to litigation. By setting realistic timelines for treatment outcomes, healthcare providers can manage patient expectations and avoid potential conflicts. This approach also promotes patient empowerment, as individuals are more likely to take an active part in their care when they understand what to expect.
Clear expectations also facilitate informed consent, making patients aware of potential risks and benefits associated with their treatment. This, in turn, reduces the risk of allegations of misdiagnosis or malpractice. Additionally, clear expectations help to establish a sense of trust between healthcare providers and patients, which is critical in building a strong patient-provider relationship. By prioritizing clear expectations, healthcare providers can reduce the risk of litigation and improve overall patient outcomes. Ultimately, establishing clear expectations is a critical component of effective communication in healthcare settings, as it supports a collaborative dynamic where patients feel informed and healthcare providers can provide high-quality care.
Establishing open communication channels is crucial in healthcare settings, as it enables patients to ask questions, express concerns, and receive timely updates about their care, thereby fostering a collaborative relationship between patients and healthcare providers. Effective communication with patients is fundamental in preventing misunderstandings, alleviating anxiety, and promoting adherence to treatment plans. However, cultural barriers and language disparities can hinder open communication. Healthcare providers must be sensitive to these differences and take steps to address them, such as using interpreters or providing multilingual resources. Additionally, technological limitations, such as outdated electronic health records or inadequate patient portals, can also impede communication. To overcome these challenges, healthcare organizations must invest in modern technologies that facilitate seamless communication and provide ongoing training to staff on effective communication strategies. By prioritizing open communication channels, healthcare providers can guarantee that patients receive high-quality care, reduce the risk of adverse events, and minimize the likelihood of litigation.
Frequently, the credibility of a medical malpractice case hinges on the testimony of a qualified authority, whose objective analysis and tailored knowledge can substantially influence the outcome of a trial. The testimony of an expert witness can make or break a case, as it provides the jury with a deeper understanding of the medical standards and practices in question. Credibility factors, such as the witness's qualifications, experience, and impartiality, play a significant role in shaping jury perceptions. A qualified expert witness can establish credibility by demonstrating a thorough understanding of the relevant medical issues, providing clear and concise explanations, and avoiding bias or emotional appeals.
The jury's perception of the expert witness's credibility is critical, as it directly impacts the weight given to their testimony. A credible expert witness can increase the plaintiff's chances of success by providing persuasive testimony that resonates with the jury. Conversely, a witness lacking credibility can undermine the plaintiff's case, leading to a verdict in favor of the defendant. Therefore, it is essential to identify and engage a qualified expert witness who can provide objective, authoritative testimony that effectively communicates complex medical concepts to the jury.
Effective risk management is a vital component of healthcare litigation prevention, and a thorough strategy involves pinpointing zones of high risk, developing targeted mitigation measures, and regularly monitoring and updating these protocols to guarantee maximum protection. By identifying vulnerabilities and addressing them proactively, healthcare providers can substantially reduce their liability exposure. A thorough risk management approach enables healthcare organizations to anticipate and respond to potential threats, ultimately minimizing the likelihood of litigation.
In the pursuit of thorough risk management, pinpointing high-risk sections within healthcare organizations is crucial to mitigating potential legal liabilities and promising excellent patient care. Identifying these segments enables healthcare providers to allocate resources effectively and develop targeted strategies to minimize risks.
Vulnerable populations, such as pediatric and geriatric patients, are often at higher risk of adverse events due to their unique needs and circumstances. Healthcare organizations must prioritize these groups and implement measures to safeguard their safety. Medication errors, for instance, can have devastating consequences, particularly among vulnerable populations. A thorough risk management strategy should involve regular audits and assessments to identify potential vulnerabilities in medication administration processes, thereby protecting patients and preventing harm in this critical sector.
Having identified high-risk regions, healthcare organizations can proactively develop and implement thorough risk management strategies to mitigate potential legal liabilities and provide excellent patient care. This involves conducting an exhaustive risk assessment to identify vulnerabilities and prioritize sectors that require improvement. A thorough risk management strategy should comprise policies, procedures, and guidelines that address high-risk sectors, guaranteeing that healthcare providers are equipped to manage risks effectively.
Implementing mitigation measures also requires a cultural shift within the organization. Healthcare providers must adopt a culture of transparency, accountability, and open communication to foster a safe and reliable environment. This can be achieved by promoting a just culture, where mistakes are viewed as opportunities for growth and improvement, rather than punished. By implementing thorough risk management strategies and fostering a cultural shift, healthcare organizations can reduce the likelihood of adverse events, improve patient outcomes, and minimize the risk of litigation.
Regular monitoring and updating of thorough risk management strategies are essential to verify their continued relevance and effectiveness in mitigating legal liabilities and improving patient care. This involves conducting regular system checks to identify potential vulnerabilities and implementing policy revisions as needed. By doing so, healthcare organizations can ensure that their risk management strategies remain effective in preventing adverse events and reducing the likelihood of litigation.
Patient consent forms | Quarterly | Changes in regulatory requirements or patient feedback |
Medication administration protocols | Bi-annually | Updates in medical research or manufacturer guidelines |
Staff training programs | Annually | Changes in industry best practices or staff feedback |
Through regular monitoring and updating, healthcare organizations can demonstrate a proactive approach to risk management, which can help to reduce legal liabilities and improve patient outcomes. By staying up-to-date with industry best practices and regulatory requirements, healthcare organizations can ensure that their risk management strategies remain effective and relevant.
A robust peer review and quality assurance (QA) process serves as a cornerstone of healthcare litigation defense, providing a critical layer of protection against medical malpractice claims. This process ensures that healthcare providers are held to high standards of care and that any deviations from these standards are identified and addressed promptly. Effective peer oversight and review protocols are essential components of a strong QA process.
Some key elements of a robust peer review and QA process include:
In addition to a robust peer review and QA process, adherence to regulatory standards is vital in healthcare litigation defense, as it demonstrates a healthcare organization's commitment to providing high-quality patient care and reducing the risk of medical malpractice claims. Regulatory standards, such as those set by the Joint Commission and HIPAA, provide a framework for healthcare organizations to verify they are meeting minimum requirements for patient care and safety. Compliance with these standards is imperative, as non-compliance can lead to enforcement actions, fines, and reputational damage. Furthermore, staying up-to-date with regulatory updates is vital, as new regulations and guidelines are constantly being introduced. Healthcare organizations must have a system in place to monitor and implement these updates to avoid potential legal and financial consequences. By prioritizing compliance with regulatory standards, healthcare organizations can demonstrate a proactive approach to patient safety and quality care, which can be a powerful defense in the event of litigation.
Compliance with regulatory standards sets the foundation for a robust defense in healthcare litigation, and objective and unbiased medical opinions serve as a critical component in supporting this defense. These opinions are essential in establishing the standard of care, assessing treatment decisions, and evaluating patient outcomes. Moreover, they play a crucial role in resolving disputes and allocating liability.
To ensure the credibility of medical opinions, several factors must be considered:
Can healthcare providers be liable for third-party vendor negligence?.
Healthcare providers can be liable for third-party vendor negligence if they fail to exercise due diligence in vendor selection and oversight, including inadequate vendor contracts and lack of regular third-party audits to verify compliance with regulatory standards.
Electronic health records (EHRs) are vulnerable to errors due to compromised data integrity, often stemming from user fatigue, inadequate training, and insufficient quality control measures, which can lead to inaccurate or incomplete patient information.
Hospitals have a moral and ethical responsibility to report medical errors, promoting transparent error disclosure that prioritizes patient safety, fostering trust and facilitating quality improvement initiatives to prevent recurring errors and enhance overall care outcomes.
In medical malpractice cases, patients may sue for emotional distress without physical harm if they exceed the Anxiety Threshold, demonstrating a Fear Factor that meets the legal standard for negligent infliction of emotional distress.
Healthcare providers are not typically liable for patient non-compliance, as patient autonomy prioritizes individual decision-making. However, providers must guarantee or certify informed consent and clear communication to facilitate treatment adherence, mitigating potential liability risks.
BMC Medical Education volume 24 , Article number: 888 ( 2024 ) Cite this article
440 Accesses
2 Altmetric
Metrics details
Academic achievement is essential for all students seeking a successful career. Studying habits and routines is crucial in achieving such an ultimate goal.
This study investigates the association between study habits, personal factors, and academic achievement, aiming to identify factors that distinguish academically successful medical students.
A cross-sectional study was conducted at the College of Medicine, King Saud University, Riyadh, Saudi Arabia. The participants consisted of 1st through 5th-year medical students, with a sample size of 336. The research team collected study data using an electronic questionnaire containing three sections: socio-demographic data, personal characteristics, and study habits.
The study results indicated a statistically significant association between self-fulfillment as a motivation toward studying and academic achievement ( p = 0.04). The results also showed a statistically significant correlation between recalling recently memorized information and academic achievement ( p = 0.05). Furthermore, a statistically significant association between preferring the information to be presented in a graphical form rather than a written one and academic achievement was also found ( p = 0.03). Students who were satisfied with their academic performance had 1.6 times greater chances of having a high-grade point average (OR = 1.6, p = 0.08).
The results of this study support the available literature, indicating a correlation between study habits and high academic performance. Further multicenter studies are warranted to differentiate between high-achieving students and their peers using qualitative, semi-structured interviews. Educating the students about healthy study habits and enhancing their learning skills would also be of value.
Peer Review reports
Academic performance is a common indicator used to measure student achievement [ 1 , 2 ]. It is a compound process influenced by many factors, among which is study habits [ 2 , 3 ]. Study habit is defined as different individual behavior in relation to studying, and is a combination of study methods and skills [ 2 , 3 , 4 ]. Put differently, study habits involve various techniques that would increase motivation and transform the study process into an effective one, thus enhancing learning [ 5 ]. Students’ perspectives and approaches toward studying were found to be the key factors in predicting their academic success [ 6 , 7 ]. However, these learning processes vary from one student to another due to variations in the students’ cognitive processing [ 8 ].
The study habits of students are the regular practices and habits they exhibit during the learning process [ 9 , 10 ]. Over time, several study habits have been developed, such as time management, setting appropriate goals, choosing a comfortable study environment, taking notes effectively, choosing main ideas, and being organized [ 11 ]. Global research shows that study habits impact academic performance and are the most important predictor of it [ 12 ]. It is difficult for medical students to organize and learn a lot of information, and they need to employ study skills to succeed [ 1 , 2 , 5 , 13 ].
Different lifestyle and social factors could affect students’ academic performance. For instance, Jafari et al. found that native students had better study habits compared to dormitory students [ 1 ]. This discrepancy between native and dormitory students was also indicated by Jouhari et al. who illustrated that dormitory students scored lower in attitude, test strategies, choosing main ideas, and concentration [ 10 ]. Regarding sleeping habits, Curcio G et al. found that students with a regular and adequate sleeping pattern had higher Grade Point Average (GPA) scores [ 14 ]. Lifestyle factors, such as watching television and listening to music, were shown to be unremarkable in affecting students’ grades [ 15 , 16 ]. Social media applications, including WhatsApp, Facebook, and Twitter, distract students during learning [ 16 , 17 ].
Motivation was found to be a major factor in students’ academic success. Bonsaksen et al. found that students who chose “to seek meaning” when studying were associated with high GPA scores [ 18 ]. In addition, low scores on “fear of failure” and high scores on “achieving” correlated with a higher GPA [ 8 , 18 ].
Resource-wise, Alzahrani et al. found that 82.7% of students relied on textbooks assigned by the department, while 46.6% mainly relied on the department’s lecture slides [ 19 ]. The study also indicated that 78.8% perceived that the scientific contents of the lectures were adequate [ 19 ]. Another study found that most students relied on the lecture slides (> 83%) along with their notes, followed by educational videos (76.1%), and reference textbooks (46.1%) [ 20 ]. Striking evidence in that study, as well as in another study, indicated that most students tended to avoid textbooks and opted for lecture slides, especially when preparing for exams [ 20 , 21 ].
Several researchers studied the association between different factors and academic performance; however, more is needed to know about this association in the process of education among medical students [ 15 , 20 , 22 ], with some limitations to the conducted studies. Such limitations include the study sample and using self-reported questionnaires, which may generate inaccurate results. Moreover, in Saudi Arabia in particular, the literature concerning the topic remains limited. Since many students are unsatisfied with their performance and seek improvement [ 10 ], the present study was designed and conducted.
Unlike other studies in the region, this study aims to investigate the relationship between study habits and personal factors and measure their influence on academic achievement. The results of this study could raise awareness regarding the effect of study habits and personal factors on students’ performance and would also guide them toward achieving academic success. The study also seeks to identify the factors that distinguish academically successful students from their peers.
This observational cross-sectional study, which took place between June and December 2022, was conducted among students attending the College of Medicine at King Saud University (KSU), Riyadh, Saudi Arabia. Its targeted population included all male and female medical students (first to fifth years) attending KSU during the academic year 2021/2022. Whereas, students at other colleges and universities, those who failed to complete the questionnaire, interns (the students who already graduated), and those who were enrolled in the university’s preparatory year, were all excluded from the current study. The sample size was calculated based on a study conducted in 2015 by Lana Al Shawwa [ 15 ]. Using the sample size formula for a single proportion (0.79), the required sample size was 255 using a confidence interval of 95% and a margin of error of 5%. After adding a 20% margin to accommodate non-responses and incomplete responses, the calculated sample size required for this study was 306. However, our research team collected a total of 336 participants for this study to ensure complete representation.
The research team developed and used an electronic questionnaire. The rationale is that no standardized questionnaire measuring the study objectives was found in the literature. However, the questionnaire was tested on a pilot of 15 students to test its clarity and address any possible misconceptions and ambiguity. The study questionnaire was distributed randomly to this cohort, who were asked to fill out the questionnaire. The students reported a complete understanding of the questionnaire’s contents, so the same questionnaire was used without any modifications. The questionnaire, written in English, consisted of three parts. The first part included eleven questions about the socio-demographic status of the participants. The second part contained twenty-one questions examining personal factors such as sleep and caffeine consumption. The last part included twenty-one questions regarding students’ study habits. The questionnaire was constructed based on an ordinal Likert scale which had: strongly agree, agree, neutral, disagree, and strongly disagree as possible answers. The questionnaire was sent to participants through email and social media applications like Twitter and WhatsApp to increase the study response. An informed consent that clearly states the study’s purpose was taken from all participants at the beginning of the questionnaire. In addition, all participants were assured that the collected data would be anonymous and confidential. Each participant was represented by a code for the sole purpose of analyzing the data. Furthermore, no incentives or rewards were given to the participants for their participation.
Socio-demographic information (such as age, gender, and academic year), and personal factors (such as motivation, sleeping status, caffeine consumption, and self-management) were the independent variables. Study habits such as attendance, individual versus group study, memorization techniques, revision, learning style, and strategies were also independent variables.
Academic achievement refers to a student’s success in gaining knowledge and understanding in various subjects, as well as the ability to apply that knowledge effectively [ 23 ]. It is a measure of the student’s progress throughout the educational journey, encompassing both academic achievements and personal growth [ 3 , 24 ]. Academic achievement is judged based on the student’s GPA or performance score. In this study, students’ GPA scores, awareness, and satisfaction regarding their academic performance were the dependent variables.
We divided the study sample into two groups based on the GPA. We considered students with high GPAs to be exposed (i.e. exposed to the study habits we are investigating), and students with low GPAs to be the control group. The purpose of this study was to determine why an exposed group of students gets high grades and what study factors they adopt. Based on this exposure (high achieving students), we concluded what methods they used to achieve higher grades. Those in the first group had a GPA greater or equal to 4.5 (out of 5), while those in the second group had a GPA less than 4.5. The students’ data were kept confidential and never used for any other purpose.
The data collected were analyzed by using IBM SPSS Statistical software for Windows version 24.0. Descriptive statistics such as frequency and percentage were used to describe the socio-demographic data in a tabular form. Furthermore, data for categorical variables, including different study habits, motivation factors, memorizing and revising factors, and lifestyle factors, were tabulated and analyzed using the odds ratio test. Finally, we calculated the odds ratio statistic and a p-value of 0.05 to report the statistical significance of our results.
Before conducting the study, the research team obtained the Ethics Committee Approval from the Institutional Review Board of the College of Medicine, KSU, Riyadh, Saudi Arabia (project No. E-22-7044). Participants’ agreement/consent to participate was guaranteed by choosing “agree” after reading the consent form at the beginning of the questionnaire. Participation was voluntary, and consent was obtained from all participants. The research team carried out all methods following relevant guidelines and regulations.
The total 336 medical students participated in the study. All participants completed the study questionnaire, and there were no missing or incomplete data, with all of them being able to participate. As shown in Table 1 9.3% of participants were between 18 and 20, 44.9% were between the ages of 21 and 22, and 35.8% were 23–28 years old. In the current study, 62.5% of the participants were males and 37.5% were females. The proportion of first-year students was 21.4%, 20.8% of second-year students, 20.8% of third-year students, 18.2% of fourth-year students, and 18.8% of fifth-year students, according to academic year levels. Regarding GPA scores, 36.9% scored 4.75-5 and 32.4% scored 4.5–4.74. 23.8% achieved 4-4.49, 6.5% achieved 3-3.99, and only 0.4% achieved 2.99 or less. Participants lived with their families in 94.6% of cases, with friends in 1.2% of cases, and alone in 4.2% of cases. For smoking habits, 86.3% did not smoke, 11% reported using vapes, 2.1% used cigarettes, and 0.6% used Shisha. 91.4% of the participants did not report any chronic illnesses; however, 8.6% did. In addition, 83% had no mental illness, 8.9% had anxiety, 6% had depression, and 2.1% reported other mental illnesses.
Table 2 shows motivational factors associated with academic performance. There was a clear difference in motivation factors between students with high and low achievement in the current study. Students with high GPAs were 1.67 times more motivated toward their careers (OR = 1.67, p = 0.09) than those with low GPAs. Furthermore, significant differences were found between those students who had self-fulfillment or ambitions in life they had ~ 2 times higher (OR = 1.93, p = 0.04) GPA scores than low GPA students. Exam results did not motivate exposed or high GPA students (46%) or control students with low GPA students (41%), but the current study showed test results had little impact on low achiever students (OR = 1.03, p = 0.88). Furthermore, 72.6% of high achievers were satisfied with their academic performance, while only 41% of low achiever students were satisfied. Therefore, students who were satisfied with their academic performance had 1.6 times greater chances of a higher GPA (OR = 1.6, p = 0.08). Students who get support and help from those around them are more likely to get high GPAs (OR = 1.1, p = 0.73) than those who do not receive any support. When students reported feeling a sense of family responsibility, the odds (odds ratio) of their receiving higher grades were 1.15 times higher (OR = 1.15, p = 0.6) compared to those who did not feel a sense of family responsibility. The p-value, which indicates the level of statistical significance, was 0.6.
Table 3 shows the study habits of higher achiever students and low achiever students. Most of the high-achieving students (79.0%) attended most of the lectures and had 1.6 times higher chances of getting higher grades (OR = 1.6, p = 0.2) than those who did not attend regular lectures. The current study found that studying alone had no significant impact on academic achievement in either group. However, those students who had studied alone had lower GPAs (OR = 1.07, p = 0.81). The current study findings reported 29.8% of students walk or stand while studying rather than sit, and they had 1.57 times higher GPA chances compared to students with lower GPAs (OR = 0.73, p = 0.27). High achievers (54.0%) preferred studying early in the morning, and these students had higher chances of achieving good GPAs (OR = 1.3, p = 0.28) than low achiever groups of students. The number of students with high achievement (39.5%) went through the lecture before the lesson was taught. These students had 1.08 times higher chances of achieving than low achiever groups of students. Furthermore, students who made a weekly study schedule had 1.3 times higher chances of being good academic achievers than those who did not (OR = 1.3, p = 0.37). Additionally, high-achieving students paid closer attention to the lecturer (1.2 times higher). In addition, students with high GPAs spent more time studying when exam dates approached (OR = 1.3, p = 0.58).
Table 4 demonstrates the relationship between memorizing and revising with high and low GPA students. It was found that high achiever students (58.9%) studied lectures daily and had 1.4 times higher chances of achieving high grades (OR = 1.4, p = 0.16) than the other group. It was found that most of the high achievers (62.1%) skim the lecture beforehand before memorizing it, which led to 1.8 times higher chances of getting good grades in this exam (OR = 1.8, p = 0.06). One regular activity reported by high GPA students (82.3%) was recalling what had just been memorized. For this recalling technique, we found a significant difference between low-achieving students (OR = 0.8, p = 0.63) and high-achieving students (OR = 1.83, p = 0.05). A high achiever student writes notes before speaking out for the memorizing method, which gives 1.2 times greater chances of getting high grades (OR = 1.2, p = 0.55) than a student who does not write notes. A major difference in the current study was that high GPA achievers (70.2%) revise lectures more frequently than low GPA achievers (57.1%). They had 1.5 times more chances of getting high grades if they practiced and revised this method (OR = 1.5, p = 0.13).
Table 5 illustrates the relationship between negative lifestyle factors and students’ academic performance. The current study found that students are less likely to get high exam grades when they smoke. Students who smoke cigarettes and those who vape are 1.14 and 1.07 times respectively more likely to have a decrease in GPA than those who do not smoke. Those students with chronic illnesses had 1.22 times higher chances of a downgrade in the exam (OR = 1.22, p = 0.49). Additionally, students with high GPAs had higher mental pressures (Anxiety = 1.2, Depression = 1.18, and other mental pressures = 1.57) than those with low GPAs.
Learning is a multifaceted process that evolves throughout our lifetimes. The leading indicator that sets students apart is their academic achievement. Hence, it is crucial to investigate the factors that influence it. The present study examined the relationship between different study habits, personal characteristics, and academic achievement among medical students. In medical education, and more so in Saudi Arabia, there needs to be more understanding regarding such vital aspects.
Regarding motivational factors, the present study found some differences between high and low achievers. Students with high GPA scores were more motivated toward their future careers (OR = 1.67, p = 0.09). The study also indicated that students who had ambitions and sought self-fulfillment were more likely to have high GPA scores, which were statistically significant (OR = 1.93, p = 0.04). This was consistent with Bin Abdulrahman et al. [ 20 ], who indicated that the highest motivation was self-fulfillment and satisfying family dreams, followed by a high educational level, aspirations to join a high-quality residency program, and high income. Their study also found that few students were motivated by the desire to be regarded as unique students. We hypothesize that this probably goes back to human nature, where a highly rewarding incentive becomes the driving force of our work. Hence, schools should utilize this finding in exploring ways to enhance students’ motivation toward learning.
The present study did not find a significant effect of previous exam results on academic performance (OR = 1.03, p = 0.88). However, some studies reported that more than half of the high-achieving students admitted that high scores acquired on previous assessments are an important motivational factor [ 15 , 25 , 26 ]. We hypothesize that as students score higher marks, they become pleased and feel confident with their study approach. This finding shows how positive measurable results influence the students’ mentality.
The present study also explored the social environment surrounding medical students. The results indicated that those who were supported by their friends or family were slightly more likely to score higher GPAs (OR = 1.1, p = 0.73); however, the results did not reach a statistical significance. We hypothesize that a supportive and understanding environment would push the students to be patient and look for a brighter future. Our study results were consistent with previous published studies, which showed an association [ 3 , 27 , 28 , 29 , 30 ]. We hypothesize that students who spend most of their time with their families had less time to study, which made their study time more valuable. The findings of this study will hopefully raise awareness concerning the precious time that students have each day.
The association of different study habits among medical students with high and low GPAs was also studied in our study. It was noted that the high-achieving students try to attend their lectures compared to the lower achievers. This was in line with the previous published studies, which showed that significant differences were observed between the two groups regarding the attendance of lectures, tutorials, practical sessions, and clinical teachings [ 31 , 32 ]. The present study found that most students prefer to study alone, regardless of their level of academic achievement (82.1%). This finding is consistent with the study by Khalid A Bin Abdulrahman et al., which also showed that most students, regardless of their GPA, favored studying alone [ 20 ].
The present study findings suggest that a small number of students (29.8%) prefer to walk or stand while studying rather than sit, with most being high achievers (OR = 1.57, P = 0.15). A study reported that 40.3% of students with high GPAs seemed to favor a certain posture or body position, such as sitting or lying on the floor [ 15 ]. These contradictory findings might indicate that which position to adopt while studying should come down to personal preference and what feels most comfortable to each student. The present study also found that high achievers are more likely to prefer studying early in the morning (OR = 1.3, P = 0.28). The authors did not find similar studies investigating this same association in the literature. However, mornings might allow for more focused studying with fewer distractions, which has been shown to be associated with higher achievement in medical students [ 3 , 15 , 33 ].
Our study also found that 39.5% of the academically successful students reviewed pre-work or went through the material before they were taught it (OR = 1.08, p = 0.75), and 25% were neutral. Similar findings were reported in other studies, showing that academically successful students prepared themselves by doing their pre-work, watching videos, and revising slides [ 3 , 9 , 34 ]. Our study showed that 75% of high-achieving students tend to listen attentively to the lecturer (OR = 1.2, p = 0.48). Al Shawa et al. found no significant differences between the high achievers and low achievers when talking about attending lectures [ 15 ]. This could be due to the quality of teachers and the environment of the college or university.
Regarding the relationship between memorizing and revising with high and low GPA students, the present study found that students who study lectures daily are more likely to score higher than those who do not (OR = 1.4, p = 0.16). This finding is consistent with other studies [ 3 , 19 , 35 ]. For skimming lectures beforehand, an appreciable agreement was noted by high GPA students (62.1%), while only (42%) of low GPA students agreed to it. Similarly, previous published studies also found that highlighting and reading the content before memorization were both common among high-achieving students [ 15 , 36 ]. Furthermore, the present study has found recalling what has just been memorized to be statistically significantly associated with high GPA students (OR = 1.83, p = 0.05). Interestingly, we could not find any study that investigated this as an important factor, which could be justified by the high specificity of this question. Besides, when it comes to writing down/speaking out what has just been memorized, our study has found no recognizable differences between high-achieving students (75%) and low-achieving students (69%), as both categories had remarkably high percentages of reading and writing while studying.
The present study has found no statistical significance between regularly revising the lectures and high GPA ( p > 0.05), unlike the study conducted by Deborah A. Sleight et al. [ 37 ]. The difference in findings between our study and Deborah A. Sleight et al. might be due to a limitation of our study, namely the similar backgrounds of our participants. Another explanation could be related to curricular differences between the institutions where the two studies were conducted. Moreover, a statistically significant correlation between not preferring the data being presented in a written form instead of a graphical form and high GPA scores have been found in their study ( p < 0.05). However, a study conducted by Deborah A. Sleight et al. indicated that 66% of high achievers used notes prepared by other classmates compared to 84% of low achievers. Moreover, their study showed that only 59% of high achievers used tables and graphs prepared by others compared to 92% of low achievers. About 63% and 61% of the students in their study reported using self-made study aids for revision and memory aids, respectively [ 37 ].
The present study also examined the effects of smoking and chronic and mental illness, but found no statistical significance; the majority of both groups responded by denying these factors’ presence in their life. A similar finding by Al Shawwa et al. showed no statistical significance of smoking and caffeine consumption between low GPA and high GPA students [ 15 ]. We hypothesize that our findings occurred due to the study’s broad approach to examining such factors rather than delving deeper into them.
High-achieving students’ habits and factors contributing to their academic achievement were explored in the present study. High-achieving students were found to be more motivated and socially supported than their peers. Moreover, students who attended lectures, concentrated during lectures, studied early in the morning, prepared their weekly schedule, and studied more when exams approached were more likely to have high GPA scores. Studying techniques, including skimming before memorizing, writing what was memorized, active recall, and consistent revision, were adopted by high-achievers. To gain deeper insight into students’ strategies, it is recommended that qualitative semi-structured interviews be conducted to understand what distinguishes high-achieving students from their peers. Future studies should also explore differences between public and private university students. Additionally, further research is needed to confirm this study’s findings and provide guidance to all students. Future studies should collect a larger sample size from a variety of universities in order to increase generalizability.
The present study has some limitations. All the study’s findings indicated possible associations rather than causation; hence, the reader should approach the results of this study with caution. We recommend in-depth longitudinal studies to provide more insight into the different study habits and their impact on academic performance. Another limitation is that the research team created a self-reported questionnaire to address the study objectives, which carries a potential risk of bias. Hence, we recommend conducting interviews and having personal encounters with the study’s participants to reduce the risk of bias and better understand how different factors affect their academic achievement. A third limitation is that the research team only used the GPA scores as indicators of academic achievement. We recommend conducting other studies and investigating factors that cannot be solely reflected by the GPA, such as the student’s clinical performance and skills. Lastly, all participants included in the study share one background and live in the same environment. Therefore, the study’s findings do not necessarily apply to students who do not belong to such a geographic area and point in time. We recommend that future studies consider the sociodemographic and socioeconomic variations that exist among the universities in Saudi Arabia.
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Grade Point Average
King Saud University
Institutional review board
Statistical package for the social sciences
Jafari H, Aghaei A, Khatony A. Relationship between study habits and academic achievement in students of medical sciences in Kermanshah-Iran. Adv Med Educ Pract. 2019;10:637–43.
Article Google Scholar
Abid N, Aslam S, Alghamdi AA, Kumar T. Relationships among students’ reading habits, study skills, and academic achievement in English at the secondary level. Front Psychol. 2023;14:1020269.
Abdulghani HM, Al-Drees AA, Khalil MS, Ahmad F, Ponnamperuma GG, Amin Z. What factors determine academic achievement in high achieving undergraduate medical students? A qualitative study. Med Teach. 2014;36(Suppl 1):S43–48.
Muntean LM, Nireștean A, Sima-Comaniciu A, Mărușteri M, Zăgan CA, Lukacs E. The relationship between personality, motivation and academic performance at Medical students from Romania. Int J Environ Res Public Health 2022, 19(15).
Reza HM, Alireza HJIJME. Investigating study Habits of Library and Information Sciences Students of Isfahan University and Isfahan University of Medical Sciences. 2014, 14:751–757.
Kurtz SM, Silverman JD. The Calgary-Cambridge Referenced Observation guides: an aid to defining the curriculum and organizing the teaching in communication training programmes. Med Educ. 1996;30(2):83–9.
Pun J, Kong B. An exploratory study of communication training for Chinese medicine practitioners in Hong Kong to integrate patients’ conventional medical history. BMC Complement Med Ther. 2023;23(1):10.
İlçin N, Tomruk M, Yeşilyaprak SS, Karadibak D, Savcı S. The relationship between learning styles and academic performance in TURKISH physiotherapy students. BMC Med Educ. 2018;18(1):291.
McKeirnan KC, Colorafi K, Kim AP, Stewart AS, Remsberg CM, Vu M, Bray BS. Study behaviors Associated with Student pharmacists’ academic success in an active Classroom Pharmacy Curriculum. Am J Pharm Educ. 2020;84(7):ajpe7695.
Jouhari Z, Haghani F, Changiz T. Assessment of medical students’ learning and study strategies in self-regulated learning. J Adv Med Educ Professionalism. 2016;4(2):72–9.
Google Scholar
Proctor BE, Prevatt FF, Adams KSS, Reaser A, Petscher Y. Study skills profiles of normal-achieving and academically-struggling College students. J Coll Student Dev. 2006;47(1):37–51.
Kyauta AMASY, Garba HS. The role of guidance and counseling service on academic performance among students of umar suleiman college of education, Gashua, Yobe State, Nigeria. KIU J Humanit. 2017;2(2):59–66.
Eva KW, Bordage G, Campbell C, Galbraith R, Ginsburg S, Holmboe E, Regehr G. Towards a program of assessment for health professionals: from training into practice. Adv Health Sci Education: Theory Pract. 2016;21(4):897–913.
Curcio G, Ferrara M, De Gennaro L. Sleep loss, learning capacity and academic performance. Sleep Med Rev. 2006;10(5):323–37.
Al Shawwa L, Abulaban AA, Abulaban AA, Merdad A, Baghlaf S, Algethami A, Abu-Shanab J, Balkhoyor A. Factors potentially influencing academic performance among medical students. Adv Med Educ Pract. 2015;6:65–75.
Ibrahim NK, Baharoon BS, Banjar WF, Jar AA, Ashor RM, Aman AA, Al-Ahmadi JR. Mobile Phone Addiction and its relationship to Sleep Quality and Academic Achievement of Medical students at King Abdulaziz University, Jeddah, Saudi Arabia. J Res Health Sci. 2018;18(3):e00420.
Alkhalaf AM, Tekian A, Park YS. The impact of WhatsApp use on academic achievement among Saudi medical students. Med Teach. 2018;40(sup1):S10–4.
Bonsaksen T, Brown T, Lim HB, Fong K. Approaches to studying predict academic performance in undergraduate occupational therapy students: a cross-cultural study. BMC Med Educ. 2017;17(1):76.
Alzahrani HA, Alzahrani OH. Learning strategies of medical students in the surgery department, Jeddah, Saudi Arabia. Adv Med Educ Pract. 2012;3:79–87.
Bin Abdulrahman KA, Khalaf AM, Bin Abbas FB, Alanazi OT. Study habits of highly effective medical students. Adv Med Educ Pract. 2021;12:627–33.
Jameel T, Gazzaz ZJ, Baig M, Tashkandi JM, Alharenth NS, Butt NS, Shafique A, Iftikhar R. Medical students’ preferences towards learning resources and their study habits at King Abdulaziz University, Jeddah, Saudi Arabia. BMC Res Notes. 2019;12(1):30.
Abdulghani HM, Alrowais NA, Bin-Saad NS, Al-Subaie NM, Haji AM, Alhaqwi AI. Sleep disorder among medical students: relationship to their academic performance. Med Teach. 2012;34(Suppl 1):S37–41.
Hwang G-J, Wang S-Y, Lai C-L. Effects of a social regulation-based online learning framework on students’ learning achievements and behaviors in mathematics. Comput Educ. 2021;160:104031.
Gamage KAA, Dehideniya D, Ekanayake SY. The role of personal values in learning approaches and student achievements. Behav Sci (Basel Switzerland) 2021, 11(7).
Linn Z, Tashiro Y, Morio K, Hori H. Peer evaluations of group work in different years of medical school and academic achievement: how are they related? BMC Med Educ. 2022;22(1):102.
Avonts M, Michels NR, Bombeke K, Hens N, Coenen S, Vanderveken OM, De Winter BY. Does peer teaching improve academic results and competencies during medical school? A mixed methods study. BMC Med Educ. 2022;22(1):431.
Topor DR, Keane SP, Shelton TL, Calkins SD. Parent involvement and student academic performance: a multiple mediational analysis. J Prev Interv Community. 2010;38(3):183–97.
Veas A, Castejón JL, Miñano P, Gilar-Corbí R. Relationship between parent involvement and academic achievement through metacognitive strategies: a multiple multilevel mediation analysis. Br J Educ Psychol. 2019;89(2):393–411.
Núñez JC, Regueiro B, Suárez N, Piñeiro I, Rodicio ML, Valle A. Student Perception of teacher and parent involvement in Homework and Student Engagement: the mediating role of motivation. Front Psychol. 2019;10:1384.
Abdulghani AH, Ahmad T, Abdulghani HM. The impact of COVID-19 pandemic on anxiety and depression among physical therapists in Saudi Arabia: a cross-sectional study. BMC Med Educ. 2022;22(1):751.
Park KH, Park JH, Kim S, Rhee JA, Kim JH, Ahn YJ, Han JJ, Suh DJ. Students’ perception of the educational environment of medical schools in Korea: findings from a nationwide survey. Korean J Med Educ. 2015;27(2):117–30.
Ahrberg K, Dresler M, Niedermaier S, Steiger A, Genzel L. The interaction between sleep quality and academic performance. J Psychiatr Res. 2012;46(12):1618–22.
Dikker S, Haegens S, Bevilacqua D, Davidesco I, Wan L, Kaggen L, McClintock J, Chaloner K, Ding M, West T, et al. Morning brain: real-world neural evidence that high school class times matter. Soc Cognit Affect Neurosci. 2020;15(11):1193–202.
Pittenger AL, Dimitropoulos E, Foag J, Bishop D, Panizza S, Bishop JR. Closing the Classroom Theory to practice gap by simulating a Psychiatric Pharmacy Practice Experience. Am J Pharm Educ. 2019;83(10):7276.
Walck-Shannon EM, Rowell SF, Frey RF. To what extent do Study habits relate to performance? CBE Life Sci Educ. 2021;20(1):ar6.
Abdulghani HM, Alanazi K, Alotaibi R, Alsubeeh NA, Ahmad T, Haque S. Prevalence of potential dropout thoughts and their influential factors among Saudi Medical Students. 2023, 13(1):21582440221146966.
Sleight DA, Mavis BE. Study skills and academic performance among second-Year Medical students in Problem-based learning. Med Educ Online. 2006;11(1):4599.
Download references
The authors are grateful to the Deanship of Scientific Research, King Saud University, for.
support through the Vice Deanship of Scientific Research Chairs.
Authors and affiliations.
Department of Psychiatry, College of Medicine, King Saud University, Riyadh, Saudi Arabia
Mohammed A. Aljaffer & Ahmad H. Almadani
College of Medicine, King Saud University, Riyadh, Saudi Arabia
Abdullah S. AlDughaither, Ali A. Basfar, Saad M. AlGhadir, Yahya A. AlGhamdi, Bassam N. AlHubaysh & Osamah A. AlMayouf
Department of Psychiatry, College of Medicine, Imam Mohammad Ibn Saud Islamic University, Riyadh, Saudi Arabia
Saleh A. AlGhamdi
Department of Medical Education, College of Medicine, King Saud University, P.O. Box: 230155, Riyadh, 11321, Saudi Arabia
Tauseef Ahmad
Department of Medical Education and Family Medicine, College of Medicine, King Saud University, Riyadh, Saudi Arabia
Hamza M. Abdulghani
You can also search for this author in PubMed Google Scholar
Conception or design: AHA, MAA, and HMA. Acquisition, analysis, or interpretation of data: AAB, SMA, ASA, YAA, BNA, OAA and SAA. Drafting the work or revising: TA, AHA, ASA AAB. Final approval of the manuscript: MAA, HMA., AHA, and TA. The author(s) read and approved the final manuscript.
Correspondence to Tauseef Ahmad .
Conflict of interest.
The Authors declare that they have no conflict of interest.
Not applicable.
The authors declare no competing interests.
Additional information, publisher’s note.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .
Reprints and permissions
Cite this article.
Aljaffer, M.A., Almadani, A.H., AlDughaither, A.S. et al. The impact of study habits and personal factors on the academic achievement performances of medical students. BMC Med Educ 24 , 888 (2024). https://doi.org/10.1186/s12909-024-05889-y
Download citation
Received : 26 September 2023
Accepted : 12 August 2024
Published : 19 August 2024
DOI : https://doi.org/10.1186/s12909-024-05889-y
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
ISSN: 1472-6920
This event has passed and can no longer be viewed.
This event was presented live or live-streamed and has not been designated for on-demand presentation.
This Neonatology Medical Literature Review session will take place on Thursday, March 12, 2024 at 12:00 p.m. Attendance will be available remotely through Zoom. Click here to receive CME credit: Attendees must complete the Session Evaluation .
Needs statement.
Physicians, residents, fellows, nurse practitioners, and other healthcare professionals involved in the care of neonates need to receive regular updates on the best strategies for reviewing, analyzing, and applying medical literature to clinical practice. The series aims to expand the knowledge of learners with regard to clinical epidemiology, biostatistics, and other research methodologies. The series also aims to review the most current research evidence related to neonatal disease processes, diagnostic and treatment modalities, quality of neonatal care, and improvement of patient outcomes.
At the conclusion of the session, the participants should be able to:
Professional categories.
Interest groups.
Baylor College of Medicine is accredited by the Accreditation Council for Continuing Medical Education (ACCME) to provide continuing medical education for physicians.
Baylor College of Medicine designates this live activity for a maximum of 1.0 AMA PRA Category 1 Credit(s)™ . Physicians should claim only the credit commensurate with the extent of their participation in the activity.
Michael e. speer, m.d., disclosure policy.
Baylor College of Medicine (BCM) is accredited by the Accreditation Council for Continuing Medical Education (ACCME) to provide continuing medical education (CME) for physicians. BCM is committed to sponsoring CE activities that are scientifically based, accurate, current, and objectively presented.
In accordance with the ACCME Standards for Commercial Support, BCM has implemented a mechanism requiring everyone in a position to control the content of an educational activity (i.e., directors, planning committee members, faculty) to disclose any relevant financial relationships with commercial interests (drug/device companies) and manage/resolve any conflicts of interest prior to the activity. Individuals must disclose to participants the existence or non-existence of financial relationships at the time of the activity or within 24 months prior.
In addition, BCM has requested activity faculty/presenters to disclose to participants any unlabeled use or investigational use of pharmaceutical/device products; to use scientific or generic names (not trade names) in referring to products; and, if necessary to use a trade name, to use the names of similar products or those within a class. Faculty/presenters have also been requested to adhere to the ACCME's validation of clinical content statements.
BCM does not view the existence of financial relationships with commercial interests as implying bias or decreasing the value of a presentation. It is up to participants to determine whether the relationships influence the activity faculty with regard to exposition or conclusions. If at any time during this activity you feel that there has been commercial/promotional bias, notify the Activity Director or Activity Coordinator. Please answer the questions about balance and objectivity in the activity evaluation candidly.
All of the relevant financial relationships listed for these individuals have been mitigated.
The following individual(s) has/have reported financial or other relationship(s) with commercial entities whose products/services may relate to the educational content of this activity:
Disclosure:.
Nothing to disclose.
Faeq al-mudares, m.d., melissa mora carbajal, m.d., joseph l. hagan, sc.d., m.s.p.h., mohan pammi, m.d., ph.d..
Health topics.
An official website of the United States government
The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.
The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.
Email citation, add to collections.
Your saved search, create a file for external citation management software, your rss feed.
Affiliation.
Background: Ethical and professional guidelines recommend disclosure of medical errors to patients. The objective of this study was to review the empirical literature on disclosure of medical errors with respect to (1) the decision to disclose, (2) the process of informing the patient and family, and (3) the consequences of disclosure or nondisclosure.
Methods: We searched 4 electronic databases (MEDLINE, CINAHL, PsycINFO, and Social Sciences Citations Index) and the reference lists of relevant articles for English-language studies on disclosure of medical errors. From more than 800 titles reviewed, we identified 17 articles reporting original empirical data on disclosure of medical errors to patients and families. We examined methods and results of the articles and extracted study designs, data collection procedures, populations sampled, response rates, and definitions of error.
Results: Available research findings suggest that patients and the public support disclosure. Physicians also indicate support for disclosure, but often do not disclose. We found insufficient empirical evidence to support conclusions about the disclosure process or its consequences.
Conclusions: Empirical research on disclosure of medical errors to patients and families has been limited, and studies have focused primarily on the decision stage of disclosure. Fewer have considered the disclosure process, the consequences of disclosure, or the relationship between the two. Additional research is needed to understand how disclosure decisions are made, to provide guidance to physicians on the process, and to help all involved anticipate the consequences of disclosure.
PubMed Disclaimer
Full text sources.
NCBI Literature Resources
MeSH PMC Bookshelf Disclaimer
The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.
IMAGES
COMMENTS
Medical errors include errors in diagnosis ("diagnostic errors"), errors in the administration of drugs and other medications ("medication errors"), errors in the performance of surgical procedures, in the use of other varieties of therapy, in the use of equipment, and the interpretation of laboratory findings. [ 1, 2, 3] It is critical ...
Abstract. Objective: Medical errors represent a leading cause of patient morbidity and mortality. The aim of this study was to quantitatively analyze the existing scientific literature on medical errors in order to gain new insights in this important medical research area. Study Design: Web of Science database was used to identify relevant ...
However, the aim of this review is to provide a summary of medication errors reporting culture, incidence reporting systems, creating effective reporting methods, analysis of medication error reports, and recommendations to improve medication errors reporting systems.
Better preparing nurses to safely fulfil the task of medication administration in the clinical environment, with increased confidence in the face of interruptions, could lead to a reduction in errors and concomitant improvements to patient safety.
Background and Aims: Medication errors occur at any point of the medication management process, and are a major cause of death and harm globally. The objective of this review was to compare the effectiveness of different interventions in reducing prescribing, dispensing and administration medication errors in acute medical and surgical settings.
This narrative review aimed to explore the impact of checklists and error reporting systems on hospital patient safety and medical errors.A systematic…
We identified such interventions. Methods: We conducted a systematic review of systematic reviews by searching four databases (PubMed, Scopus, Ovid Medline, and Embase) until January 2021 to elicit interventions that have the potential to decrease medical errors. Two reviewers independently conducted data extraction and analyses.
Several primary studies and systematic reviews have explored factors contributing to medication errors. Given the plethora of systematic reviews investigating contributory factors to medication errors, there is a need to identify, critically appraise, and synthesize these factors via an umbrella review.
Conclusions Medication errors are classified based on multifaceted criteria and there is a need to standardize the recommendations and make them a central goal all over the globe for the best practice. Nurses are the frontlines of clinical settings, encouraged to be one integrated body to prevent the occurrence of medication errors.
Underreporting of medical errors is a common and a challenging obstacle in the fight for patient safety. The goal of this study is to review common barriers to reporting medical errors. Methods. We systematically reviewed the literature by searching the MEDLINE and SCOPUS databases for studies on barriers to reporting medical errors.
Medical errors are a substantial problem in health care. Understanding the effect of medical errors on health care providers as the "second victims" is necessary to maintain safe, quality patient care for the good of both patients and providers. We report an integrative literature review of the effe …
Abstract. Background: Medical errors are one of the most important quality problems in health care today. The best insight into the incidences and characteristics of medical errors is through studies on adverse events (AEs) since a considerable fraction of AEs are results of errors and as such preventable. Even though prevention is where effort ...
The review also found four leadership actions - regular checks on the front line and promoting teamwork, psychological safety and open communication - associated with successful outcomes. The review concluded that leadership appeared to be the preeminent factor in reducing medical errors and improving patient safety.
Background Ethical and professional guidelines recommend disclosure of medical errors to patients. The objective of this study was to review the empirical literature on disclosure of medical errors with respect to (1) the decision to disclose, (2) the process of informing the patient and...
Medical errors have more recently been recognized as a serious public health problem, reported as the third leading cause of death in the US.[1] However, because medical errors are comprised of different types of failures (eg, diagnostic or medication errors) that can result in various outcomes (eg, near-miss, injury, or no harm), estimates of the incidence of medical errors vary widely in ...
Thus, this narrative review aims to analyze and describe the relationship between medical errors, medical negligence, and the practice of D.M.
Chapte r 2. Medication-Relate d Errors: A Literature Review of. Incidenc e and Antecedents. Gay a Carlton and Mary A. Blegen. ABSTRAC T. Patient safety has become a major concern for both society ...
Keywords: literature review, medication errors, patient safety Study search and selection flow Percentage of Medication Errors Occurrence
Diagnostic errors are associated with patient harm and suboptimal outcomes. Despite national scientific efforts to advance definition, measurement and interventions for diagnostic error, diagnosis in mental health is not well represented in this ongoing work. We aimed to summarise the current state of research on diagnostic errors in mental health and identify opportunities to align future ...
Background: Diagnostic errors are an underappreciated cause of preventable mortality in hospitals and pose a risk for severe patient harm and increase hospital length of stay. Objective: This study aims to explore the potential of machine learning and natural language processing techniques in improving diagnostic safety surveillance. We conducted a rigorous evaluation of the feasibility and ...
The phrase medical errors is an umbrella term for all errors that occur within the health care system, including mishandled surgeries, diagnostic errors, equipment failures, and medication errors. This article is a review and discussion of the literature on the scope of medical errors, with a focus on drug-related problems and medication errors.
Objective: This systematic literature review aims to identify barriers and facilitators to the implementation of digital health services for people with musculoskeletal conditions in the primary health care setting. Methods: PubMed, Embase, and CINAHL were searched for eligible qualitative and mixed methods studies up to March 2024.
The phrase medical errors is an umbrella term for all errors that occur within the health care system, including mishandled surgeries, diagnostic errors, equipment failures, and medication errors. This article is a review and discussion of the literature on the scope of medical errors, with a focus on drug-related problems and medication errors.
An important contribution of the research is the use of data from medical records, containing multiple information from investigations and visits, compared to most studies in the literature that ...
Equipment errors: Medical equipment design flaws, mishandling, user error, and malfunction are common causes of medical errors. Additionally, a significant number of medical devices have been implanted in patients (eg, pacemakers, defibrillators, and nerve and brain stimulators), which may malfunction and result in life-threatening complications.
A systematic literature review was performed to identify trials that assessed the efficacy and safety of interventions used in patients that progressed on prior ARAT therapies. A literature search was conducted using the OVID platform that searched the EMBASE, MEDLINE, and CENTRAL bibliographic databases.
A robust peer review and quality assurance (QA) process serves as a cornerstone of healthcare litigation defense, providing a critical layer of protection against medical malpractice claims. This process ensures that healthcare providers are held to high standards of care and that any deviations from these standards are identified and addressed ...
Background Academic achievement is essential for all students seeking a successful career. Studying habits and routines is crucial in achieving such an ultimate goal. Objectives This study investigates the association between study habits, personal factors, and academic achievement, aiming to identify factors that distinguish academically successful medical students. Methods A cross-sectional ...
This Neonatology Medical Literature Review session will take place on Thursday, March 12, 2024 at 12:00 p.m. Attendance will be available remotely through Zoom. ... and applying medical literature to clinical practice. The series aims to expand the knowledge of learners with regard to clinical epidemiology, biostatistics, and other research ...
Abstract Background: Ethical and professional guidelines recommend disclosure of medical errors to patients. The objective of this study was to review the empirical literature on disclosure of medical errors with respect to (1) the decision to disclose, (2) the process of informing the patient and family, and (3) the consequences of disclosure or nondisclosure.