Europe PMC

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


Background

Digital health technologies can be key to improving health outcomes, provided health care workers are adequately trained to use these technologies. There have been efforts to identify digital competencies for different health care worker groups; however, an overview of these efforts has yet to be consolidated and analyzed.

Objective

The review aims to identify and study existing digital health competency frameworks for health care workers and provide recommendations for future digital health training initiatives and framework development.

Methods

A literature search was performed to collate digital health competency frameworks published from 2000. A total of 6 databases including gray literature sources such as OpenGrey, ResearchGate, Google Scholar, Google, and websites of relevant associations were searched in November 2019. Screening and data extraction were performed in parallel by the reviewers. The included evidence is narratively described in terms of characteristics, evolution, and structural composition of frameworks. A thematic analysis was also performed to identify common themes across the included frameworks.

Results

In total, 30 frameworks were included in this review, a majority of which aimed at nurses, originated from high-income countries, were published since 2016, and were developed via literature reviews, followed by expert consultations. The thematic analysis uncovered 28 digital health competency domains across the included frameworks. The most prevalent domains pertained to basic information technology literacy, health information management, digital communication, ethical, legal, or regulatory requirements, and data privacy and security. The Health Information Technology Competencies framework was found to be the most comprehensive framework, as it presented 21 out of the 28 identified domains, had the highest number of competencies, and targeted a wide variety of health care workers.

Conclusions

Digital health training initiatives should focus on competencies relevant to a particular health care worker group, role, level of seniority, and setting. The findings from this review can inform and guide digital health training initiatives. The most prevalent competency domains identified represent essential interprofessional competencies to be incorporated into health care workers' training. Digital health frameworks should be regularly updated with novel digital health technologies, be applicable to low- and middle-income countries, and include overlooked health care worker groups such as allied health professionals.

Free full text 


Logo of jmirLink to Publisher's site
J Med Internet Res. 2020 Nov; 22(11): e22706.
Published online 2020 Nov 5. https://doi.org/10.2196/22706
PMCID: PMC7677019
PMID: 33151152

A Digitally Competent Health Workforce: Scoping Review of Educational Frameworks

Monitoring Editor: Gunther Eysenbach
Reviewed by Sheyu Li and Karen Day
Nuraini Nazeha, BA,1 Deepali Pavagadhi, MSc,1 Bhone Myint Kyaw, MBBS, MSc, PhD,1 Josip Car, MD, PhD, FRCPE, FFPH,corresponding author1,2 Geronimo Jimenez, MA,1,3 and Lorainne Tudor Car, MD, MSc, PhD2,4
1 Centre for Population Health Sciences, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore,
2 Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, United Kingdom,
3 Department of Public Health and Primary Care, Leiden University Medical Center, Netherlands, Netherlands,
4 Family Medicine and Primary Care, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore,
Josip Car, Centre for Population Health Sciences, Lee Kong Chian School of Medicine, Nanyang Technological University, 11 Mandalay Road, Singapore, Singapore, Phone: 65 69047005, [email protected].

Associated Data

Supplementary Materials

Abstract

Background

Digital health technologies can be key to improving health outcomes, provided health care workers are adequately trained to use these technologies. There have been efforts to identify digital competencies for different health care worker groups; however, an overview of these efforts has yet to be consolidated and analyzed.

Objective

The review aims to identify and study existing digital health competency frameworks for health care workers and provide recommendations for future digital health training initiatives and framework development.

Methods

A literature search was performed to collate digital health competency frameworks published from 2000. A total of 6 databases including gray literature sources such as OpenGrey, ResearchGate, Google Scholar, Google, and websites of relevant associations were searched in November 2019. Screening and data extraction were performed in parallel by the reviewers. The included evidence is narratively described in terms of characteristics, evolution, and structural composition of frameworks. A thematic analysis was also performed to identify common themes across the included frameworks.

Results

In total, 30 frameworks were included in this review, a majority of which aimed at nurses, originated from high-income countries, were published since 2016, and were developed via literature reviews, followed by expert consultations. The thematic analysis uncovered 28 digital health competency domains across the included frameworks. The most prevalent domains pertained to basic information technology literacy, health information management, digital communication, ethical, legal, or regulatory requirements, and data privacy and security. The Health Information Technology Competencies framework was found to be the most comprehensive framework, as it presented 21 out of the 28 identified domains, had the highest number of competencies, and targeted a wide variety of health care workers.

Conclusions

Digital health training initiatives should focus on competencies relevant to a particular health care worker group, role, level of seniority, and setting. The findings from this review can inform and guide digital health training initiatives. The most prevalent competency domains identified represent essential interprofessional competencies to be incorporated into health care workers’ training. Digital health frameworks should be regularly updated with novel digital health technologies, be applicable to low- and middle-income countries, and include overlooked health care worker groups such as allied health professionals.

Keywords: digital health, eHealth, health professions education, digital competency, competency, framework, review, medical education

Introduction

Background

Over the last three decades, there has been considerable interest in the use of digital health to enhance the quality, efficiency, and safety of health care [1,2]. Digital health and eHealth are often used interchangeably and broadly defined as “the use of information and communications technology in support of health and health-related fields” [3]. An analysis of various digital health definitions revealed three distinct yet overlapping uses such as monitoring, tracking, and informing health (eg, mobile devices, mobile sensors and wearables, apps, social media); enabling health communication among various stakeholders (eg, telehealth, virtual consultations); and storing, managing, and utilizing health data (eg, electronic medical records, electronic medication systems) [4]. Digital health tools have the potential to provide health care workers with a holistic view of patients’ medical conditions through access to their health-related data and improved communication, regardless of distance and access [5]. Furthermore, the use of digital technology in health care could potentially reduce turnaround times, resource use, medication errors, and adverse drug events; increase the use of preventive care; and enable greater adherence to clinical guidelines [6-8].

Training and educating health care workers to be digitally competent is important for several reasons.

First, with the growing use of digital technology in health care, the roles and responsibilities of the health workforce are transforming in an unprecedented manner, intensifying the need for capacity building and continuous professional development. For example, a recent review commissioned by the United Kingdom Secretary of State for Health and Social Care (ie, the Topol Review) reported that within the next two decades, the majority of jobs in the National Health Service (NHS) will have a digital component [9]. Second, the importance and potential of remote care has been brought to light recently with the COVID-19 pandemic. Virtual consultation devices and electronic systems are indispensable tools used to diagnose and treat patients with potential COVID-19 infections as well as all other infections [10,11]. Third, even though the current and next generation of practitioners may be seen as “digital natives” [12], surveys of health care workers show that they would appreciate more training on digital technology [13,14]. Finally, improving digital literacy capabilities could lead to better adoption and implementation of digital services and technologies in health care settings [15]. Similarly, poor digital health literacy was found to be the most common barrier to the digital transformation of health care [16], and thus, the adoption of health technologies has been gradual in countries such as the United States [17], Europe [16], and Australia [18]. For the above-mentioned reasons, there is an increasing number of medical schools introducing digital health training into their curricula [12,19,20].

Such training programs should be guided by a clear framework of digital health competencies suited for different health care worker groups, settings, contexts, seniority, and role. Although there is an increasing number of individual digital health competency frameworks and reviews focusing on a specific health care worker role or setting [21-24], there is a need for consolidation, analysis, and a comprehensive overview of existing frameworks for all health care worker groups. This includes frameworks that are specific for and those that are relevant across different health professions, roles, or settings. Such an overview is important to inform increasingly interdisciplinary teams working in medicine and health care and corresponding future training initiatives, policy development, and research.

Objectives

The objective of this review is to identify and analyze the available digital health competency frameworks, regardless of health profession, role, or setting. This scoping review takes into consideration the heterogeneity and complexity of this field, and we aim to identify (1) the intended applications of digital health competency frameworks; (2) the methodologies employed; (3) the targeted audience in terms of health professions and settings; and (4) the type of competencies included in the frameworks. By doing so, we aim to provide an in-depth analysis of the existing frameworks as well as identify potential gaps and propose recommendations for the development of future frameworks and digital health training initiatives.

Methods

Study Design

We followed the guidelines by the Joanna Briggs Institute [25] in performing a literature review and guidelines by Tricco et al [26] in creating a Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow chart. The protocol for this review was registered with the Open Science Framework [27]. In this review, we used the World Health Organization’s definition of digital health as “the combination of e-health and m-health as well as emerging areas, such as the use of advanced computing sciences in big data, genomics and artificial intelligence” [3].

Eligibility Criteria

We included studies and reports focusing on the development and reporting of a digital health competency framework for health care workers. In this review, a competency framework is defined as a repository or a model that identifies, enlists, structures, and organizes competencies into meaningful categories and that has been developed via a systematic methodology or a relevant, established organization. This definition was developed a priori by referring to the existing definitions and descriptions, and looking at the common features of formerly identified digital health competency frameworks applicable to health care workers [28]. We included studies and reports on all health professions, including pre- and in-service, health care settings, and languages. Studies before January 2000 were excluded because digital health has evolved at a rapid pace, with substantial changes over the last two decades. The details of the inclusion and exclusion criteria are listed in Multimedia Appendix 1.

Search Strategy

The search strategy was developed collaboratively and iteratively by the reviewers with support from an experienced medical librarian and was guided by the following: (1) the sensitivity of the search strategy to relevant articles identified from previous manual searches and (2) the total number of relevant results in the first few pages of results in Medical Literature Analysis and Retrieval System Online (MEDLINE) and EMBASE (Excerpta Medica dataBASE). The final MEDLINE search strategy (Multimedia Appendix 2) was translated to other databases. Subsequently, the following 6 databases were searched on November 8, 2019: MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Education Resources Information Center (ERIC), PsycINFO, and the Cochrane Library. MEDLINE, EMBASE, ERIC, and PsycINFO were accessed via the Ovid platform, and CINAHL was accessed via EBSCOhost. We expected that there would be substantial unpublished work in this area, for which searches were performed using pertinent keywords (Multimedia Appendix 3) in OpenGrey, ResearchGate, and the first 10 pages of Google and Google Scholar. Websites of relevant professional associations (eg, International Medical Informatics Association [IMIA]), accreditation councils (eg, the US Accreditation Council for Graduate Medical Education [ACGME]), and key government websites (eg, Digital Health Canada, NHS Digital) were also searched (Multimedia Appendix 4).

Screening and Data Extraction

The reviewers screened the search results and assessed the full-text studies for inclusion. For the title and abstract screening, Covidence tool [29], a web-based software platform, and, for full-text screening, EndNote X8 were used. Subsequently, a data extraction form was used to record information from the selected full-text studies using Microsoft Excel. The form was developed to be in line with the research objectives and was piloted by reviewers on 3 studies. The form was further amended (Multimedia Appendix 5), and relevant data were extracted by reviewers. Each round of screening and data extraction process was performed by a pair of reviewers independently, and results were compared thereafter. Disagreements between reviewers were resolved by discussion, and where required, a third reviewer was engaged as an arbiter.

Data Synthesis

We analyzed the identified digital health competency frameworks in terms of their coverage of health professions, education level (eg, preservice or in-service), geographical applicability (ie, local or organizational, regional, national, international), health care settings (eg, acute care, emergency care, primary care), and other comparable features such as source and methodology. In frameworks that did not specify their methodology, an additional internet search was performed to retrieve information on the methods employed for framework development. Following this, we narratively synthesized and described framework characteristics, the evolution of frameworks over time, and the structural composition of competencies.

In addition, we performed a thematic analysis according to a list of steps proposed by Nowell et al [30] to understand the types of digital health competency categories presented in the frameworks. From the included frameworks, 2 reviewers independently classified competency categories into overarching domains. Studies that did not publish the full version of the framework were excluded from the thematic analysis, together with competency categories that were aimed at non–health care workers in a health care setting or irrelevant to digital competencies. Frameworks with ambiguous categories were excluded unless pertaining category descriptions or competencies were provided. Frameworks with competency themes or statements, with no distinct categories, were also included in the analysis by carefully allocating them to the identified domains. In some cases, where a single competency statement or theme encompassed several components of a competency, it was allocated to more than one relevant domain. After discussion and consensus, the reviewers derived a consolidated list of identified domains and their definitions and the prevalence of each identified domain across the included frameworks.

Results

Study Characteristics

The search generated 14,229 articles, of which 14,091 were from database searches and 138 from gray literature. After duplicates were removed and screening was completed, 33 articles were deemed eligible for inclusion. Of these, 27 articles presented individual frameworks. The remaining 6 articles presented preliminary findings followed by finalized versions of their frameworks (Staggers et al [31,32]; Egbert et al [33,34]; Hubner et al [35,36]), adding 3 more individual frameworks. As a result, a total of 30 frameworks are presented in this review (Figure 1), of which 16 were found through a gray literature search.

An external file that holds a picture, illustration, etc.
Object name is jmir_v22i11e22706_fig1.jpg

PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow chart.

In terms of methodology, 14 frameworks employed literature review as an initial step, subsequently finalizing the frameworks through the use of expert consultations (n=5) [37-41], focus group discussions (n=3) [33,34,42,43], Delphi methodology (n=5) [31,32,44-47], or expert surveys [48]. In total, 11 other frameworks used one or a combination of methodologies (ie, Delphi, expert discussions, workshops, surveys) to reach consensus, largely by engaging various experts such as informaticists, health professionals, educators, and academics [21,22,36,49-56]. Of the remaining frameworks, 2 used only literature review to select relevant competencies [57,58], and 3 frameworks were built on the foundation of other published frameworks [59-61]. In addition, the frameworks were developed by a team of authors from a single university or institute (eg, University of Minnesota, School of Nursing) [44], by an international- or national-level organization (eg, IMIA, Australian Health Informatics Council [AHIEC]) [49,57], or by means of a collaborative effort to produce frameworks such as Technology Informatics Guiding Education Reform (TIGER) [35,36,52] and Health Information Technology Competencies (HITCOMP) [41].

In terms of geographical relevance, 15 frameworks were country-specific [21,33,37,38,40,42,45,47,48,50,55-59], 1 was specific to the European Union region [61], 5 were applicable globally [35,36,41,49,52,54], and the remaining did not specify (n=9). In terms of health care settings, 4 were developed for remote care delivery [39,51,53,60], 1 framework each for hospitals [48], acute care [41], and homecare [50], while the remaining frameworks either were applicable to all health care settings (n=5) [42,45,56,57,59] or did not specify (n=18). In terms of health professions, 14 frameworks targeted nurses, 4 targeted doctors, of which one also included dentists, and 1 framework each targeted psychiatrists, dietitians, and public health professionals; 9 frameworks targeted health care workers in general, of which 5 specified the inclusion of administrative, information technology (IT) support, and health informatics specialist roles [41,52,54,57,61], and 1 specified the inclusion of allied health professionals [39]. Among the nursing frameworks, 7 were meant for in-service nurses [21,31,32,42-44,46,48], 5 for preservice nursing students [33-37,53,58], and 2 for both [22,50]. Of the 4 medicine-focused frameworks, one focused on in-service doctors [40], another on preservice medical students [55], and 2 on both [59,60]. The framework characteristics and summary of the findings of the included studies are presented in Table 1 and Table 2, respectively. Additional details of the included studies are presented in Multimedia Appendix 6 [21,22,31-63].

Table 1

Characteristics of the 30 frameworks.

CharacteristicsValues, n (%)
Publication dates

2000-20106 (20)

2010-201924 (80)
Source

Database14 (47)

Gray literature16 (53)
Geographical setting

Country15 (50)

Region1 (3)

International5 (17)

Not specified9 (30)
Health care setting

Acute care1 (3)

Home care1 (3)

Hospitals1 (3)

Remote care4 (13)

All health care settings5 (17)

Not specified18 (60)
Health care profession

Nursing14 (47)

Medicine4 (13)

Allied health1 (3)

Psychiatry1 (3)

Public health professionals1 (3)

Unspecified or applicable to multiple health professions9 (30)
Educational level

In-service13 (43)

Preservice9 (30)

Both8 (27)

Table 2

Summary of findings of included studies.

Study IDContext (country; health care setting)Intended audience (profession; educational level)MethodologyOrganization of framework
Academy of Medical Royal Colleges (2011) [59]Scotland; allDoctors and dentists; preservice and in-serviceFramework aligned with other competency frameworks418 competencies divided into 20 domains, and further subdivided into outcomes (ie, knowledge, skills, behavior)
AHIECa (2011) [57]Australia; allAll HCPsb including admin and ITc support staff; preservice and in- serviceLiterature review drew on a wide range of major initiatives45 competencies grouped into 3 categories and assigned a competency level ranging from 1 to 6
AFMCd in Partnership with Canada Health Infoway (2014) [55]Canada; not specifiedMedical students; preserviceFramework was based on contributions from experts25 competencies classified according to physicians’ roles and each competency is further divided into preclinical and clerkship milestones
Australian Nursing and Midwifery Federation (2015) [42]Australia; allNurses and midwives (registered nurses, midwives, and enrolled nurses); in-service
  • Literature review

  • Consensus via focus groups, on-line survey, and expert interviews

53 competencies grouped into 3 categories and 10 subcategories
Ayres (2012) [45]United States; allRegistered dietitians, and dietetic technicians, registered and students; preservice and in-service
  • Literature review

  • Delphi study

216 competencies grouped into 3 categories for each level of practice
Barakat (2013) [50]The Netherlands; home careNurses; pre-service and in-serviceA two-day collaborative workshop with academic experts14 competencies organized into 5 themes
Brunner (2018) [47]Australia; not specifiedHealth graduates; preservice
  • Literature review

  • Focus group discussion

  • Delphi study

40 competencies organized into 4 domains and further divided into knowledge and performance cues
Chang (2011) [21]Taiwan; not specifiedNurses; in-service3 web-based Delphi rounds conducted with experts318 competencies grouped into 3 categories for each level of practice
Collins (2017) [46]Not specifiedNurse leaders; in-service
  • Literature review

  • Delphi study (3 rounds)

  • Exploratory factor analysis for scale optimization and factor identification

74 competencies organized into 15 categories, and 15 of the most relevant competencies are ranked.
Crawford (2016) [51]Not specified; remote carePsychiatry residents; in-serviceExpert panel and interviews with faculty and psychiatry residences15 competencies sorted by professional roles, with examples
Curran (2003) [22]Not specifiedNurse practitioners; preservice and in-serviceConsensus with a team of nurse informaticists and nurse practitioner program directors32 competencies grouped into 3 categories
Egbert (2016) [33]; Egbert (2019) [34]Austria, Switzerland, Germany; not specifiedNurses; preservice
  • Literature review

  • Expert survey

  • Focus group discussion and consensus

24 competency areas identified, and 5 of the most relevant areas ranked for 5 nursing roles
HITCOMPe (2019) [41]International; acute careAll HCPs; preservice and in-service
  • Literature review

  • Survey sent to international experts

  • Gap analysis

  • Expert consultation

1025 competencies organized into 33 competency areas, for 5 levels of practice across 5 domains
Hilty (2015) [60]Not specified; remote careDoctors, medical students; preservice and in-serviceCompetencies organized using the US ACGME framework, with input from the CanMEDS frameworkCompetencies listed for 8 main categories and subcategories, for each level of practice
Honey (2018) [58]New Zealand; not specifiedRegistered nurses; preservice
  • Curriculum mapping

  • Literature review

4 domains identified, and relevant subcategories and examples presented for each domain
Hubner (2016) [35]International; not specifiedNurses; preservice
  • Survey sent to international experts

  • A workshop was held to validate competencies

24 competency areas identified, and 6 of the most relevant areas ranked for 5 nursing roles
Hubner (2018) [36]International; not specifiedNurses; preservice
  • Survey sent to international experts

  • A workshop was held to validate competencies

  • 24 competency areas identified, and sorted into 6 overarching domains

  • 10 of the most relevant areas ranked for 5 nursing roles

Hubner (2019) [52]International; not specifiedAll HCPs; preservice
  • Adapted Hubner (2016 and 2018)’s work [35,36] to include more HCP roles

  • Survey was sent to international experts

33 competency areas are identified, and the 10 most relevant competencies are ranked for each HCP role
Hwang (2008) [48]Taiwan; hospitalClinical nurses; in-service
  • Literature review

  • Expert survey

49 competencies grouped into 3 main categories and subcategories
Jidkov (2019) [40]United Kingdom; not specifiedDoctors; in-service
  • Literature review

  • Curricular content analysis

  • Expert consultation

20 competencies organized into 6 domains
Maheu (2018) [39]Not specified; remote careAll HCPs including allied health professionals; Preservice and in-service
  • Literature review

  • Expert consultation

7 domains identified, which are further broken down into 51 telebehavioral objectives, followed by 149 telebehavioral practices across 3 levels
Mantas (2010) [49]International; not specifiedAll HCPs; in-serviceRecommendations were discussed and refined by the IMIAf task force.34 competencies organized into 3 BMHIg domains and each competency is determined if it is required by an IT user or a BMHI specialist according to 3 proficiency levels
Nagle (2014) [37]Canada; not specifiedRegistered nurses; preservice
  • Literature review

  • Consensus with experts through 3 rounds of feedback

19 competencies grouped into 3 domains.
NHS (2018) [56]United Kingdom; allAll HCPs; in-serviceConsultations with different stakeholders and workforce groups [62]An overarching domain broken down into 5 domains, each with a set of description and competencies sorted according to 4 proficiency levels
Public Health Informatics Institute (2016) [38]United States; not specifiedPublic health professionals; in-service
  • Literature review

  • Expert consultation

8 categories identified, each with a set of competency statement and competencies
JASEHN (2018) [61]Region; not specifiedAll HCPs including admin and IT support staff; in-service
  • Literature review

  • Framework aligned with roles and competences as per the European eCompetence Framework

  • Use of framework descriptions to determine skill level for each role [63]

  • Model 1: mission and main tasks described for 3 main profiles of health care workers (ie, health, nonhealth, and IT)

  • Model 2: 52 competencies grouped into 6 domains, where each competency has a description, and a set of associated knowledge and skill, according to 5 proficiency levels

Staggers (2001) [31]Not specifiedNurses; in-service
  • Literature review

  • Consensus with experts

304 competencies grouped into 3 categories for each level of practice
Staggers (2002) [32]Not specifiedNurses; in-service
  • Follow-up from Staggers (2001) [31]

  • 3 Delphi rounds were conducted

281 competencies grouped into 3 categories for each level of practice
Thye (2018) [54]International; not specifiedAll HCPs including admin and IT support staff; preservice
  • Mapped competency areas from Hubner (2018) [36] and HITCOMP [41]

  • Survey was sent to HCPs

33 competency areas identified, and the 10 most relevant interprofessional areas are listed
Trangenstein (2009) [43]Not specifiedNurse scholars; in-service
  • Literature review

  • Discussion and consensus

7 competency domains sorted according to nursing level of practice
Van Houwelingen (2016) [53]Not specified; remote careNurses; preservice
  • Survey with competencies was sent to participants

  • Delphi study (4 rounds)

52 competencies organized into 3 categories, where skills are further subdivided into 5 domains
Westra and Delaney (2008) [44]Not specifiedNurse leaders; in-service
  • Literature review

  • Delphi study

92 competency areas are grouped into 3 categories

aAHIEC: Australian Health Informatics Education Council.

bHCP: health care professional.

cIT: information technology.

dAFMC: Association of Faculties of Medicine of Canada.

eHITCOMP: Health Information Technology Competencies.

fIMIA: International Medical Informatics Association.

gBMHI: biomedical and health informatics.

Evolution of Frameworks

The digital health competency frameworks have drawn upon each other and have incrementally advanced the recommendations made in this area, as presented in Figures 2 and and3.3. The initial work of Staggers et al [31,32], which targeted nurses at 4 levels of practice, has been reproduced and adapted to suit different nursing roles (eg, nurse leaders, nurse practitioners) [22,44], health professions (eg, dietitians) [45], and even geographical settings (eg, Taiwan, Canada; Figure 2) [37,48]. In another instance, to propose competencies for nurse leaders, Collins et al [46] expanded and reorganized competency categories from Westra and Delaney [44], which initially drew inspiration from the framework by Staggers et al [31,32]. The framework by Staggers et al [31,32] was updated 10 years later by Chang et al [21] with 42 new competencies.

An external file that holds a picture, illustration, etc.
Object name is jmir_v22i11e22706_fig2.jpg

Digital health competency frameworks adapted from Staggers framework.

An external file that holds a picture, illustration, etc.
Object name is jmir_v22i11e22706_fig3.jpg

Development of recent digital health competency frameworks. HITCOMP: Health Information Technology Competencies; TIGER: Technology Informatics Guiding Education Reform.

Another commonly referenced framework is that by Egbert et al (Figure 3) [33,34]. This framework identified 24 core competency areas and conducted a survey with experts to rank the most relevant competency areas for nurses in Austria, Switzerland, and Germany. The same survey with 24 core competency areas was then sent to multiple countries to put forth international recommendations for nursing informatics, widely known as the TIGER framework [35,36]. The TIGER framework grouped the core competency areas into 6 overarching domains (ie, data, information and knowledge, information exchange and information sharing, ethics and legal issues, systems life cycle management, management in informatics, biostatistics, and medical technology) and ranked the most relevant competencies for nursing internationally. Subsequently, the TIGER framework prompted its 2.0 version to include a wider spectrum of health care workers [52], and inspired the work by Thye et al [54] where interprofessional competencies were identified.

One framework that was accessible through an open-source internet-based database is the HITCOMP Tool and Repository [41]. HITCOMP was produced by the eHealth Workforce Development Workgroup as part of the EU*US eHealth Work Project. Its overall goal was to map, quantify, and project the needs of a digitally competent workforce [64]. This tool covers the digital competencies required in acute care settings for 5 broad roles of health care workers, similar to the TIGER framework version 2.0 (ie, direct patient care; administration; engineering or information, communication, and technology; informatics; and research or biomedicine) [52]. In comparison with the other included frameworks, the HITCOMP framework has the highest number of competencies at 1025.

Other frameworks that inspired the development of subsequent frameworks include the IMIA [49], which was adapted by the AHIEC [57] to create national informatics standards for Australian health professionals, health informaticians, and specialists; the frameworks by Barakat et al [50] and the Academy of Medical Royal Colleges [59], which were adapted by Van Houwelingen et al [53] to develop a telehealth framework aimed at nurses; and the telepsychiatry framework by Hilty et al [60], which laid the foundation for telebehavioral health competencies by Maheu et al [39].

Digital Health Competencies and Categories

Across the included digital health competency frameworks, the number of competency categories, subcategories, and competencies ranged from 3 to 33, 10 to 39, and 15 to 1025, respectively. The wide range of reported competencies reflects the scale and specificity of the frameworks. For example, the framework with 15 competencies was focused on telepsychiatry training for psychiatry residents [51], while a framework with 318 competencies was intended for nurses at 4 different levels of practice [21]. Frameworks with multiple categories or subcategories had a larger number of competencies. For example, the eHealth competency framework by the Academy of Medical Royal Colleges presented 20 categories and included 418 competencies [59].

The primary objective of the frameworks was to guide the development of digital health curricula or training initiatives. Thus, 20 frameworks listed specific competencies (eg, knows how to use medical information systems for retrieval of patient data) [48], 6 frameworks cited case studies or provided examples for integration of competencies into curricula or training programs [33-36,45,51,52,58], and 3 frameworks ranked the most relevant competency areas, while the remaining 2 frameworks proposed only broad competency domains. Furthermore, in 12 frameworks, proficiency level in a digital health area or competency was presented according to the hierarchy of a profession or according to the depth of a skill that can be acquired by a health care worker role. For example, Chang et. al [21] presented competencies according to nursing staff seniority level (ie, a beginning nurse, an experienced nurse, an informatics specialist, an informatics innovator). Conversely, AHIEC assigned each competency a level of 1 to 6 (ie, 1: Remembering; 2: Understanding; 3: Applying; 4: Analyzing; 5: Evaluating; 6: Creating), according to the revised Taxonomy of Learning Domain objectives by Bloom, to indicate the depth of a skill that can be acquired by a health care worker role [57].

In addition, the structure of the included digital health competency frameworks varied. Competencies were organized either based on broad informatics categories (ie, computer skills, informatics knowledge, informatics skills) [21,22,31,32,42,44,45,48,53] or a combination of informatics and noninformatics categories (ie, information systems concepts, management concepts, ethical or legal concepts) [38,41,46,59-61] or based on health care worker roles (ie, communicator, collaborator, professional) [33-36,51,52,54,55]. Alternatively, competencies were sorted according to learning outcomes or statements [37,39,40,43,47,49,50,56-58]. For example, the national guideline for Canadian registered nurses sorted competencies according to 3 overarching statements: (1) uses relevant information and knowledge to support the delivery of evidence-informed patient or client care; (2) uses IT in accordance with professional and regulatory standards and workplace policies; and (3) uses IT in the delivery of patient or client care [37].

Through thematic analysis, we were able to classify the majority of the competency categories presented in the frameworks into 28 domains. These domains are defined in Textbox 1, details of the analysis are provided in Multimedia Appendix 7 [45], and results of the analysis is presented in Multimedia Appendix 8. Competencies relating to the following domains were found to be prevalent in at least half of the included frameworks: informatics concepts and processes (22/30, 73%); health information and records management (19/30, 63%); communication (19/30, 63%); ethics, legal, or regulations (18/30, 60%); privacy and security (17/30, 57%); technical knowledge and support (15/30, 50%); and clinical care delivery (15/30, 50%). Conversely, competencies relating to medicines management (2/30, 7%) [41,59]; attitudes toward IT (4/30, 13%) [48,51,58,60]; IT advocacy (5/30, 17%) [21,22,51,55,60]; and public health (5/30, 17%) [41,49,52,54,55] were found to be uncommon in digital health competency frameworks. Of the 28 identified domains, 20 (71%) were present in at least one-third of the frameworks (Multimedia Appendix 8).

Digital health competency domains identified from the included frameworks.

Administration and general management

  • Use of administrative information technology (IT) applications to perform tasks and procedures, such as planning and delivery of services, business workflows, and human resource management

Analysis

  • Use of IT systems to perform analysis of data, including data visualization, evaluation, and reporting

Attitudes toward IT

  • Attitudes and cultural awareness toward the use of IT in patient care

Clinical care delivery

  • Utilization of IT for the support of clinical care and practice, including use of assistive technologies and electronic test requesting

Communication

  • Use of digital communications (eg, social media, email, etc) to enhance interpersonal skills and to aid in care delivery and decision-making process

Decision support

  • Use of IT for clinical practice decision support

Documentation

  • Use of IT for appropriate documentation tasks and processes, including knowledge of coding and terminologies

Education and training

  • Use of IT in education and training, including e-Learning, mobile learning, and simulation

Ethics, legal, or regulations

  • Knowledge of ethical, regulatory, compliance, and legal requirements relating to health IT

Financial management

  • Knowledge of financial and account management relating to IT applications, including billing and fiscal aspects

Health information and records management

  • Ability to access, collect, store, share, and manage digital health information; use of eHealth records; information and knowledge management

Health care quality and safety

  • Ensuring or improving the quality and safety of health care services with the use of IT

Imaging

  • Knowledge of biomedical imaging digital technologies

Informatics concepts and processes

  • Knowledge and skills in computer basics, information systems, and general health IT use

Integration and interoperability

  • Knowledge of integrated health IT applications, health information exchange, and interoperability standards, including coordination and collaboration aspects

IT advocacy

  • Play an active role in promoting the use of IT in health care environments

Leadership and executive management

  • Providing or enhancing executive leadership skills relating to the use of IT, including setting direction, strategic management, change management, stakeholder management, and governance

Medicines management

  • Management of digital medication records and use of order entry

Patient access and engagement

  • Promoting use of IT applications among patients and supporting or empowering patients for self-management, including patient access to patient health records

Privacy and security

  • Ensuring that digital data and health information are protected and kept confidential by following privacy and security procedures

Project management

  • Knowledge of project management software and associated terminologies

Public health

  • Use of IT to inform public health strategies

Remote care

  • Provision of care at a distance, including telehealth care, eHealth, mobile health, and related fields

Research

  • Appropriate use of IT for research support and innovations

Risk management

  • Managing IT-related risks

Systems implementation

  • Knowledge and skills about IT systems development, management, and implementation

Technical knowledge and support

  • Knowledge of technical aspects of IT systems, including software applications, testing, applied computer science, and IT maintenance and support capabilities

Discussion

Principal Findings

Of the 30 digital health competency frameworks, 14 solely targeted nursing staff. The frameworks predominantly originated from high-income countries and were developed based on literature reviews, followed by expert discussions or a Delphi approach. More than half of the included frameworks, especially those providing national-level recommendations, were from gray literature sources. Most frameworks were published between 2016 and 2019, highlighting the growing interest in digital health competencies in recent years.

The purpose of the retrieved digital health competency frameworks and the intended audience was clearly stated in most frameworks. The earliest frameworks and almost half of all the included frameworks were meant for nurses. This could be due to the significantly larger proportion of nurses in the health workforce [65]. Nurses play a crucial role in supporting health care environments by being a constant point of contact between patients and doctors; thus, there are various aspects of digital capabilities that are required of them (eg, using staff scheduling systems, extracting data from clinical systems, navigating decision support systems) [22]. These nursing-focused frameworks have inspired subsequent works for other health care workers. For example, several competency areas subsumed under broad areas for nurses in the TIGER framework [36] were marked as standalone competency areas (ie, communication, legal issues, interoperability and integration, and life cycle management) for a wider spectrum of health care workers in version 2.0 of the TIGER framework [52]. Notably, only one framework was found for allied health professionals (ie, dietitians) [45], which highlights the perceived lack of interest in educating and training this group of workers in digital health. However, the Health Informatics Society of Australia, now known as the Australasian Institute of Digital Health, highlighted the need to focus on allied health care workers as their involvement is becoming increasingly important in decision making to improve patient care and health outcomes [66]. Furthermore, although there were frameworks for doctors and medical students collectively, only one framework was intended solely for undergraduate medical education. The framework was a national guideline for medical students in Canada briefly describing 25 eHealth competencies [55]. Medical practice relies heavily on communication, which is now achieved through various digital means; thus, the skills to utilize a range of digital technologies should be comprehensive and included in medical education [67]. Moreover, with the COVID-19 pandemic, doctors are required to handle patient consultations digitally [11]. A 2018 survey conducted by European Medical Students’ Association revealed that a majority of medical students rated their eHealth skills to be “poor” or “very poor” and desired for adequate digital health literacy [14].

Most of the included frameworks are useful for application in education or practice, mainly owing to the specificity of competencies, the organization of competencies according to proficiency levels or health care worker roles, and the illustration of case studies and examples to be applicable to various settings. On the other hand, frameworks by Trangenstein et al [43] and Jidkov et al [40] presented only broad competency themes, as it was believed that exhaustive lists of competencies could lead to poor adoption [40]. As the included digital health competency frameworks were heterogeneous in purpose, audience, and setting, it is challenging to determine a single framework as exemplary. Nevertheless, HITCOMP, which was developed via an iterative methodology, was found to be the most comprehensive framework, covering 21 out of the 28 identified competency domains, listing 1025 competencies, and targeting a wide audience of health care workers and medical specialties [41].

The key thrust of work in this area involves competencies related to informatics, followed by eHealth, telehealth or telebehavioral or telepsychiatry, digital capability, and health IT competencies. This distinction may be superficial, given that the definitions and terminologies seem to overlap across frameworks and the nomenclatural differences do not necessarily convey differences in competencies. For example, the interprofessional eHealth framework developed by Thye et al [54] utilized a range of informatics frameworks [33,41,49].

Although frameworks often drew upon each other, there were considerable variations among the identified competencies. The Egbert et al [33,34] framework identified the 5 most relevant competency areas (out of 24) for 5 nursing roles in Austria, Germany, and Switzerland. The TIGER framework [35,36] used the same competency areas and methodology as Egbert et al [33,34] and additionally reached out to experts worldwide for their inputs. The resulting relevant competency areas for a nurse in an IT management role, for example, varied considerably between both frameworks. For this role, competency areas, risk management and project management, ranked the top 5 internationally in the TIGER framework [35,36]; however, it was only relevant in 1 out of 3 countries in the Egbert et al [34] framework. In addition, eHealth, telematics, and telehealth, which were ranked as top 5 by Egbert et al [34] for 2 out of 3 countries (ie, Germany and Austria), did not make it to the top 10 list in the TIGER framework [35,36]. This suggests that the IT management role for nurses could be defined differently depending on each setting. Hence, a clear definition of the role is important to match the appropriate competency skills to a health care worker role.

In our thematic analysis of the competencies included in the retrieved frameworks, we identified 28 competency domains. The most prevalent domain relates to competencies aimed at providing knowledge on informatics concepts and processes. Examples of these include basic computer knowledge, information systems concepts, and principles of informatics, which are fundamental skills to health care workers intending to maximize the use of digital technologies. The other common domains included the ability of health care workers to manage data from health information systems and records and to be well-versed in digital communications. Most of the health-related data today exist in digital form; therefore, it is imperative for health care workers to be able to understand the purpose, basic structures, use, and storage of electronic health records (EHRs). In addition, as digital health entails new forms of communication (eg, virtual consultations, email, chatbots), it is imperative for health care workers to be able to relate information accurately yet efficiently, timely, and delicately to patients, colleagues, and other collaborating stakeholders [68]. Furthermore, the rise in the adoption and utilization of digital technologies has spurred new issues relating to the use of IT [69], which corresponds to the next two common domains of competencies (ie, ethics, legal, or regulations, and privacy and security). These domains stress the importance of health care workers’ adherence to legal and regulatory requirements and to keep up to date with privacy and security policies pertaining to the appropriate use of digital technologies.

Some categories that were found in more recent frameworks, such as attitudes toward the use of IT, medication and prescription, IT advocacy, and public health, reflect the emerging trends in digital capabilities required by health care workers. For example, with the widespread adoption of EHRs and e-prescribing being a key functionality, it is imperative for physicians to be able to perform prescribing tasks efficiently and adapt to new features as systems continually evolve [70]. In addition, as digital technologies have an increasing role in the management of health of communities and populations, frameworks have also started to incorporate competencies related to public health [71]. Similarly, the acceptance of IT and its incorporation into everyday practice hinges on health care workers advocating for their use and being mindful of contextual factors and beliefs that would enable their use in different settings, such as high-income and low- and middle-income countries (LMICs). Other distinct domains such as leadership, administrative, managerial, and financial bring to attention that a digitally competent workforce should also be able to utilize technologies to oversee organizational-level aspects. It was also noted that competencies related to artificial intelligence, robotics, and social media, which are very relevant in current times, were not explicitly mentioned in the included frameworks [5,9,72]. One possible explanation could be that some of these are subsumed under broader categories, for example, competencies regarding the use of social media could be part of the communication category, or that these digital areas have yet to be covered in digital health competency frameworks.

From this synthesis of digital health competency frameworks, we would like to propose recommendations for the development of future frameworks (Textbox 2). First, an iterative methodology that includes literature review and consultations with local and international experts is ideal for a comprehensive framework. Second, it is encouraged for upcoming frameworks to explore competency areas that appeared in more recent frameworks, to cover upcoming digital health areas (ie, health apps, artificial intelligence, autonomous decision-support systems), and to be open to future revisions to be up to date with technological developments. For example, HITCOMP is projected to continue mapping and aligning competencies with the curriculum and other major initiatives [64]. Finally, the lack of a comprehensive and international framework applicable to allied health professionals and LMICs warrants the development of frameworks that include these populations and settings. For example, only the TIGER framework includes case studies of LMICs, such as China, India, and Nigeria [73].

Recommendations for the development of digital health competency frameworks.

Methodology:

  • Literature review, followed by consultations or Delphi study with local experts, followed by engagement with international experts

Content:

  • Explore new competency areas that appeared in recent frameworks (ie, attitudes and advocacy toward the use of information technology (IT), medication management, public health)

  • Update competencies based on technological innovations and adoption and emerging evidence (ie, health apps, artificial intelligence, autonomous decision-support systems)

  • Include essential interprofessional competencies (ie, informatics concepts and processes, health information management, communication, ethics, legal, or regulations, and privacy and security)

Target audience or setting to include:

  • Allied health professionals

  • Low- and middle-income countries

Application:

  • Provide case studies of integration into curricula or training programs or examples of application in practice

The findings from this review can also inform and guide future training initiatives on digital health. When designing an educational or training program, it may not be possible to cover numerous competencies presented in a framework; rather, the program should focus on a specific set of competencies suitable for a particular group of health care workers, role, level of seniority, geographical, and health care setting. However, the identified competency domains prevalent in more than half of the included frameworks (ie, informatics concepts and processes, health information management, communication, ethics, legal, or regulations, and privacy and security) should be considered essential interprofessional competencies and thus should be incorporated into training and education efforts for any health care worker group. In addition, several digital competencies presented in the included frameworks may already be covered within the existing curriculum. For example, competencies within the Analysis and Research category may have been integrated within epidemiology training and evidence-based medicine education, respectively. Therefore, educators should consider integrating digital health training within existing parts of the curriculum and teaching it in an applied manner as much as possible. For example, the use of EHRs could be incorporated into the internal medicine curriculum.

Strengths and Limitations

To our knowledge, this is the first consolidation and analysis of existing digital health competency frameworks regardless of the role of health care workers. We performed a thorough search, including several databases and gray literature sources. Our analysis also provides a comprehensive overview of the types of competencies presented in digital health competency frameworks, which will aid in the training and education of health care workers to be digitally competent in relevant areas. Some weaknesses must be kept in mind when interpreting the findings of this review. Although a substantial number of frameworks from gray literature were included, some could have been missed, potentially national guidelines and standards from LMICs. In addition, when performing the thematic analysis, there were frameworks with vague competency categories and overlaps among some categories, leading to differences in opinions during the classification process. However, the 2 reviewers used their expertise to develop and clearly define the domains and allocate categories from frameworks into these domains, first independently and then through a consensus discussion, to reduce bias and classify as appropriately as possible. Although the reviewers aimed to make the classification process as transparent and reproducible as possible, it must be noted that there could be alternate ways of interpreting and classifying and that categorization may differ in the future with the new advances in digital health.

Conclusions

Of the 30 frameworks included in this scoping review, a majority target nurses, originate from high-income countries, and have been developed using an iterative approach. Our analysis of digital health competency frameworks can help inform the development of future digital health training programs for health care workers. Existing frameworks largely focus on the development of basic IT skills, proficiency in managing health-related information and digital communications, and awareness of ethical, legal, privacy, and security implications relating to IT. Future frameworks and training programs need to take into consideration the evolving nature of digital health and have to be able to incorporate upcoming digital trends, such as artificial intelligence and robotics. There is also a need for frameworks focusing on LMICs, medical students, and allied health professionals.

Acknowledgments

The authors thank Ms Yasmin Lynda Munro from the Lee Kong Chian School of Medicine, Medical Library, for assistance in formulating the search strategy. They would also like to thank Ms Laura Martinengo, Ms Selina Poon, Ms Christina Tan, Mr Gerard Dunleavy, and Mr Rishi S Nannan Panday for their assistance with screening articles and data extraction. The authors would like to acknowledge the funding support from the Lee Kong Chian School of Medicine, Nanyang Technological University Singapore. JC’s and LC’s post at Imperial College London is supported by the National Institute for Health Research North West London Applied Research Collaboration.

This research was supported by funding from the World Health Organization Collaborating Centre for Digital Health and Health Education, provided by the Lee Kong Chian School of Medicine and Nanyang Technological University Singapore, Singapore.

Abbreviations

AHIECAustralian Health Informatics Council
CINAHLCumulative Index to Nursing and Allied Health Literature
EHRelectronic health record
EMBASEExcerpta Medica dataBASE
ERICEducation Resources Information Centre
HITCOMPHealth Information Technology Competencies
IMIAInternational Medical Informatics Association
ITinformation technology
LMIClow- and middle-income country
MEDLINEMedical Literature Analysis and Retrieval System Online
NHSNational Health Services
TIGERTechnology Informatics Guiding Education Reform

Appendix

Multimedia Appendix 1

Inclusion and exclusion criteria.

Multimedia Appendix 2

Search strategy for Medical Literature Analysis and Retrieval System Online (MEDLINE).

Multimedia Appendix 3

Keywords used for searching gray literature.

Multimedia Appendix 4

List of organizations whose websites were searched.

Multimedia Appendix 5

Data extraction form.

Multimedia Appendix 6

Details of included studies.

Multimedia Appendix 7

Allocation of competency categories or themes from included frameworks into overarching competency domains.

Multimedia Appendix 8

Competency domains prevalent across 30 digital health competency frameworks.

Footnotes

Contributed by

Authors' Contributions: LC conceived the idea for the review and advised on the methodology. NN, DP, BK, and GJ were involved in the literature search, screening, and data extraction. NN and GJ were involved in the thematic analysis. NN analyzed and synthesized the data and drafted the manuscript. JC conceived the idea for the review and supervised the study. All authors reviewed the paper and provided critical inputs.

Conflicts of Interest: None declared.

References

1. Catwell L, Sheikh A. Evaluating eHealth interventions: the need for continuous systemic evaluation. PLoS Med. 2009 Aug;6(8):e1000126. 10.1371/journal.pmed.1000126. https://dx.plos.org/10.1371/journal.pmed.1000126. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
2. Peckham D. Electronic patient records, past, present and future. Paediatr Respir Rev. 2016 Aug;(20 Suppl):8–11. 10.1016/j.prrv.2016.06.005. [Abstract] [CrossRef] [Google Scholar]
3. WHO Guideline: Recommendations on Digital Interventions for Health System Strenghtening. World Health Organization. 2019. [2020-10-08]. https://apps.who.int/iris/bitstream/handle/10665/311941/9789241550505-eng.pdf?ua=1. [Abstract]
4. Shaw T, McGregor D, Brunner M, Keep M, Janssen A, Barnet S. What is ehealth (6)? Development of a conceptual model for ehealth: qualitative study with key informants. J Med Internet Res. 2017 Oct 24;19(10):e324. 10.2196/jmir.8106. https://www.jmir.org/2017/10/e324/ [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
5. Global Diffusion of Ehealth: Making Universal Health Coverage Achievable. World Health Organization. 2016. [2020-10-08]. https://apps.who.int/iris/bitstream/handle/10665/252529/9789241511780-eng.pdf?sequence=1.
6. Keasberry J, Scott IA, Sullivan C, Staib A, Ashby R. Going digital: a narrative overview of the clinical and organisational impacts of eHealth technologies in hospital practice. Aust Health Rev. 2017 Dec;41(6):646–64. 10.1071/AH16233. [Abstract] [CrossRef] [Google Scholar]
7. Nanah A, Bayoumi AB. The pros and cons of digital health communication tools in neurosurgery: a systematic review of literature. Neurosurg Rev. 2020 Jun;43(3):835–46. 10.1007/s10143-018-1043-0. [Abstract] [CrossRef] [Google Scholar]
8. Mohsin-Shaikh S, Furniss D, Blandford A, McLeod M, Ma T, Beykloo MY, Franklin BD. The impact of electronic prescribing systems on healthcare professionals' working practices in the hospital setting: a systematic review and narrative synthesis. BMC Health Serv Res. 2019 Oct 22;19(1):742. 10.1186/s12913-019-4554-7. https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-019-4554-7. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
9. The Topol Review: Preparing the Healthcare Workforce to Deliver the Digital Future. The NHS Constitution. 2019. [2020-10-08]. https://topol.hee.nhs.uk/
10. The Government of the Republic of Korea Flattening the Curve on Covid 19: How Korea Responded to a Pandemic Using ICT. The Government of the Republic of Korea. 2020. [2020-10-08]. http://www.undp.org/content/seoul_policy_center/en/home/presscenter/articles/2019/flattening-the-curve-on-covid-19.html.
11. Mian A, Khan S. Medical education during pandemics: a UK perspective. BMC Med. 2020 Apr 9;18(1):100. 10.1186/s12916-020-01577-y. https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-020-01577-y. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
12. Aungst TD, Patel R. Integrating digital health into the curriculum-considerations on the current landscape and future developments. J Med Educ Curric Dev. 2020;7:2382120519901275. 10.1177/2382120519901275. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
13. Stanford Medicine 2020 Health Trends Report: The Rise of the Data-Driven Physician. Stanford Medicine. 2020. [2020-10-08]. http://med.stanford.edu/content/dam/sm/school/documents/Health-Trends-Report/Stanford%20Medicine%20Health%20Trends%20Report%202020.pdf.
14. Digital Health in the Medical Curriculum: Addressing the Needs of the Future Health Workforce. European Medical Students' Association Europe. [2020-10-08]. https://emsa-europe.eu/wp-content/uploads/2019/09/Digital-Health-in-the-Medical-Curriculum_-Addressing-the-Needs-of-the-Future-Health-Workforce.pdf.
15. Improving Digital Literacy. Royal College of Nursing. 2017. [2020-10-08]. https://www.rcn.org.uk/professional-development/publications/pub-006129.
16. Schreiweis B, Pobiruchin M, Strotbaum V, Suleder J, Wiesner M, Bergh B. Barriers and facilitators to the implementation of ehealth services: systematic literature analysis. J Med Internet Res. 2019 Nov 22;21(11):e14197. 10.2196/14197. https://www.jmir.org/2019/11/e14197/ [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
17. Adler-Milstein J, Kvedar J, Bates DW. Telehealth among US hospitals: several factors, including state reimbursement and licensure policies, influence adoption. Health Aff (Millwood) 2014 Feb;33(2):207–15. 10.1377/hlthaff.2013.1054. [Abstract] [CrossRef] [Google Scholar]
18. Evolution of eHealth in Australia: Achievements, Lessons, and Opportunities. Sydney: National E-Health Transition Authority Ltd. 2016. https://tinyurl.com/yy3xg947.
19. Mesko B, Győrffy Z, Kollár J. Digital literacy in the medical curriculum: a course with social media tools and gamification. JMIR Med Educ. 2015 Oct 1;1(2):e6. 10.2196/mededu.4411. https://mededu.jmir.org/2015/2/e6/ [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
20. Pathipati AS, Azad TD, Jethwani K. Telemedical education: training digital natives in telemedicine. J Med Internet Res. 2016 Jul 12;18(7):e193. 10.2196/jmir.5534. https://www.jmir.org/2016/7/e193/ [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
21. Chang J, Poynton MR, Gassert CA, Staggers N. Nursing informatics competencies required of nurses in Taiwan. Int J Med Inform. 2011 May;80(5):332–40. 10.1016/j.ijmedinf.2011.01.011. [Abstract] [CrossRef] [Google Scholar]
22. Curran CR. Informatics competencies for nurse practitioners. AACN Clin Issues. 2003 Aug;14(3):320–30. 10.1097/00044067-200308000-00007. [Abstract] [CrossRef] [Google Scholar]
23. Strudwick G, Nagle L, Kassam I, Pahwa M, Sequeira L. Informatics competencies for nurse leaders: a scoping review. J Nurs Adm. 2019 Jun;49(6):323–30. 10.1097/NNA.0000000000000760. [Abstract] [CrossRef] [Google Scholar]
24. Gonçalves LS, Wolff L, Staggers N, Peres A. Nursing informatics competencies: an analysis of the latest research. NI 2012 (2012) 2012;2012:127. http://europepmc.org/article/MED/24199069. [Europe PMC free article] [Abstract] [Google Scholar]
25. Peters M, Godfrey C, McInerney P, Baldini SC, Khalil H, Parker D. Joanna Briggs Institute Reviewer's Manual. Australia: The Joanna Briggs Institute; 2017. Scoping Reviews. [Google Scholar]
26. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, Moher D, Peters MD, Horsley T, Weeks L, Hempel S, Akl EA, Chang C, McGowan J, Stewart L, Hartling L, Aldcroft A, Wilson MG, Garritty C, Lewin S, Godfrey CM, Macdonald MT, Langlois EV, Soares-Weiser K, Moriarty J, Clifford T, Tunçalp O, Straus SE. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018 Oct 2;169(7):467–73. 10.7326/M18-0850. [Abstract] [CrossRef] [Google Scholar]
27. Pavagadhi D. Digital Health Competency Frameworks for Pre- and In-Service Health Workers from All Health Professions: A Scoping Review Protocol. OSF Registries. [CrossRef]
28. Milner RJ, Gusic ME, Thorndyke LE. Perspective: toward a competency framework for faculty. Acad Med. 2011 Oct;86(10):1204–10. 10.1097/ACM.0b013e31822bd524. [Abstract] [CrossRef] [Google Scholar]
29. Covidence Systematic Review Software. Veritas Health Innovation. [2020-10-08]. https://www.covidence.org/
30. Nowell LS, Norris JM, White DE, Moules NJ. Thematic analysis. Int J Quant Method. 2017 Oct 2;16(1):160940691773384. 10.1177/1609406917733847. [CrossRef] [Google Scholar]
31. Staggers N, Gassert CA, Curran C. Informatics competencies for nurses at four levels of practice. J Nurs Educ. 2001 Oct;40(7):303–16. [Abstract] [Google Scholar]
32. Staggers N, Gassert CA, Curran C. A Delphi study to determine informatics competencies for nurses at four levels of practice. Nurs Res. 2002;51(6):383–90. 10.1097/00006199-200211000-00006. [Abstract] [CrossRef] [Google Scholar]
33. Egbert N, Thye J, Schulte G, Liebe J, Hackl W, Ammenwerth E, Hübner U. An iterative methodology for developing national recommendations for nursing informatics curricula. Stud Health Technol Inform. 2016;228:660–4. [Abstract] [Google Scholar]
34. Egbert N, Thye J, Hackl WO, Müller-Staub M, Ammenwerth E, Hübner U. Competencies for nursing in a digital world. Methodology, results, and use of the DACH-recommendations for nursing informatics core competency areas in Austria, Germany, and Switzerland. Inform Health Soc Care. 2019;44(4):351–75. 10.1080/17538157.2018.1497635. [Abstract] [CrossRef] [Google Scholar]
35. Hübner U, Shaw T, Thye J, Egbert N, Marin H, Ball M. Towards an international framework for recommendations of core competencies in nursing and inter-professional informatics: the tiger competency synthesis project. Stud Health Technol Inform. 2016;228:655–9. [Abstract] [Google Scholar]
36. Hübner U, Shaw T, Thye J, Egbert N, Marin HD, Chang P, O'Connor S, Day K, Honey M, Blake R, Hovenga E, Skiba D, Ball MJ. Technology informatics guiding education reform - tiger. Methods Inf Med. 2018 Jun;57(S 01):e30–42. 10.3414/ME17-01-0155. http://www.thieme-connect.com/DOI/DOI?10.3414/ME17-01-0155. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
37. Nagle LM, Crosby K, Frisch N, Borycki E, Donelle L, Hannah K, Harris A, Jetté S, Shaben T. Developing entry-to-practice nursing informatics competencies for registered nurses. Stud Health Technol Inform. 2014;201:356–63. [Abstract] [Google Scholar]
38. Applied Public Health Informatics Competency Model. Public Health Informatics Institute. 2016. [2020-10-08]. https://www.phii.org/resources/view/9462/applied-public-health-informatics-competency-model.
39. Maheu MM, Drude KP, Hertlein KM, Lipschutz R, Wall K, Hilty DM. Correction to: an interprofessional framework for telebehavioral health competencies. J Technol Behav Sci. 2018 Mar 5;3(2):108–40. 10.1007/s41347-018-0046-6. [CrossRef] [Google Scholar]
40. Jidkov L, Alexander M, Bark P, Williams JG, Kay J, Taylor P, Hemingway H, Banerjee A. Health informatics competencies in postgraduate medical education and training in the UK: a mixed methods study. BMJ Open. 2019 Mar 30;9(3):e025460. 10.1136/bmjopen-2018-025460. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
41. Health Information Technology Competencies. 2020. [2020-10-08]. http://hitcomp.org/competencies/
42. National Informatics Standards for Nurses and Widwives. Australia: Australian Nursing and Midwifery Federation, Federal Office. 2015. [2020-10-08]. http://anmf.org.au/documents/National_Informatics_Standards_For_Nurses_And_Midwives.pdf.
43. Trangenstein PA, Weiner EE, Gordon JS, McArthur D. Nursing informatics for future nurse scholars: lessons learned with the doctorate of nursing practice (DNP) Stud Health Technol Inform. 2009;146:551–5. [Abstract] [Google Scholar]
44. Westra BL, Delaney CW, Delaney C. Informatics competencies for nursing and healthcare leaders. AMIA Annu Symp Proc. 2008 Nov 6;:804–8. http://europepmc.org/article/MED/18998803. [Europe PMC free article] [Abstract] [Google Scholar]
45. Ayres EJ, Greer-Carney JL, Fatzinger McShane PE, Miller A, Turner P. Nutrition informatics competencies across all levels of practice: a national Delphi study. J Acad Nutr Diet. 2012 Dec;112(12):2042–53. 10.1016/j.jand.2012.09.025. http://europepmc.org/article/MED/23174690. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
46. Collins S, Yen P, Phillips A, Kennedy MK. Nursing informatics competency assessment for the nurse leader: the delphi study. J Nurs Adm. 2017 Apr;47(4):212–8. 10.1097/NNA.0000000000000467. [Abstract] [CrossRef] [Google Scholar]
47. Brunner M, McGregor D, Keep M, Janssen A, Spallek H, Quinn D, Jones A, Tseris E, Yeung W, Togher L, Solman A, Shaw T. An ehealth capabilities framework for graduates and health professionals: mixed-methods study. J Med Internet Res. 2018 May 15;20(5):e10229. 10.2196/10229. https://www.jmir.org/2018/5/e10229/ [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
48. Hwang HG, Chen RF, Chang LH, Hsiao JL. A study of the informatics literacy of clinical nurses in Taiwan. Comput Inform Nurs. 2008;26(5):290–9. 10.1097/01.NCN.0000304836.70133.d1. [Abstract] [CrossRef] [Google Scholar]
49. Mantas J, Ammenwerth E, Demiris G, Hasman A, Haux R, Hersh W, Hovenga E, Lun KC, Marin H, Martin-Sanchez F, Wright G, IMIA Recommendations on Education Task Force Recommendations of the international medical informatics association (IMIA) on education in biomedical and health informatics. First revision. Methods Inf Med. 2010 Jan 7;49(2):105–20. 10.3414/ME5119. [Abstract] [CrossRef] [Google Scholar]
50. Barakat A, Woolrych RD, Sixsmith A, Kearns WD, Kort HS. Ehealth technology competencies for health professionals working in home care to support older adults to age in place: outcomes of a two-day collaborative workshop. Med 2 0. 2013;2(2):e10. 10.2196/med20.2711. https://www.medicine20.com/2013/2/e10/ [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
51. Crawford A, Sunderji N, López J, Soklaridis S. Defining competencies for the practice of telepsychiatry through an assessment of resident learning needs. BMC Med Educ. 2016 Jan 26;16:28. 10.1186/s12909-016-0529-0. https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-016-0529-0. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
52. Hübner U, Thye J, Shaw T, Elias B, Egbert N, Saranto K, Babitsch B, Procter P, Ball MJ. Towards the tiger international framework for recommendations of core competencies in health informatics 2.0: extending the scope and the roles. Stud Health Technol Inform. 2019 Aug 21;264:1218–22. 10.3233/SHTI190420. [Abstract] [CrossRef] [Google Scholar]
53. van Houwelingen CT, Moerman AH, Ettema RG, Kort HS, Ten Cate O. Competencies required for nursing telehealth activities: a Delphi-study. Nurse Educ Today. 2016 Apr;39:50–62. 10.1016/j.nedt.2015.12.025. https://linkinghub.elsevier.com/retrieve/pii/S0260-6917(16)00014-9. [Abstract] [CrossRef] [Google Scholar]
54. Thye J, Shaw T, Hüsers J, Esdar M, Ball M, Babitsch B, Hübner U. What are inter-professional ehealth competencies? Stud Health Technol Inform. 2018;253:201–5. [Abstract] [Google Scholar]
55. eHealth Competencies for Undergraduate Medical Education. Canada: The Association of Faculties of Medicine of Canada. 2014. [2020-10-08]. https://www.infoway-inforoute.ca/en/component/edocman/3400-ehealth-competencies-for-undergraduate-medical-education/view-document?Itemid=101.
56. A HealthCare Digital Capabilities Framework. England: NHS. 2018. [2020-10-08]. https://www.hee.nhs.uk/sites/default/files/documents/Digital%20Literacy%20Capability%20Framework%202018.pdf.
57. Health Informaticscope, Careers and Competencies. Australia: Australian Health Informatics Education Council. 2011. [2020-10-08]. https://www.ahiec.org.au/docs/AHIEC_HI_Scope_Careers_and_Competencies_V1-9.pdf.
58. Honey M, Collins E, Britnell S. Guidelines: Informatics for Nurses Entering Practice. University of Auckland. 2018. [2020-10-08]. https://cdn.ymaws.com/www.hinz.org.nz/resource/resmgr/resources/Guidelines_Informatics_for_n.pdf.
59. E Health Competency Framework - Defining the Role of the Expert Clinician. Scotland: Academy of Medical Royal Colleges. 2011. [2020-10-08]. https://www.physio-pedia.com/images/f/f0/EHealth_Competancy_Framework.pdf.
60. Hilty DM, Crawford A, Teshima J, Chan S, Sunderji N, Yellowlees PM, Kramer G, O'neill P, Fore C, Luo J, Li ST. A framework for telepsychiatric training and e-health: competency-based education, evaluation and implications. Int Rev Psychiatry. 2015;27(6):569–92. 10.3109/09540261.2015.1091292. [Abstract] [CrossRef] [Google Scholar]
61. Recommendations on a Common Framework for Mapping Health Professionals' eHealth Competencies. Joint Action to Support the eHealth Network. 2018. [2020-10-08]. https://jasehn.eu/wordpress/wp-content/uploads/2018/07/JAseHN_D7.1.3_RECOMMENDATIONS_common_Framework_mapping_health_profession....pdf.
62. Digital Literacy. Health Education England. [2020-10-08]. https://www.hee.nhs.uk/our-work/digital-literacy.
63. Joint Action to support the eHealth Network JAseHN 677102 - Joint Actions. European Commission. [2020-09-10]. https://webgate.ec.europa.eu/chafea_pdb/health/projects/677102/workpackages.
64. EU US eHealth Works to Improve Global Workforce Development. Technology Informatics Guiding Education Reform. 2017. [2020-10-08]. https://tutcris.tut.fi/portal/files/12978862/Eu_us_ehealth_workforce_development.pdf.
65. Nursing and Midwifery. World Health Organization. [2020-10-08]. https://www.who.int/news-room/fact-sheets/detail/nursing-and-midwifery.
66. Allied Health Professionals: the Untapped Potential in Digital Health. Health Informatics Society of Australia. 2019. [2020-10-08]. https://www.hisa.org.au/wp-content/uploads/2019/02/Allied-Health-Informatics-Position-Statement_draft.pdf.
67. Wells KM. Social media in medical school education. Surgery. 2011 Jul;150(1):2–4. 10.1016/j.surg.2011.05.023. [Abstract] [CrossRef] [Google Scholar]
68. Griffiths Fe, Armoiry X, Atherton H, Bryce C, Buckle A, Cave Jak, Court R, Hamilton K, Dliwayo Tr, Dritsaki M, Elder P, Forjaz V, Fraser J, Goodwin R, Huxley C, Ignatowicz A, Karasouli E, Kim Sw, Kimani P, Madan Jj, Matharu H, May M, Musumadi L, Paul M, Raut G, Sankaranarayanan S, Slowther Am, Sujan Ma, Sutcliffe Pa, Svahnstrom I, Taggart F, Uddin A, Verran A, Walker L, Sturt J. The role of digital communication in patient–clinician communication for NHS providers of specialist clinical services for young people [the Long-term conditions Young people Networked Communication (LYNC) study]: a mixed-methods study. Southampton (UK): NIHR Journals Library. 2018 [Abstract] [Google Scholar]
69. Vayena E, Haeusermann T, Adjekum A, Blasimme A. Digital health: meeting the ethical and policy challenges. Swiss Med Wkly. 2018;148:w14571. 10.4414/smw.2018.14571. https://doi.emh.ch/10.4414/smw.2018.14571. [Abstract] [CrossRef] [Google Scholar]
70. Abramson EL, Patel V, Pfoh ER, Kaushal R. How physician perspectives on e-prescribing evolve over time. A case study following the transition between EHRS in an outpatient clinic. Appl Clin Inform. 2016 Oct 26;7(4):994–1006. 10.4338/ACI-2016-04-RA-0069. http://europepmc.org/article/MED/27786335. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
71. Gamache R, Kharrazi H, Weiner JP. Public and population health informatics: the bridging of big data to benefit communities. Yearb Med Inform. 2018 Aug;27(1):199–206. 10.1055/s-0038-1667081. http://www.thieme-connect.com/DOI/DOI?10.1055/s-0038-1667081. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
72. Alraies MC, Raza S, Ryan J. Twitter as a new core competency for cardiologists. Circulation. 2018 Sep 25;138(13):1287–9. 10.1161/CIRCULATIONAHA.118.032999. [Abstract] [CrossRef] [Google Scholar]
73. EU US eHealth Work Project H2020-SC1-HCO13-2016. Healthcare Information and Management Systems Society. 2016. [2020-10-08]. https://www.himss.org/euus-ehealth-work-projects-global-case-studies.

Articles from Journal of Medical Internet Research are provided here courtesy of JMIR Publications Inc.

Citations & impact 


Impact metrics

Jump to Citations

Citations of article over time

Alternative metrics

Altmetric item for https://www.altmetric.com/details/93759149
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/93759149

Smart citations by scite.ai
Smart citations by scite.ai include citation statements extracted from the full text of the citing article. The number of the statements may be higher than the number of citations provided by EuropePMC if one paper cites another multiple times or lower if scite has not yet processed some of the citing articles.
Explore citation contexts and check if this article has been supported or disputed.
https://scite.ai/reports/10.2196/22706

Supporting
Mentioning
Contrasting
2
106
0

Article citations


Go to all (51) article citations

Data 


Data behind the article

This data has been text mined from the article, or deposited into data resources.

Similar Articles 


To arrive at the top five similar articles we use a word-weighted algorithm to compare words from the Title and Abstract of each citation.