Keywords

Artificial intelligence, Nursing activities, Research trends

 

Authors

  1. Hwang, Gwo-Jen PhD
  2. Chang, Po-Ya MS
  3. Tseng, Wan-Yu MS
  4. Chou, Chia-An MS
  5. Wu, Chih-Hsin MS
  6. Tu, Yun-Fang PhD

Abstract

The present study referred to the technology-based learning model to conduct a systematic review of the dimensions of nursing activities, research samples, research methods, roles of artificial intelligence, applied artificial intelligence algorithms, evaluation measure of algorithms, and research foci. Based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses procedure, this study obtained and analyzed a total of 102 high-quality artificial intelligence-associated nursing activities studies published from 2001 to 2020 in the Web of Science database. The results showed: (1) In terms of nursing activities, nursing management was explored the most, followed by nursing assessment; (2) quantitative methods were most frequently adopted in artificial intelligence-associated nursing activities studies to investigate issues related to patients, followed by nursing staff; (3) the most adopted roles of artificial intelligence in artificial intelligence-associated nursing activities studies were profiling and prediction, followed by assessment and evaluation; (4) artificial intelligence-associated nursing activities studies frequently mixed applied artificial intelligence algorithms and evaluation measure of algorithms; (5) in the dimension of research foci, most studies mainly paid attention to the design or evaluation of the artificial intelligence systems/instruments, followed by investigating the correlation and affect issues. Based on the findings, several recommendations are raised as a reference for future researchers, educators, and policy makers.

 

Article Content

Rapid advancement in computer technologies, in particular, artificial intelligence (AI) technologies, has provided new opportunities to facilitate medical services.1,2 Artificial intelligence is a computer technique that enables computers to behave like humans, giving them the ability to analyze, reason, make decisions, and self-correct.3,4 Artificial intelligence-associated nursing activities (AINAs), referring to the use of AI technologies in nursing services, education, or decision-making, have received attention from numerous researchers in recent years3-6; for instance, a neural network-based text classification model system has been proposed to assist nurses in documenting patient care and potentially reducing the documentation workload.7 Machine learning models of big data have been applied to assist in clinical decision-making.8 In addition, with regard to nursing care, AI technology has been verified by researchers as effectively assisting in nursing care-related tasks such as patient bed allocation, drug administration, and patient care.4,6 In terms of nursing professional learning, AI technology can enhance nursing staff's and students' professional knowledge and skills.1 For example, in one study, students were able to repeatedly operate and practice in the AI-simulated contexts to enhance their related professional skills, which further reduced their learning anxiety and increased their confidence.9

 

Huang et al10 reviewed 77 papers in the nursing and infectious disease field and pointed out five innovative technologies with great potential for nursing activities, namely, AI, the Internet of Things, information and communications technology, simulation technology, and e-learning. Studies have shown that Internet of Things is most frequently adopted in assessment areas, AI is most frequently used in prevention and control areas, information and communications technology is most frequently used in management areas, and simulation and e-learning are most frequently applied in nursing education.10 Researchers have specified that AI technology can analyze massive amounts of data in daily clinical practice (eg, electronic healthcare record systems) and can effectively support clinical decision-making.11 With the assistance of AI technologies, the performance of nursing management can be enhanced.6,10

 

In recent years, the application of AI in the nursing field has been recognized by several researchers.4,12,13 The review studies on the application of AI in the nursing field have mainly focused on nursing pain education,3 primary care,4 and AI agents in healthcare.5 Few studies could be found that reviewed papers on AI in nursing activities. In order to understand the research trend of AI application in nursing activities, the present study referred to Chang et al,1 Huang et al,10 and Hwang and Tu14 and analyzed the trend of Social Sciences Citation Index AINA studies from the Web of Science database published over the past 2 decades from the perspective of nursing activities, research samples, research methods, roles of AI, applied AI algorithms, the evaluation measure of algorithms, and research foci. As suggested by previous review studies,1,10,14 it is important to perceive the trends of a research field by reviewing the studies published in the past 2 decades (ie, 2001-2020); moreover, it is important to compare what was found in the first decade (ie, 2001-2010) and in the second decade (ie, 2011-2020) to see the paradigm shifts between the two time periods.

 

Accordingly, the research questions of the present study were as follows:

 

1. From 2001 to 2020, what were the major nursing activities in AINA studies?

 

2. From 2001 to 2020, what were the research samples selected for AINA studies? What were the research methods adopted in AINA studies?

 

3. From 2001 to 2020, what were the roles of AI in AINA studies?

 

4. From 2001 to 2020, what were the applied AI algorithms and evaluation measure of algorithms in AINA studies?

 

5. From 2001 to 2020, what were the main research foci in AINA studies?

 

 

RESEARCH METHODS

Process of Data Searching and Collection

According to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses15 and previous studies related to AI and nursing,1,14,16 the current study searched for articles published between 2001 and 2020 in the Web of Science database with the following keywords in titles, abstracts, or keywords: the "artificial intelligence" substring ("artificial intelligence" or "machine intelligence" or "intelligent support" or "intelligent virtual reality" or "chat bot*" or "machine learning" or "automated tutor*" or "personal tutor*" or "intelligent agent*" or "expert system*" or "neural network*" or "natural language processing" or "chatbot*" or "intelligent system" or "intelligent tutor*") and the "nursing" substring ("nurs* skill" or "nurs* knowledge" or "nurs* training" "nurs*" or "pupil nurse" or "midwifery" or "nurse academic" or "nurse educator" or "nurse teacher"). A total of 215 articles were obtained after excluding non-articles. Duplicates, articles not written in English, literature reviews, and articles not related to the research topic (AINAs) were removed after screening. After careful selection, a total of 102 suitable articles were retained. Figure 1 presents the article selection process.

  
Figure 1 - Click to enlarge in new windowFIGURE 1. PRISMA flowchart for scoping review.

Data Distribution

Taking the fluctuation of technologies into account, the current study referred to Chang et al1 and Zheng et al17 and classified 102 AINA studies into two periods: a total of 12 AINA studies were published in the first period (2001-2010); and 90, in the second period (2011-2020). Starting from 2015, there has been an increase in the publication number of AINA studies. In addition, the nine journals with the greatest amount of literature published between 2001 and 2020, from the most to least, are CIN: Computers, Informatics, Nursing; International Journal of Medical Informatics; Journal of the American Medical Informatics Association; Journal of Medical Internet Research; International Journal of Environmental Research and Public Health; JMIR Medical Informatics; Journal of Biomedical Informatics; Nurse Education Today; and Nursing Research.

 

Theoretical Model, Data Coding, and Analysis

In this study, the categories for analyzing the target studies were adapted from the model for reviewing AI in education research proposed by Hwang and Tu,14 who suggested that, to investigate the trends of AI-based applications, it is important to review the literature from several dimensions, that is, the roles of AI, research samples, research methods, applied AI algorithms, and research issues. In addition, to explore research issues related to AINA, a systematic review was conducted by referring to the coding scheme of Chang et al,1 Huang et al,10 and Hwang and Tu.14 The dimensions of coding and analysis included nursing activities, research samples, research methods, roles of AI, applied AI algorithms, evaluation measures of algorithms, and research foci.

 

Table 1 illustrates the overall coding scheme of this study. The coding items of the "nursing activities" dimension were determined by referring to the categories suggested by Huang et al.10 The items in the "research sample" and "research methods" dimensions were determined based on the categories suggested by Chang et al.1 The coding items of the "roles of AI," "applied AI algorithms," and "research foci" dimensions were determined by referring to the categories suggested by Hwang and Tu.14 The coding items of the "evaluation measures of algorithms" dimension were determined by referring to the categories suggested by Luan and Tsai.18 Moreover, two researchers who had more than 5 years' experience of conducting studies related to technologies in nursing applications were invited to conduct the coding. The kappa value of the coding results was 0.86, showing high consistency.19 For the inconsistent coding values, the researchers were asked to discuss them until agreement was reached.

  
Table 1 - Click to enlarge in new windowTable 1 Coding Schemes of This Study

RESEARCH RESULTS

Nursing Activities

Table 2 shows the major nursing activities in AINA studies published between 2001 and 2020. By referring to the study of Huang et al,10 this study categorized AI-associated activities into four major categories: (1) prevention and control (14 studies) as essential elements of patient safety and quality of care, including prediction and early detection of disease and quality improvement; (2) nursing management (47 studies), that is, improving nursing quality and patient satisfaction is an important component of nursing, including planning or organizing, decision support/making, patient management, and care management; (3) nursing assessment (37 studies) involves the nursing process and daily nursing tasks such as urinary tract infection assessment, imaging assessment, vascular assessment, and temperature measurement; and (4) nursing education (four studies) includes continuing training for nursing staff and school training for students. In the first period (2001-2010), assessment was the major nursing activity in AINA studies (6 out of 12 studies), followed by recording (two studies), care management (two studies), decision support/making (one study), and school training (one study). In the second period (2011-2020), assessment was the major nursing activity in AINA studies (19 out of 90 studies), followed by patient management (18 studies), care management (16 studies), predicting and detection (14 studies), decision support/making (10 studies), recording (10 studies), and school training (three studies).

  
Table 2 - Click to enlarge in new windowTable 2 Distribution of Major Nursing Activities in AINA Studies in Each Period

As shown in Table 2, from the first to the second period, the numbers of AINA studies related to "nursing management" and "prevention and control" increased the most. For example, in the second period, Hunter et al20 applied data-to-text technology to an electronic patient record system, which could automatically produce helpful natural language nursing shift summaries; Buisseret et al21 designed a method integrating clinical tests and motion capture sensors to optimize the prediction of the risk of falls. Nevertheless, quality improvement of "infection prevention and control" as well as the issues related to continuing education have not been explored in AINA studies.

 

Research Sample and Research Methods

Table 3 shows the distribution of research samples in AINA studies. From 2001 to 2020, the most frequently explored research sample in AINA studies was patients (58 studies), followed by nursing staff (23 studies), mixed (10 studies), non-specified (five studies), students (four studies), and others (two studies). In addition, in Table 3, it was found that few studies explored nursing staff and patients in the nursing education activities of the AINA studies.

  
Table 3 - Click to enlarge in new windowTable 3 Distribution of Research Samples in AINA Studies in Each Period

As demonstrated in Table 3, in the first period, patients (4 out of 12 studies) and nursing staff (four studies) accounted for the majority, followed by mixed (two studies), students (one study), and non-specified (one study). In the second period, patients (54 out of 90 studies) and nursing staff (19 studies) were the most frequently explored research samples, followed by mixed (eight studies), non-specified (four studies), students (three studies), and others (two studies). Furthermore, in the second period, in addition to patients and nursing staff, AINA studies also explored issues related to students, the elderly, and data and records in the hospital. For example, Gochoo et al22 adopted wireless passive infrared sensors to collect the elderly's health data and used several AI algorithms to infer and predict dementia.

 

From 2001 to 2020, the most adopted research method was quantitative (90 out of 102 studies), followed by qualitative (seven studies) and mixed methods (five studies). After comparing AINA studies published in the two periods, it was found that qualitative and mixed methods started to be adopted by researchers in the second period.

 

Roles of Artificial Intelligence in Artificial Intelligence-Associated Nursing Activities

Figure 2 shows the distribution of roles of AI in AINA studies. From 2001 to 2020, the most adopted role of AI in AINA studies was profiling and prediction (63.73%), followed by assessment and evaluation (17.65%), intelligent tutoring systems (10.78%), and adaptive systems and personalization (7.84%). Figure 2 also presents that the most adopted role of AI in care management in the AINA studies was profiling and prediction (36 out of 47 studies), followed by assessment and evaluation (four studies), adaptive systems and personalization (four studies), and intelligent tutoring systems (three studies). For example, Bosque23 developed an intravenous infusion nanotechnology monitoring system to warn nurses of impending peripheral intravenous infusion failure. In the AINA studies, the most frequent role of AI in the nursing assessment component was profiling and prediction (14 out of 37 studies), followed by assessment and evaluation (13 studies), intelligent tutoring systems (six studies), and adaptive systems and personalization (four studies). For instance, Lindberg et al24 used tree-based machine learning methods to determine the most important predictors of inpatient falls and performed cross-validation. In the aspects of prevention and control, the most adopted role of AI was profiling and prediction (13 out of 14 studies), followed by assessment and evaluation (one study). No studies could be found to adopt intelligent tutoring systems or adaptive systems and personalization. For example, Chun et al12 investigated factors related to early pressure injury progression and applied a machine learning approach to develop a model to predict these outcomes. In terms of aspects of nursing education, the most adopted roles of AI were profiling and prediction (two out of four studies) and intelligent tutoring systems (two studies), whereas no research could be found to adopt assessment and evaluation or adaptive systems and personalization. For instance, Kwon et al25 showed how one application of machine learning might support nursing work and discussed how nurses could help improve its relevance and performance. Shorey et al26 developed and examined the use of virtual patients to prepare nursing undergraduate students for communicating with real-life patients, their family members, and other nursing staff during their clinical tenure.

  
Figure 2 - Click to enlarge in new windowFIGURE 2. Roles of AI and AI-associated nursing activities.

Applied Artificial Intelligence Algorithms and the Evaluation Measures of Algorithms

Table 4 shows the distribution of applied AI algorithms in AINA studies. From 2001 to 2020, the most applied AI algorithm was mixed (48 out of 102 studies), with natural language processing (21 studies) and artificial neural networks (seven studies) in the second and third places. In the first period, the most applied AI algorithms were knowledge elicitation methods via interviewing domain experts (three studies) and mixed (three studies), followed by case-based reasoning (two studies), natural language processing (two studies), artificial neural networks (one study), and others (one study). For instance, Martin27 developed and assessed an expert system for calculating the most likely diagnosis, presented photos of the typical ocular findings, and offered information about management and treatment. In the second period, the most applied AI algorithm was mixed (45 studies), whereas the second was natural language processing (19 studies), and the third was artificial neural networks (six studies). For instance, Moen et al7 developed a system based on artificial neural networks and classification to conduct text classification on EHRs, which assisted nurses in effective management in hospitals.

  
Table 4 - Click to enlarge in new windowTable 4 Applied AI Algorithms and Evaluation of Algorithms in Each Period

In the first period, the most adopted AI algorithms in AINA studies were fuzzy logic algorithms. Fuzzy logic is a mathematical logic model developed based on the concept of partial truth values (ie, ranging from "perfectly right" to "perfectly wrong") and has become a widely used instrument for managing imprecision and uncertainty. It has been used in various application domains such as differential diagnosis of alterations in urinary elimination.28 In the second period, the most adopted AI algorithms in AINA studies included random forest, support vector machines (SVMs), decision trees, logistic regression, artificial neural networks, data mining, others, Bayesian inferencing and networks, and so on. As can be seen from Table 4, it has become a trend to adopt mixed AI algorithms in AINA studies. For example, Horng et al29 used an SVM, logistic regression, naive Bayes, and random forests to build four models to predict infection, incrementally adding vital signs, chief complaints, and free text nursing assessment. Shorey et al26 applied natural language processing and a neural network and classification to develop virtual patients to facilitate nursing staff's communication skills training. Sanchez-Montanes et al30 applied various AI algorithms (eg, logistic regression, decision tree, Bayesian network, random forest, and bi-clustering algorithms to build a mortality prediction model for COVID-19 patients).

 

Table 4 also shows the distribution of adopted evaluation measures of algorithms in AINA studies. From 2001 to 2020, the most adopted evaluation measure of algorithms in AINA studies was mixed (51 out of 102 studies), with no evaluation measure of algorithms (22 studies) and accuracy (12 studies) in the second and third places. In the first period, no evaluation measure of algorithms (six studies) accounted for the majority, followed by accuracy (four studies), mixed (one study), and others (one study). For example, Leung and Mao31 evaluated the accuracy of artificial neural networks to develop telephone triage assistants and obtained positive feedback. In the second period, the most adopted evaluation measure of algorithms was mixed (50 studies), with no evaluation measure of algorithms (16 studies) and accuracy (eight studies) in the second and third places. For instance, Lee et al32 compared the effects of six machine learning methods (ie, random forest, logistics regression, linear SVM, polynomial SVM, radial SVM, and sigmoid SVM) on predicting falls in nursing homes. On the other hand, from 2001 to 2020, the most adopted evaluation measure of algorithms was recall/sensitivity, specificity, and accuracy. For instance, Moseley and Mead33 evaluated the accuracy, recall/sensitivity, and specificity of data mining and machine learning to develop a nursing education system that increased the quality of nursing education training at schools. In the second period, there were several newly adopted evaluation measures of algorithms in AINA studies at the same time, including area under the curve, F1 score, positive/negative predictive value, precision-recall curve, precision, and receiver operating characteristic curve.34-36

 

Research Foci

Figure 3 shows the distribution of research foci in AINA studies published from 2001 to 2020. The most frequently explored research focus in AINA studies was system design or evaluating AI system/instrument performance (83.04%), followed by correlation (8.04%), affect (7.14%), and cognition (1.79%). However, a few research foci have not been investigated in AINA studies, such as skills and behaviors. In the aspect of nursing management, the most frequently explored research focus in AINA studies was system design or evaluating AI system/instrument performance (45 studies), followed by correlation (five studies) and affect (one study). For instance, Sandhu et al37 adopted semi-structured interviews to examine the factors affecting the application of a machine learning sepsis early warning system in clinical workflows. For the aspect of nursing assessment, the most frequently explored research focus was system design or evaluating AI system/instrument performance (34 studies), followed by affect (four studies) and correlation (three studies). For example, Hu et al38 used natural language processing techniques applied to a corpus to calculate the number of different healthcare topics and performed sentiment analysis to explore patients' sentiments regarding different healthcare services. In their study, issues related to patient safety received the most attention, followed by information technology and service efficiency. As for the aspect of prevention and control, the most frequently explored research focus was system design or evaluating AI system/instrument performance (13 studies), followed by correlation (one study). For instance, Sun et al39 provided information about COVID-19 infection prevention measures, and identified and predicted the risk and possibility of COVID-19 infection in nursing homes by using a machine learning approach. Galvan et al40 applied artificial neural networks of self-organizing maps to analyze and predict the possible factors influencing the spread of COVID-19. With regard to the aspect of nursing education, the most frequently explored research focus was affect (three studies), followed by cognition (two studies) and system design or evaluating AI system/instrument performance (one study). For instance, researchers showed that combining AI and virtual reality technology in a learning environment to train students with virtual patients could enhance their self-efficacy and communication skills.9,26

  
Figure 3 - Click to enlarge in new windowFIGURE 3. Research foci of the AINA studies in each period.

As can be seen from Figure 3, in the first period, in the dimensions of nursing management, nursing assessment, and nursing education in AINA studies, the most frequently explored research focus was system design or evaluating AI system/instrument performance (12 studies); among those studies, there was one that discussed issues related to system design or evaluating AI system/instrument performance and correlation at the same time.41 On the other hand, the most frequently explored research issue in the second period was system design or evaluating AI system/instrument performance (81 studies), followed by correlation (nine studies), affect (eight studies), and cognition (two studies). During this period, AINA studies began to discuss issues related to cognition and affect.

 

DISCUSSION

Nursing Activities

In AINA studies, the most frequently explored nursing activity was nursing management, followed by nursing assessment. In the first period, nursing assessment accounted for the majority of studies,27 whereas nursing management accounted for the majority in the second period, followed by nursing assessment. Moreover, nursing management received a great deal of attention in AINA studies.42 For instance, Ladios-Martin et al43 integrated data mining and machine learning through the Norton scale and Braden scale to effectively predict the risk of pressure injury. This allowed nurses to pay attention to patients at a high risk of pressure injury without increasing their workload. Tawfik et al44 established a nurse staffing prediction model and evaluated deviation from predicted nurse staffing as a contributor to patient outcomes. In the aspect of nursing assessment, with the development of nursing techniques, the data of patients could be collected through Internet of Things and sensors21; for example, Ocagli et al45 integrated various AI algorithms to evaluate and classify patients' physical conditions and to provide adequate nursing assistance. In addition, among the nursing activities, few AINA studies could be found to examine quality improvement in the dimension of prevention and control or continuing education in the dimension of nursing education.

 

Research Samples and Research Methods

From 2001 to 2020, the most frequently discussed research sample in AINA studies was patients, followed by nursing staff. From the perspective of nursing activities, in the aspects of nursing management and nursing assessment, the most frequently explored research sample was patients, followed by nursing staff. With regard to the aspects of prevention and control (eg, prediction and early detection of disease and quality improvement), patients accounted for the majority, whereas students accounted for the majority in the aspect of nursing education. On the other hand, few AINA studies could be found to explore patients in AI-supported nursing education activities, nursing staff in AI-supported continuing education activities, or students in AI-supported prevention and control, nursing management, and nursing assessment activities. Furthermore, the results showed that the sample size of AINA studies increased significantly, indicating that the advancements in AI technology enhanced the ability to predict and evaluate the data.30 Most of the AINA studies adopted quantitative methods as the research method, whereas several adopted qualitative methods9 and mixed methods26 in the second period. Besides adopting quantitative methods to evaluate and measure the application of AI in the nursing field, researchers also focused on nursing staff's or nursing students' perceptions and experience of AINAs in AINA studies, for example, the nursing staff's opinions on AI-assisted professional judgment through interviews37; the nurses' viewpoints on the use of robots in pediatric units46; student users' attitudes and experience; and clinical instructors' points of view on students' clinical performance after the virtual patient training.9

 

Roles of Artificial Intelligence in Artificial Intelligence-Associated Nursing Activities

The most adopted role of AI in nursing activities was profiling and prediction, followed by assessment and evaluation. In the first period, assessment and evaluation accounted for the majority, whereas profiling and prediction accounted for the majority in the second period, followed by assessment and evaluation. Exploring profiling and prediction as the roles of AI in AINA studies showed the greatest growth. In addition, with the advancements of AI technologies, such techniques as algorithms, prediction models, natural language processing, and machine learning could be applied to analyze substantial data in hospitals (eg, patients' medical records, nursing records, data of medical systems) so as to assist hospitals in accurately predicting the incidence of diseases,47 standardizing terminology for the emergency department,48 and supporting nursing operations and efficiency.2,41

 

In terms of nursing activities, the most frequently adopted role of AI was profiling and prediction.40,49 Besides, in AI-supported prevention and control, no AINA studies could be found to explore the two roles of AI (ie, intelligent tutoring systems and adaptive systems and personalization). With regard to AI-supported nursing education, no AINA studies could be found to explore assessment and evaluation or adaptive systems and personalization as the roles of AI.

 

Applied Artificial Intelligence Algorithms and Evaluation Measures of Algorithms

The advancements in AI technology have facilitated the development of nursing applications. The application of AI algorithms has also become increasingly diverse, and there is a trend towards exploring the integration or comparison of various AI technologies. In AINA studies, the most adopted algorithm was mixed, followed by natural language processing. In the first period, such algorithms as knowledge elicitation methods via interviewing domain experts and mixed accounted for the majority, whereas the most adopted algorithm in the second period was mixed, followed by natural language processing. For instance, an electronic classification system for health records was developed based on artificial neural networks and classification to reduce the time and effort nurses spent on recording care in hospitals.7 Some researchers used various AI algorithms for the evaluation in order to increase the accuracy of data processing.25,41 Furthermore, there were some AI algorithms that were less frequently adopted by AINA studies, such as case-based reasoning, knowledge elicitation methods via interviewing domain experts, classification, convolutional neural networks, evolutionary algorithms, and fuzzy logic algorithms.

 

In the early stage, only a few AINA studies were related to the "evaluation measures of algorithms." Most AINA studies did not use any evaluation measures of algorithms; instead, they investigated the participants' perceptions9,37,46 or the effectiveness of using AI in terms of improving the health of older adults.50 With the progress of AI technology, the evaluation measure of algorithms has become more diverse, such as area under the curve, F1 score, positive/negative predictive value, precision-recall curve, precision, and receiver operating characteristic curve. From 2001 to 2020, the most frequently adopted evaluation measure of algorithms was recall/sensitivity, followed by specificity and accuracy. The mixed evaluation measure of algorithms could increase the accuracy of systems to promote the accuracy and efficiency of AI application in the nursing field.29

 

Research Foci

From the research issues explored, the AINA studies focused on developing systems and assisting doctors with medical diagnosis, a finding similar to that of Kueper et al.4 In nursing activities of prevention and control, nursing management, and nursing assessment, most of the AINA studies put emphasis on system design or evaluating AI system/instrument performance.38 In contrast, the issues related to cognition, affect, skills, behaviors, and correlation were scarcely explored, especially cognition, skills, and behaviors. Moreover, few AINA studies could be found to explore the application of AI technology in nursing education, especially for issues related to affect, cognition, skills, behaviors, correlation, and system design, or evaluating AI system/instrument performance.

 

CONCLUSIONS

The present study analyzed a total of 102 AINA studies published from 2001 to 2020 in the Web of Science database. Researchers indicate that AI technology can assist the professional training of nursing staff and students. It can also help diagnose patients' physical conditions and predict the risk of diseases and accidents, which can foster development in the nursing and medical fields.3,9,25,49 This study classified and summarized the research findings as follows: (1) it analyzed the distribution of nursing activities in AINA studies, (2) it identified research samples and research methods that were less explored in AINA studies, (3) it proposed roles of AI that were less adopted in AINA studies, (4) it pointed out AI algorithms and evaluation measures of algorithms that were less applied in AINA studies, and (5) it indicated research foci that were less discussed in AINA studies.

 

Based on the findings of the study, several recommendations for future AINA research are given: (1) proposing effective strategies to foster nursing staff's and students' AI knowledge and skills and investigating the factors influencing their attitudes towards applying AI technologies to practical applications; (2) developing personalized learning systems to provide AI literacy training for nursing staff and students, and evaluating the training outcomes from diverse dimensions, such as learning achievement, self-efficacy, problem-solving skills, critical thinking skills, and communication skills; (3) exploring patients' and nursing staff's perceptions and acceptance of using AI technologies in personalized care; (4) developing and adopting measures to assess the effectiveness of applying AI technology to nursing activities, such as tests, questionnaires, interviews, rubrics, or coding schemes for behavioral pattern analysis; (5) developing AI technologies to optimize or improve the accuracy of medical diagnosis and treatment, such as analyzing medical diagnostic images with image recognition technologies and expert systems; (6) using AI technologies for nursing data analysis to improve nursing care quality, such as enabling real-time diagnosis and health alerts for individual patients, and preventing and controlling nursing-associated infections; and (7) organizing interdisciplinary research teams to apply AI technologies in smart care, such as home care robots for older adults and patients, and health promotion systems for older adults.

 

To sum up, this study analyzed the AINA research published in the past 2 decades from diverse perspectives. The findings could be a good reference for nursing staff, teachers, and policy makers in nursing institutes, as well as researchers in the field for conducting their work and research in the future.

 

On the other hand, the current study has some limitations: first, only the Web of Science database was considered; second, the coding was conducted based on the technology-based learning review model; the analytical results would be influenced by the model representing the classification and coding schemes. Therefore, it is suggested that a larger scale review be conducted in the future by taking more academic databases and other review models into account.

 

References

 

1. Chang CY, Lai CL, Hwang GJ. Trends and research issues of mobile learning studies in nursing education: a review of academic publications from 1971 to 2016. Computers & Education. 2018;116: 28-48. [Context Link]

 

2. Mairittha T, Mairittha N, Inoue S. Automatic labeled dialogue generation for nursing record systems. Journal of Personalized Medicine. 2020;10(3): 62. [Context Link]

 

3. Harmon J, Pitt V, Summons P, Inder KJ. Use of artificial intelligence and virtual reality within clinical simulation for nursing pain education: a scoping review. Nurse Education Today. 2021;97: 104700. [Context Link]

 

4. Kueper JK, Terry AL, Zwarenstein M, Lizotte DJ. Artificial intelligence and primary care research: a scoping review. The Annals of Family Medicine. 2020;18(3): 250-258. [Context Link]

 

5. Milne-Ives M, de Cock C, Lim E, et al. The effectiveness of artificial intelligence conversational agents in health care: systematic review. Journal of Medical Internet Research. 2020;22(10): e20346. [Context Link]

 

6. Xie B, Tao C, Li J, Hilsabeck RC, Aguirre A. Artificial intelligence for caregivers of persons with Alzheimer's disease and related dementias: systematic literature review. JMIR Medical Informatics. 2020;8(8): e18189. [Context Link]

 

7. Moen H, Hakala K, Peltonen LM, et al. Assisting nurses in care documentation: from automated sentence classification to coherent document structures with subject headings. Journal of Biomedical Semantics. 2020;11(1): 10. [Context Link]

 

8. Senders JT, Staples PC, Karhade AV, et al. Machine learning and neurosurgical outcome prediction: a systematic review. World Neurosurgery. 2018;109: 476-486.e1. [Context Link]

 

9. Shorey S, Ang E, Ng ED, Yap J, Lau LST, Chui CK. Communication skills training using virtual reality: a descriptive qualitative study. Nurse Education Today. 2020;94: 104592. [Context Link]

 

10. Huang F, Brouqui P, Boudjema S. How does innovative technology impact nursing in infectious diseases and infection control? A scoping review. Nursing Open. 2021;8(5): 2369-2384. [Context Link]

 

11. Kaji DA, Zech JR, Kim JS, et al. An attention based deep learning model of clinical events in the intensive care unit. PLoS One. 2019;14(2): e0211057. [Context Link]

 

12. Chun X, Pan L, Lin Y, et al. A model for predicting 7-day pressure injury outcomes in paediatric patients: a machine learning approach. Journal of Advanced Nursing. 2020;77(3): 1304-1314. [Context Link]

 

13. Hamet P, Tremblay J. Artificial intelligence in medicine. Metabolism. 2017;69: S36-S40. [Context Link]

 

14. Hwang GJ, Tu YF. Roles and research trends of artificial intelligence in mathematics education: a bibliometric mapping analysis and systematic review. Mathematics. 2021;9(6): 584. [Context Link]

 

15. Moher D, Liberati A, Tetzlaff J, Altman DGPRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine. 2009;6(7): e1000097. [Context Link]

 

16. Button D, Harrington A, Belan I. E-learning & information communication technology (ICT) in nursing education: a review of the literature. Nurse Education Today. 2014;34(10): 1311-1323. [Context Link]

 

17. Zheng P, Liang X, Huang G, Liu X. Mapping the field of communication technology research in Asia: content analysis and text mining of SSCI journal articles 1995-2014. Asian Journal of Communication. 2016;26(6): 511-531. [Context Link]

 

18. Luan H, Tsai CC. A review of using machine learning approaches for precision education. Educational Technology & Society. 2021;24(1): 250-266. [Context Link]

 

19. Lavrakas PJ. Encyclopedia of Survey Research Methods. Thousand Oaks, CA: SAGE; 2008. [Context Link]

 

20. Hunter J, Freer Y, Gatt A, Reiter E, Sripada S, Sykes C. Automatic generation of natural language nursing shift summaries in neonatal intensive care: BT-Nurse. Artificial Intelligence in Medicine. 2012;56(3): 157-172. [Context Link]

 

21. Buisseret F, Catinus L, Grenard R, et al. Timed up and go and six-minute walking tests with wearable inertial sensor: one step further for the prediction of the risk of fall in elderly nursing home people. Sensors. 2020;20(11): 3207. [Context Link]

 

22. Gochoo M, Tan TH, Velusamy V, Liu SH, Bayanduuren D, Huang SC. Device-free non-privacy invasive classification of elderly travel patterns in a smart house using PIR sensors and DCNN. IEEE Sensors Journal. 2018;18(1): 390-400. [Context Link]

 

23. Bosque EM. Development of an alarm algorithm, with nanotechnology multimodal sensor, to predict impending infusion failure and improve safety of peripheral intravenous catheters in neonates. Advances in Neonatal Care. 2020;20(3): 233-243. [Context Link]

 

24. Lindberg DS, Prosperi M, Bjarnadottir RI, et al. Identification of important factors in an inpatient fall risk prediction model to improve the quality of care using EHR and electronic administrative data: a machine-learning approach. International Journal of Medical Informatics. 2020;143: 104272. [Context Link]

 

25. Kwon JY, Karim ME, Topaz M, Currie LM. Nurses 'seeing forest for the trees' in the age of machine learning: using nursing knowledge to improve relevance and performance. CIN: Computers, Informatics, Nursing. 2019;37(4): 203-212. [Context Link]

 

26. Shorey S, Ang E, Yap J, Ng ED, Lau ST, Chui CK. A virtual counseling application using artificial intelligence for communication skills training in nursing education: development study. Journal of Medical Internet Research. 2019;21(10): e14658. [Context Link]

 

27. Martin L. Knowledge acquisition and evaluation of an expert system for managing disorders of the outer eye. Computers in Nursing. 2001;19(3): 114-117. [Context Link]

 

28. De Moraes Lopes MH, Siqueira Ortega NR, Massad E, De Fatima Marin H. Model for differential nursing diagnosis of alterations in urinary elimination based on fuzzy logic. CIN: Computers, Informatics Nursing. 2009;27(5): 324-329. [Context Link]

 

29. Horng S, Sontag DA, Halpern Y, Jernite Y, Shapiro NI, Nathanson LA. Creating an automated trigger for sepsis clinical decision support at emergency department triage using machine learning. PLoS One. 2017;12(4): e0174708. [Context Link]

 

30. Sanchez-Montanes M, Rodriguez-Belenguer P, Serrano-Lopez AJ, Soria-Olivas E, Alakhdar-Mohmara Y. Machine learning for mortality analysis in patients with COVID-19. International Journal of Environmental Research and Public Health. 2020;17(22): 8386. [Context Link]

 

31. Leung M, Mao JY. Proactive task support enabled by a neural network: a prototype for telephone triage. International Journal of Human-Computer Interaction. 2004;17(3): 309-332. [Context Link]

 

32. Lee SK, Ahn J, Shin JH, Lee JY. Application of machine learning methods in nursing home research. International Journal of Environmental Research and Public Health. 2020;17(17): 6234. [Context Link]

 

33. Moseley LG, Mead DM. Predicting who will drop out of nursing courses: a machine learning exercise. Nurse Education Today. 2008;28(4): 469-475. [Context Link]

 

34. Hu YH, Lee YL, Kang MF, Lee PJ. Constructing inpatient pressure injury prediction models using machine learning techniques. CIN: Computers, Informatics, Nursing. 2020;38(8): 415-423. [Context Link]

 

35. Park JI, Bliss DZ, Chi CL, Delaney CW, Westra BL. Knowledge discovery with machine learning for hospital-acquired catheter-associated urinary tract infections. CIN: Computers, Informatics, Nursing. 2020;38(1): 28-35. [Context Link]

 

36. Womack DM, Hribar MR, Steege LM, Vuckovic NH, Eldredge DH, Gorman PN. Registered nurse strain detection using ambient data: an exploratory study of underutilized operational data streams in the hospital workplace. Applied Clinical Informatics. 2020;11(4): 598-605. [Context Link]

 

37. Sandhu S, Lin AL, Brajer N, et al. Integrating a machine learning system into clinical workflows: qualitative study. Journal of Medical Internet Research. 2020;22(11): e22421. [Context Link]

 

38. Hu G, Han X, Zhou H, Liu Y. Public perception on healthcare services: evidence from social media platforms in China. International Journal of Environmental Research and Public Health. 2019;16(7): 1273. [Context Link]

 

39. Sun CLF, Zuccarelli E, Zerhouni EGA, et al. Predicting coronavirus disease 2019 infection risk and related risk drivers in nursing homes: a machine learning approach. Journal of the American Medical Directors Association. 2020;21(11): 1533-1538. [Context Link]

 

40. Galvan D, Effting L, Cremasco H, Adam Conte-Junior C. Can socioeconomic, health, and safety data explain the spread of COVID-19 outbreak on Brazilian federative units?International Journal of Environmental Research and Public Health. 2020;17(23): 8921. [Context Link]

 

41. Beddoe G, Petrovic S. Enhancing case-based reasoning for personnel rostering with selected tabu search concepts. Journal of the Operational Research Society. 2007;58(12): 1586-1598. [Context Link]

 

42. Clancy TR. Artificial intelligence and nursing: the future is now. The Journal of Nursing Administration. 2020;50(3): 125-127. [Context Link]

 

43. Ladios-Martin M, Fernandez-de-Maya J, Ballesta-Lopez FJ, Belso-Garzas A, Mas-Asencio M, Cabanero-Martinez MJ. Predictive modeling of pressure injury risk in patients admitted to an intensive care unit. American Journal of Critical Care. 2020;29(4): e70-e80. [Context Link]

 

44. Tawfik DS, Profit J, Lake ET, Liu JB, Sanders LM, Phibbs CS. Development and use of an adjusted nurse staffing metric in the neonatal intensive care unit. Health Services Research. 2020;55(2): 190-200. [Context Link]

 

45. Ocagli H, Lanera C, Lorenzoni G, et al. Profiling patients by intensity of nursing care: an operative approach using machine learning. Journal of Personalized Medicine. 2020;10(4): 279. [Context Link]

 

46. Liang HF, Wu KM, Weng CH, Hsieh HW. Nurses' views on the potential use of robots in the pediatric unit. Journal of Pediatric Nursing. 2019;47: e58-e64. [Context Link]

 

47. Topaz M, Woo K, Ryvicker M, Zolnoori M, Cato K. Home healthcare clinical notes predict patient hospitalization and emergency department visits. Nursing Research. 2020;69(6): 448-454. [Context Link]

 

48. Travers DA, Haas SW. Using nurses' natural language entries to build a concept-oriented terminology for patients' chief complaints in the emergency department. Journal of Biomedical Informatics. 2003;36(4-5): 260-270. [Context Link]

 

49. Yokota S, Endo M, Ohe K. Establishing a classification system for high fall-risk among inpatients using support vector machines. CIN: Computers, Informatics, Nursing. 2017;35(8): 408-416. [Context Link]

 

50. Papadopoulos C, Hill T, Battistuzzi L, et al. The CARESSES study protocol: testing and evaluating culturally competent socially assistive robots among older adults residing in long term care homes through a controlled experimental trial. Archives of Public Health. 2020;78: 26. [Context Link]