Keywords

Burnout, horizontal violence, incivility, nurses, workplace bullying

 

Authors

  1. Purpora, Christina

ABSTRACT

Objective: The objective of this review is to assess the association between workplace bullying and nurse burnout.

 

Introduction: Internationally, workplace bullying has been linked to nurse burnout. Burnout is of significant concern due to its association with nurses' intent to quit, job dissatisfaction, reduced empathy and patient satisfaction. While there have been systematic reviews conducted on workplace bullying, none have explored its association with nurse burnout.

 

Inclusion criteria: This review will consider studies that include licensed nurses in any clinical setting in any country. Only studies in which the Negative Acts Questionnaire-Revised was used to measure licensed nurses' exposure to workplace bullying and in which the Maslach Burnout Inventory was used to measure burnout (i.e. the outcome of interest) will be considered. Prospective and retrospective cohort studies, case-control studies and analytical cross-sectional studies will be considered for inclusion.

 

Methods: Key information sources to be searched for studies in English from 1990 to the present include CINAHL, Embase, PsycINFO, PubMed and Scopus. Two independent reviewers will screen titles, abstracts and full texts of selected citations against the inclusion criteria and appraise for methodological quality. Two reviewers will independently use the standardized data extraction tool to extract data from studies used in the review. Studies will, where possible, be pooled in a statistical meta-analysis. Where statistical pooling is not possible, the findings will be presented in narrative form including tables and figures to aid in data presentation, where appropriate.

 

Systematic review registration number: PROSPERO CRD42019128798

 

Article Content

Introduction

Internationally, for more than four decades, researchers have been studying acts of disrespect or mistreatment that occur between and among nurses working in clinical settings. These acts have been conceptualized in multiple ways, including, but not limited to, incivility,1 horizontal (or lateral) violence,2,3 disruptive behavior4 and workplace bullying or mobbing.5-7 These individual concepts are closely related yet still distinct from one another. Incivility is a subtle violation of expected norms of conduct.8 Incivility manifests as disrespectful, inconsiderate, uncaring or rude verbal and non-verbal communication from the offender without a clear intention to harm the target. Horizontal violence, which originated in oppression theory, is explained as in-fighting within an oppressed group stemming from the inability to attack an oppressor.9,10 Roberts11 used this theory to describe the profession of nursing as an oppressed group whose members are at risk of experiencing horizontal violence-the negative workplace conduct that can occur between peers who share the same social standing in a hierarchical institution.12 Disruptive behavior is misconduct ranging from non-physical to physical to sexual harassment that occurs between and among different health professional disciplines, such as nurses and physicians, and may injure the target and potentially threaten the quality and safety of patient care.13

 

Although the definition of workplace bullying varies between countries and cultures, there are common features among them: Bullying is persistent, repetitive mistreatment of a target over a period of time to the extent that the target becomes defenseless.14 There is some disagreement among scholars in relation to the intentionality of bullying as a definitional feature.14 Some researchers argue that only perpetrators of bullying can confirm or deny their intent to harm the target. Others describe workplace bullying as abusive conduct, akin to domestic violence, where the perpetrator is motivated to control their victim.15

 

An additional concept related to problematic workplace conduct is mobbing. In his pioneering work in Sweden in the 1980s, Heinz Leymann,16 a psychologist, was the first to use the term mobbing in regards to human behaviors. As described in his first paper in English in 1990, the concept of mobbing is drawn from descriptions of animal behavior, specifically where multiple animals group together to attack an individual animal.16 Leymann defined mobbing in humans as a situation in which an individual or individuals act in concert to systematically direct "hostile and unethical communication" toward another individual on a weekly basis (minimum) for the duration of six months (minimum).17(p.168) The actions over time result in the target becoming defenseless.17 Leymann reserved the term bullying to name physical aggression between children in the school yard, differentiating mobbing as "psychological terror" among adults in the workplace.17(p.168) In the 1990s, Andrea Adams, a British journalist and activist, and Neil Crawford, a psychotherapist, used the term bullying to name behavior that terrorized adults in their place of work.18 Workplace bullying and mobbing are similar in that they occur repeatedly over time to the point that the target becomes unable to defend themselves. However, there is disagreement among scholars about whether these concepts are the same phenomenon or differ slightly, in that a group perpetrates mobbing whereas an individual perpetrates workplace bullying.14,19

 

While conceptually similar in that they are negative workplace conduct, scholars posit that incivility, horizontal violence, disruptive behavior and workplace bullying are not the same. The concepts of incivility and workplace bullying exist along a continuum of lesser to greater intensity of negative workplace conduct.8,20-23 Incivility is on the lower end of the continuum while workplace bullying is on the higher end due to its persistency and frequency.20-24 Horizontal violence, however, does not exist on this continuum. Instead, some investigators suggest that horizontal violence is a broader topic that includes workplace bullying.25,26 Researchers have not addressed where or if disruptive behavior exists on the continuum of negative workplace conduct, or, conversely, whether incivility or workplace bullying are types of disruptive behavior.

 

This review will focus on workplace bullying. While there are many definitions of workplace bullying in the literature, Einarsen et al.'s14 definition will be used in this review: "Bullying at work means harassing, offending, socially excluding someone or negatively affecting someone's work tasks. In order for the label bullying (or mobbing) to be applied to a particular activity, interaction or process it has to occur repeatedly and regularly (e.g. weekly) and over a period of time (e.g. about six months). Bullying is an escalating process in the course of which the person confronted ends up in an inferior position and becomes the target of systematic negative social acts. A conflict cannot be called bullying if the incident is an isolated event or if two parties of approximately equal strength are in conflict."(p.22)

 

The most frequently used measure of exposure to workplace bullying is the Negative Acts Questionnaire (NAQ).27 The Negative Acts Questionnaire-Revised (NAQ-R) is the English language version of the original Norwegian NAQ designed for use in Anglo-American cultures.22 The NAQ-R is a 22-item measure with three subscales: i) work-related bullying (seven items), e.g. "someone withholding information which affects your performance"; ii) person-related bullying (12 items), e.g. "being ignored or excluded or isolated from others"; and iii) physically-intimidating bullying (three items), e.g. "being shouted at or being the target of spontaneous anger".22(p.32) The NAQ-R, however, is not without limitations.22,28 Respondents may interpret each of the questionnaire's items differently. The authors of the NAQ-R conclude that the questionnaire does not consider study participants' perception of each negative act through the lens of their occupation or organizational culture. In one occupation, an item may be viewed as a negative act while that same act in another field may be viewed as a normal aspect of work-life. For example, nurses may frequently select "being exposed to an unmanageable workload", but this item might reflect the work of nursing, not bullying.12,29 While nursing is the only occupation addressed in this review, it is important to consider the NAQ-R's limitation, as the pool of included studies will likely be from different countries and organizational cultures.

 

The NAQ-R instrument has been widely used internationally to measure workplace bullying in nursing.26,30-32 Researchers have assessed workplace bullying using the full 22-item measure,26,33 a 14-item modified version,33 or the three subscales separately.34 The prevalence of workplace bullying reported in studies where researchers used any version of the NAQ-R ranges from 13% to 54%.26,31,32,34-36

 

Researchers around the world have conducted studies that aim to describe workplace bullying among nurses and its association with nurse related outcomes such as burnout.37-40 In 1981, Maslach and Jackson published the Maslach Burnout Inventory (MBI).41 They defined burnout as a group of psychological symptoms that a person develops in response to his or her occupational life experiences. Since 1981, Maslach and colleagues have developed additional versions of this measurement tool for use in a variety of work settings. Researchers administered various versions of the MBI in several nursing studies internationally, including the 22-item MBI Human Services Survey (MBI-HSS)32,40-42 and the 16-item MBI General Survey (MBI-GS).37,43,44

 

The 22-item MBI-HSS contains three subscales: i) emotional exhaustion (nine items): feeling overly stretched emotionally and exhausted from work; ii) depersonalization (five items): unfeeling and impersonal response toward people served; and iii) personal accomplishment (eight items): feelings of competence and success in work with people.45 The 16-item MBI-GS measure is also composed of three subscales, though slightly different: i) exhaustion (five items), ii) cynicism (five items): feelings of indifference, and iii) professional efficacy (six items): feelings of effectiveness at work.46 While often administered, the MBI has limitations.47 Study participants may respond to items differently based on occupation and country. Research has not provided insight into whether cultural and organizational influences may explain these differences. Thus, the MBI is limited in its ability to measure burnout across occupations and countries. While nursing is the only occupation of interest in this review, it is important to consider this limitation in the MBI, because the pool of included studies will likely be from different countries.

 

Since the NAQ-R is frequently utilized in research on workplace bullying among nurses, only studies in which the NAQ-R was used to measure workplace bullying will be included in this review to allow for accurate comparisons between studies. Likewise, the MBI has been administered extensively in studies investigating the association between workplace bullying and nurse burnout. Therefore, only studies in which the MBI was used to measure burnout will be included in this review. Studies that utilize any of the previously stated MBI measurement tools will be included.

 

In studies using the NAQ-R and the MBI, workplace bullying was associated with burnout in nurses. Burnout is an important variable to study because of its relationship to outcomes such as nurses' intent to quit, job dissatisfaction, reduced empathy and patient satisfaction.42-44,48

 

A preliminary search of PROSPERO, MEDLINE via PubMed, CINAHL, the JBI Database of Systematic Reviews and Implementation Reports, and the Cochrane Database of Systematic Reviews did not reveal any systematic review currently underway or completed on the topic of workplace bullying and nurse burnout. However, in the JBI Database of Systematic Reviews and Implementation Reports, there was one protocol and two reviews published on similar topics: a qualitative review protocol on incivility in online nursing education,49 a quantitative systematic review about the impact of horizontal violence on nurses' job satisfaction and retention and the effectiveness of programs to decrease its prevalence and attenuate its effects,50 and a quantitative review of successful interventions for managing disruptive behavior within the nursing work environment.51 Further, in the Cochrane Library, there was one systematic review that focused on interventions for prevention of bullying in the workplace for a broad population of employees in paid work within public, private or voluntary organizations.52 Those reviews, whether proposed or completed, differ from this review, which will focus on the association between workplace bullying and nurse burnout.

 

Review question

What is the association between workplace bullying and nurse burnout?

 

Inclusion criteria

Participants

The review will consider studies that include licensed nurses working in clinical settings in any country. For the purposes of this review and given possible differences in terminology internationally, the term "licensed nurse" pertains to, but is not limited to, registered nurse (RN), licensed practical nurse (LPN) and licensed vocational nurse (LVN). Likewise, "clinical setting" refers to any setting where nursing care is delivered to people including, but not limited to, hospitals, long-term care facilities, skilled nursing facilities, home care, ambulatory care clinics and outpatient clinics. Therefore, all terms for "licensed nurse" and "clinical settings" will be considered. Furthermore, "any country" refers to countries that are considered low-, middle- or high-resource/income.

 

Exposure of interest

This review will consider studies in which researchers administered the NAQ-R to measure licensed nurses' exposure to workplace bullying in clinical settings. As identified in this protocol's introduction, Einarsen et al.'s14 conceptual definition of workplace bullying will be used in this review. Features of workplace bullying include patterning (diversity of negative acts), repetition (the frequency of negative acts), and duration (over time).22 Based on these features, the NAQ-R's operational criteria for bullying include exposure to two negative acts (patterning), at least weekly (repetition), within the last six months (duration). Einarsen et al. quoted Leymann's 1997 unpublished manuscript that established at least one negative act as a criterion for mobbing.22 Einarsen et al. selected two negative acts.22,28 Their rationale for this stricter criterion was to address a limitation in the NAQ-R; the measure does not consider study participants' perception of each negative act through the lens of their occupation, organizational culture or work setting where an item may reflect the work, not a negative act associated with bullying. Consistent with Leymann's research,16 the authors established the frequency of exposure as at least weekly, the second criterion for bullying.22 They use a frequency response scale: "never," "now and then," "monthly," "weekly," and "daily."22(p.28) For the third criterion, the authors of the NAQ-R used research to decide on a exposure duration of within the last six months to assure the persistence of negative acts while minimizing the potential for recall difficulty and memory bias.17,53,54

 

Outcomes

This review will consider studies in which the researchers administered the MBI to measure burnout in licensed nurses. The response scales for the MBI-HSS and MBI-GS are in the form of a frequency rating scale including: "never," "a few times a year or less," "once a month or less," "a few times a month", "once a week," "a few times a week," and "everyday."45(p.13),46(p.41) Burnout has relevance for researchers and policy makers because of its relationship to outcomes such as nurses' intent to quit, job dissatisfaction, reduced empathy and patient satisfaction.42-44,48 Furthermore, these burnout-related outcomes are important because nurses are costly to replace,55 nurses' job satisfaction is related to patient care,56,57 empathy is a vital component of good nursing practice,42,58 and patient satisfaction is an indicator of patient perception of care received, which is valuable information for quality improvement in healthcare institutions.48,59

 

Types of studies

STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) is a global, collaborative initiative of scientists and journal editors who are committed to the conduct and dissemination of observational studies.60 To improve the quality of reporting, collaborators created checklists, focusing on three primary, analytic designs used in observational research: cohort, case-control and cross-sectional. Thus, this review of workplace bullying and risk for burnout in nurses will consider prospective and retrospective cohort (longitudinal) studies, case-control studies and analytical cross-sectional studies for inclusion. Studies published in English will be included. Studies published from 1990 to the present will be considered for inclusion. The reviewers have selected 1990 as a starting point to coincide with Leymann's pioneering work and first publication in English on mobbing.16

 

Methods

The proposed systematic review will be conducted in accordance with JBI methodology for systematic reviews of etiology and risk.61

 

Search strategy

The search strategy will aim to locate both published and unpublished studies. An initial limited search of MEDLINE via PubMed and CINAHL was undertaken to identify articles on the topic. The text words contained in the titles and abstracts of relevant articles, and the index terms used to describe the articles, were used to develop a full search strategy for CINAHL (Appendix I). The search strategy, including all identified keywords and index terms, will be adapted for each included information source. The reference list of all studies selected for critical appraisal will be screened for additional studies.

 

Information sources

The databases to be searched include: CINAHL, Embase, PsycINFO, MEDLINE via PubMed, and Scopus.

 

Sources for gray literature will include Google Scholar, MedNar, New York Academy of Medicine Grey Literature Report, and ProQuest Dissertations and Theses.

 

Study selection

Following the search, all identified citations will be collated and uploaded into EndNote V9 (Clarivate Analytics, PA, USA) and duplicates will be removed. Two independent reviewers will screen titles and abstracts for assessment against the inclusion criteria for the review. Potentially relevant studies will be retrieved in full and their citation details imported into JBI System for the Unified Management, Assessment, and Review of Information (JBI SUMARI; Joanna Briggs Institute, Adelaide, Australia). Two independent reviewers will assess in detail the full text of selected citations against the inclusion criteria. Reasons for exclusion of full-text studies that do not meet the inclusion criteria will be recorded and reported in the systematic review. Any disagreements that arise between the reviewers at each stage of the study selection process will be resolved through discussion or with a third reviewer. The results of the search will be reported in full in the final systematic review and presented in a Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) flow diagram.62

 

Assessment of methodological quality

Two independent reviewers will appraise eligible quantitative studies for methodological quality using standardized critical appraisal instruments from the JBI SUMARI.63 Following critical appraisal, studies that do not meet a certain quality threshold will be excluded. The decision to exclude will be based on cut-off scores of less than 75% of items for each of the JBI critical appraisal tools included in this study. This represents the following amount of "yes" answers from the JBI critical appraisal checklist for each type of study: fewer than nine out of 11 for cohort studies, fewer than eight out of 10 for case-control studies and fewer than six out of eight for analytical cross-sectional studies. Authors of papers will be contacted to request missing or additional data for clarification, where required. Any disagreements that arise will be resolved through discussion or with a third reviewer. The results of critical appraisal will be reported in a narrative form and a table.

 

Data extraction

Two independent reviewers will use the standardized data extraction tool from JBI SUMARI to extract data from studies used in the review.61 The extracted data will include the following information: name of author(s), year of publication, study design (cohort, case-control, cross sectional), clinical setting (i.e. hospital, clinic or other included setting), participant characteristics (i.e. age, sex, sample size, country/location), exposure of interest (workplace bullying) including different exposure categories (i.e. patterning, frequency, duration), outcome of significance (burnout) and data analysis methods of significance to the review question. Any disagreements that arise between the reviewers will be resolved through discussion or with a third reviewer. The authors of the included studies will be contacted to request missing or additional data relevant to this review.

 

Data synthesis

Studies will, where possible, be pooled in a statistical meta-analysis using JBI SUMARI.61 Effect sizes will be expressed as weighted mean differences with a 95% confidence interval. Heterogeneity will be assessed statistically using the standard chi-squared and I2 tests. Statistical analyses will be performed using a random or fixed effects model based on the guidance from Tufanaru et al.64 Sensitivity analyses will be conducted to test decisions made by the reviewers. Where statistical pooling is not possible, the findings will be presented in narrative form, including tables and figures to aid in data presentation, where appropriate. A funnel plot will be generated to assess publication bias if there are 10 or more studies included in a meta-analysis. Statistical tests for funnel plot asymmetry (Egger test, Begg test, Harbord test) will be performed, where appropriate.

 

Assessing certainty in the findings

The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach for grading the certainty of evidence will be followed.65 A Summary of Findings (SoF) will be created using GRADEpro (McMaster University, ON, Canada). The SoF will present the following information where appropriate: absolute risks for the treatment and control, estimates of relative risk, and a ranking of the quality of the evidence based on study limitations (risk of bias), indirectness, heterogeneity, imprecision and risk of selection bias, information bias, and publication bias of the review results. Nurse burnout will be the outcome included in the SoF.

 

Acknowledgments

CP and CS would like to thank the University of San Francisco's Faculty Development Funds for the financial support needed to attend the Comprehensive Systematic Review training at the UCSF Centre for Evidence Synthesis and Implementation: a Joanna Briggs Institute Centre for Excellence.

 

Appendix I: Search strategy for CINAHL

Search conducted on November 10, 2018

 

S1: (MH "Bullying+") (6,713)

 

S2: bully* OR incivil* OR "horizontal violence" OR "lateral violence" OR mobbing OR uncivil* (8,192)

 

S3: S1 OR S2 (8,384)

 

S4: (MH "Nurses+") OR (MH "Nursing Practice+") (242,994)

 

S5: nurs* (810,203)

 

S6: S4 OR S5 (813,863)

 

S7: IN negative acts questionnaire revised OR IN NAQR OR IN Maslach* burnout inventory OR IN Maslach* (1,997)

 

S8: measure* OR instrument* OR tool* OR questionnaire* OR inventory OR "negative acts" OR NAQR OR maslach* (1,117,883)

 

S9: S7 OR S8 (1,118,013)

 

S10: (MH "Personnel Turnover") OR (MH "Personnel Retention") OR (MH "Work Environment+") OR (MH "Burnout, Professional+") OR (MH "Compassion Fatigue") OR (MH "Job Satisfaction+") OR (MH "Productivity") OR (MH "Absenteeism") OR (MH "Depersonalization") (75,041)

 

S11: burnout OR "compassion fatigue" OR "intent to leave" OR attrition OR "workplace satisfaction" OR "job satisfaction" OR "work environment" OR turnover OR retention OR depersonalization OR "emotional exhaustion" OR productivity OR absenteeism (105,305)

 

S12: S10 OR S11 (114,080)

 

S13: S3 AND S6 AND S9 AND S12 (261)

 

S14: S3 AND S6 AND S9 AND S12, Limiters - English Language, Published Date: 1990-2018 (240)

 

References

 

1. Hutton S, Gates D. Workplace incivility and productivity losses among direct care staff. AAOHN J 2008; 56 (4):168-175. [Context Link]

 

2. Griffin M. Teaching cognitive rehearsal as a shield for lateral violence: an intervention for newly licensed nurses. J Contin Educ Nurs 2004; 35 (6):257-263. [Context Link]

 

3. McKenna B, Smith N, Poole S, Coverdale J. Horizontal violence: experiences of registered nurses in their first year of practice. J Adv Nurs 2003; 42 (1):90-96. [Context Link]

 

4. Lux KM, Hutcheson JB, Peden AR. Ending disruptive behavior: staff nurse recommendations to nurse educators. Nurse Educ Pract 2014; 14 (1):37-42. [Context Link]

 

5. Carter M, Thompson N, Crampton P, Morrow G, Burford B, Gray C, et al. Workplace bullying in the UK NHS: a questionnaire and interview study on prevalence, impact and barriers to reporting. BMJ Open 2013; 3 (6):e002628. [Context Link]

 

6. Bortoluzzi G, Caporale L, Palese A. Does participative leadership reduce the onset of mobbing risk among nurse working teams? J Nurs Manag 2014; 22 (5):643-652. [Context Link]

 

7. Topa G, Moriano JA. Stress and nurses' horizontal mobbing: moderating effects of group identity and group support. Nurs Outlook 2013; 61 (3):e25-e31. [Context Link]

 

8. Pearson C, Porath C. The cost of bad behavior. New York: Penguin Group; 2009. [Context Link]

 

9. Fanon F. The Wretched of the Earth. New York: Grove Press; 2004. [Context Link]

 

10. Freire F. Pedagogy of the Oppressed. 30th ed.New York: Continuum; 2003. [Context Link]

 

11. Roberts SJ. Oppressed group behavior: implication for nursing. ANS Adv Nurs Sci 1983; 5 (4):21-30. [Context Link]

 

12. Purpora C, Blegen MA, Stotts NA. Horizontal violence among hospital staff nurses related to oppressed self or oppressed group. J Prof Nurs 2012; 28 (5):306-314. [Context Link]

 

13. Rosenstein AH. The quality and economic impact of disruptive behaviors on clinical outcomes of patient care. Am J Med Qual 2011; 26 (5):372-379. [Context Link]

 

14. Einarsen S, Hoel H, Zapf D, Cooper C. Einarsen S, Hoel H, Zapf D, Cooper C. The concept of bullying and harassment at work: the European tradition. Bullying and harassment in the workplace: Development in theory, research, and practice CRC Press, 2nd edBoca Raton, FL: 2011. [Context Link]

 

15. Namie G, Namie RF. The bully-free workplace. Hoboken, New Jersey: John Wiley & Sons, Inc; 2011. [Context Link]

 

16. Leymann H. Mobbing and psychological terror at workplaces. Violence Vict 1990; 5 (2):119-126. [Context Link]

 

17. Leymann H. The content and development of mobbing at work. Eur J Work Organ Psychol 1996; 5 (2):165-184. [Context Link]

 

18. Adams A. Bullying at Work: How to Confront and Overcome it. London: Virago; 1992. [Context Link]

 

19. Caponecchia C, Wyatt A. Preventing Workplace Bullying: An Evidence-based Guide for Managers and Employees. Australia: Allen & Unwin Pty Ltd; 2011. [Context Link]

 

20. Lutgen-Sandvik P. Adult Bullying-A Nasty Piece of Work: Translating Decades of Research on Non-Sexual Harassment, Psychological Terror, Mobbing, and Emotional Abuse on the Job. St. Louis, MO: CreateSpace Independent Publishing Platform; 2003. [Context Link]

 

21. Namie G. Workplace bullying: escalated incivility. Ivey Business J 2003; 68 (2):1-6. [Context Link]

 

22. Einarsen S, Hoel H, Notelaers G. Measuring exposure to bullying and harassment at work: validity, factor structure and psychometric properties of the Negative Acts Questionnaire-Revised. Work Stress 2009; 23 (1):24-44. [Context Link]

 

23. Hershcovis MS. Incivility, social undermining, bullying[horizontal ellipsis]oh my: a call to reconcile constructs within workplace aggression research. J Organiz Behav 2011; 32 (3):499-519. [Context Link]

 

24. Cortina LM, Magley VJ, Williams JH, Langhout RD. Incivility in the workplace: incidence and impact. J Occup Health Psychol 2001; 6 (1):64-80. [Context Link]

 

25. Purpora C, Blegen MA. Job satisfaction and horizontal violence in hospital staff registered nurses: the mediating role of peer relationships. J Clin Nurs 2015; 24 (15-16):2286-2294. [Context Link]

 

26. Simons S. Workplace bullying experienced by Massachusetts registered nurses and the relationship to intention to leave the organization. ANS Adv Nurs Sci 2008; 31 (2):e48-e59. [Context Link]

 

27. Nielsen MB, Einarsen S. Outcomes of exposure to workplace bullying: a meta-analytic review. Work Stress 2012; 26 (4):309-332. [Context Link]

 

28. Mikkelsen EG, Einarsen S. Bullying in Danish work-life: prevalence and health correlates. Eur J Work Organizational Psychol 2001; 10 (4):393-413. [Context Link]

 

29. Johnson SL, Rea RE. Workplace bullying concerns for nurse leaders. J Nurs Adm 2009; 39 (32):84-90. [Context Link]

 

30. AL-Sagarat A, Qan'ir Y, AL-Azzam M, Obeidat H, Khalifeh A. Assessing the impact of workplace bullying on nursing competencies among RNs in Jordanian public hospitals. Nurs Forum 2018; 53 (3):304-313. [Context Link]

 

31. Yokoyama M, Suzuki M, Takai Y, Igarashi-Watanshi M, Yamamoto-Mitani N. Workplace bullying among nurses and their related factors in Japan: a cross sectional study. J Clin Nurs 2016; 25 (17-18):2478-2488. [Context Link]

 

32. Sa L, Fleming M. Bullying, burnout, and mental health amongst Portuguese nurses. Issues Ment Health Nurs 2008; 29 (4):11-26. [Context Link]

 

33. Spence Laschinger HK, Grau AL, Finegan J, Wilk P. Predictors of new graduate nurses' workplace well-being: testing the job demands-resource model. Health Care Manage Rev 2012; 37 (2):175-186. [Context Link]

 

34. Losa Iglesias ME, Becerro de Bengoa Vallejo R. Prevalence of bullying at work and its association with self-esteem scores in Spanish nurse sample. Contemp Nurse 2012; 42 (1):2-10. [Context Link]

 

35. Wright W, Khatri N. Bullying among nursing staff: relationship with psychological/behavioral responses of nurses and medical errors. Health Care Manage Rev 2015; 40 (2):139-147. [Context Link]

 

36. Chatziioannidis I, Bascialla FG, Chatzivalsama P, Vouzas F, Mitsiakos G. Prevalence, causes and mental health impact of workplace bullying in neonatal intensive care unit environment. BMJ Open 2018; 8 (2):e018766. [Context Link]

 

37. Spence Laschinger HK, Grau AL, Finegan J, Wilk P. New graduate nurses' experiences of bullying and burnout in hospital settings. J Adv Nurs 2010; 66 (12):2732-2742. [Context Link]

 

38. Spence Laschinger HK, Fida R. A time-lagged analysis of the effect of authentic leadership on workplace bullying, burnout, and occupational turnover intentions. Eur J Work Organizational Psychol 2014; 23 (5):739-753. [Context Link]

 

39. Giorgi G, Mancuso S, Fiz Perez F, Castiello D'Antonio A, Mucci N, Cupelli V, et al. Bullying among nurses and its relationship with burnout and organizational climate. Int J Nurs Pract 2016; 22 (2):160-168. [Context Link]

 

40. Ajoudani F, Baghaei R, Lotfi M. Moral distress and burnout in Iranian nurses: the mediating effect of workplace bullying. Nurs Ethics (Epub ahead of print) 2018. 1-14. [Context Link]

 

41. Maslach C, Jackson SE. The measurement of experienced burnout. J Occup Behav 1981; 2 (2):99-113. [Context Link]

 

42. Ferri P, Guerra E, Marchesetti L, Cunico L, Di Lorenzo R. Empathy and burnout: an analytic cross-sectional study among nurses and nursing students. ACTA Biomed 2015; 82 (S2):104-115. [Context Link]

 

43. Spence Laschinger HK, Leiter M, Day A, Gilin D. Workplace empowerment, incivility, and burnout: impact on staff nurse recruitment and retention outcomes. J Nurs Manag 2009; 17 (3):302-311. [Context Link]

 

44. Leiter MP, Maslach C. Nurse turnover: the mediating role of burnout. J Nurs Manag 2009; 17 (3):331-339. [Context Link]

 

45. Maslach C, Jackson SE. Maslach C, Jackson SE, Leiter M. The MBI - Human Services Survey: MBI-HSS. Maslach Burnout Inventory Manual 4th edMenlo Park: Mind Garden, Inc; 1981. 13-24. [Context Link]

 

46. Schaufeli WB, Leiter M, Maslach C, Jackson SE. Maslach C, Jackson SE, Leiter M. The MBI General Survey: MBI-GS. Maslach Burnout Inventory Manual 4th edMenlo Park: Mind Garden, Inc; 1996. 38-46. [Context Link]

 

47. Maslach C, Jackson SE, Leiter M, editors. Maslach burnout inventory manual. 4th ed. Menlo Park, CA: Mind Garden, Inc: 1996-2018. [Context Link]

 

48. Vahey DC, Aiken LH, Sloane DM, Clarke SP, Vargas D. Nurse burnout and patient satisfaction. Med Care 2004; 42: (2 suppl): ii57-ii66. [Context Link]

 

49. Lampley TM, Curia M, Vollero B, Hansel D. Experiences of incivility among faculty and students in online nursing education: a qualitative systematic review protocol. JBI Database System Rev Implement Rep 2016; 14 (12):119-126. [Context Link]

 

50. Rittenmeyer L, Huffman D, Hopp L, Block M. A comprehensive systematic review on the experience of lateral/horizontal violence in the profession of nursing. JBI Database System Rev Implement Rep 2013; 11 (11):362-468. [Context Link]

 

51. Rogers-Clark C, Pearce S, Cameron M. Management of disruptive behaviour within nursing work environments: a systematic review of the evidence. JBI Database System Rev Implement Rep 2009; 7 (15):615-678. [Context Link]

 

52. Gillen PA, Sinclair M, Kernohan WG, Begley CM, Luyben AG. Interventions for prevention of bullying in the workplace. Cochrane Database Syst Rev 2017; (2):CD009778. [Context Link]

 

53. Arvey RD, Cavanaugh MA. Using surveys to assess prevalence of sexual harassment: some methodological problems. J Soc Issues 1995; 51 (1):39-52. [Context Link]

 

54. Hoel H, Rayner C, Cooper CL. Workplace bullying. In: Cooper CL, Robertson IT, editors. International Review of Industrial and Organizational Psychology. Vol. 14. West Sussex: John Wiley & Sons; 1999. [Context Link]

 

55. Duffield CM, Roche AR, Homer C, Buchan J, Dimitrelis S. A comparative review of nurse turnover rates and costs across countries. J Adv Nurs 2014; 70 (12):2703-2712. [Context Link]

 

56. Choi J, Bergquist-Beringer S, Staggs VS. Linking RN workgroup job satisfaction to pressure ulcers among older adults on acute care hospital units. Res Nurs Health 2013; 36 (2):181-190. [Context Link]

 

57. Aiken LH, Sermeus W, Van den Heede K, Sloane DM, Busse R, McKee M, et al. Patient safety, satisfaction, and quality of hospital care: cross-sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ 2012; 344:e1717. [Context Link]

 

58. Code of ethics for nurses with interpretive statements [Internet]. Maryland: American Nurses Association; 2015 [cited April 15, 2019]. Available from: http://www.nursingworld.org. [Context Link]

 

59. Al-Abri R, Al-Balushi A. Patient satisfaction survey as a tool towards quality improvement. Oman Med J 2014; 29 (1):3-7. [Context Link]

 

60. Strengthening the reporting of observational studies in epidemiology (STROBE) statement [Internet]. 2009 [updated 2014 Mar 17; cited 2019 Apr 15]. Available from: https://www.strobe-statement.org/index.php?id=strobe-home[Context Link]

 

61. Aromataris E, Munn Z (Editors). Joanna Briggs Institute Reviewer's Manual [Internet]. Adelaide: Joanna Briggs Institute; 2017. [cited April 15, 2019] Available from: https://reviewersmanual.joannabriggs.org/[Context Link]

 

62. Moher D, Liberati A, Tetzlaff J, Altman DG. the PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement. PLoS Med 2009; 6 (7):e1000097. [Context Link]

 

63. Moola S, Munn Z, Tufanaru C, Aromataris E, Sears K, Sfetcu R, et al. Chapter 7: Systematic reviews of etiology and risk. In: Aromataris E, Munn Z (Editors). Joanna Briggs Institute Reviewer's Manual [Internet]. Adelaide: Joanna Briggs Institute. 2017. [cited April 15, 2019]. Available from https://reveiwersmanual.joannabriggs.org/. [Context Link]

 

64. Tufanaru C, Munn Z, Stephenson M, Aromataris E. Fixed or random effects meta-analysis? Common methodological issues in systematic reviews of effectiveness. Int J Evid Based Healthc 2015; 13 (3):196-207. [Context Link]

 

65. Schunemann H, Brozek J, Guyatt G, Oxman A, editors. Handbook for grading the quality of evidence and strength of recommendations using the GRADE approach [Internet]. Updated October 2013. The GRADE Working Group, 2013. Available from: https://gdt.gradepro.org/app/handbook/handbook.html. [Context Link]