Authors

  1. Damron-Rodriguez, JoAnn PhD, LCSW

Abstract

Evidence-based approaches to education.

 

Article Content

Informal caregivers-primarily family members-are the foundation of rehabilitation, chronic care, and long-term support for older persons. The growing population of older persons and the changing health care delivery system (for example, shortened hospital stays) demand more of family caregivers and increase the toll on their health.1 To help them cope with these demands, nurses and social workers, who treat diverse older populations, must have cultural competence to enable them to practice effectively with caregivers.2

 

Along with increasing the emphasis on evidence-based practice, health care education is moving to a competence-based approach with clearly measured outcomes.3,4 In this article, literature from the past decade, especially systematic reviews of evidence-based-practice dissemination and training, is used to inform nurse and social worker competence in supporting family caregivers. The reviews were from the medical education literature as well as from nursing and social work education, and some studies involved students and residents, not only postgraduate practitioners.

 

IDENTIFYING COMPETENCE

Across disciplines, competence refers to being able to demonstrate that the knowledge, values, and skills learned can be integrated into practice.3 The Council for Higher Education Accreditation, which oversees standards for 76 professions (including nursing and social work), has adopted a competence model for accreditation.4 Competence-based education and evaluation consist of two components: identification in clear, measurable terms, with indicators for levels of performance, of the specific skills required to practice a profession; and evaluation of skill acquisition through measurable criteria.5

 

Hartford competencies. The John A. Hartford Foundation has supported competence identification in nurses and social workers who provide care to older adults. The process of identifying competence involved extensive literature review and consensus building for each profession. The result is referred to in this article as the Hartford geriatric competencies. Table 1 (page 42) presents the competencies that specifically mention families.

  
Table 1 - Click to enlarge in new windowTABLE 1. Hartford Geriatric Nursing and Social Work Competencies for Practice with Families

The American Association of Colleges of Nursing and the John A. Hartford Foundation Institute for Geriatric Nursing identified 30 competencies and curricular guidelines for baccalaureate nursing programs (available online at http://www.aacn.nche.edu/Education/pdf/Gercomp.pdf).6 The Social Work Leadership Institute and the Council on Social Work Education Gero-Ed Center (funded by the John A. Hartford Foundation) identified 40 competencies for a master's degree in social work,7 which is required for licensure.

 

Dimensions of competence. The Geriatric Social Work Competency Scale II measures five levels of competence. "This skill is becoming more integrated in my practice" connotes a moderate level of competence. The highest level is "I complete this skill with sufficient mastery to teach others."7 Postgraduate training is needed to introduce these competencies and improve practitioners' levels of skill.

 

Competence-based education and evaluation also recognize levels of generality,8 with procedural or task skills at one end of the continuum and metacompetencies at the other. Procedural skills, such as taking vital signs and administering the Mini-Mental State Examination, are the most straightforward to measure.9 Competencies needed for working with family caregivers are at a higher level of generality and require drawing on diverse sets of knowledge and skills.8 In Table 1, the domain in which each competence is classified, such as communication or assessment, could be considered a metacompetence.

 

Competence in interdisciplinary teamwork is central to geriatrics.10 One systematic review of interdisciplinary learning for health care professionals reported that it resulted in positive outcomes in knowledge, skills, attitudes, and beliefs.11 Another systematic review found that none of the research evaluated met the methodologic rigor for providing conclusive evidence.12 Nonetheless, shared learning among various disciplines may be helpful in competence-based education that teaches family caregiver support.13

 

ADULT LEARNING

Two approaches founded in principles of andragogy, or adult learning, are important for helping nurses and social workers develop competence in caregiver support.

 

The learner-centered approach shifts the responsibility of organizing, analyzing, and synthesizing information from the teacher to the learner.14 This approach recognizes that knowledge is built on what the learner already knows. Positive outcomes, including increased comprehension, result.15 The learner-centered approach also involves cooperative learning, in which a group of learners works on a project, leading to creative solutions and increasing social perspective by helping the members understand interactive factors.16

 

Problem-based learning is a related approach that structures the curricula around practice-related problems and is based on constructive, self-directed, collaborative, and contextual learning.17 Studies have demonstrated that problem-based learning stimulates a learner to restructure knowledge or reorganize what is already known based on new understanding of the subject and interest in the topic.17,18 Students and faculty have been shown to be highly satisfied with problem-based learning, although studies differ on its superiority over conventional methods of learning.19

 

LINKING EVIDENCE-BASED PRACTICE TO COMPETENCE

Evidence from the research into interventions with caregivers can help to build professional competence. The "knowledge transfer framework" of the Agency for Healthcare Research and Quality describes three major stages that encompass all levels of evidence-based-practice adoption.20 First, knowledge is created and distilled, then it is diffused and disseminated, and finally it is adopted, implemented, and institutionalized.20

 

Strictly defined, evidence-based practice is a multistep process that begins with formulating an answerable question and progresses through practitioner evaluation of patient outcomes.21 To make research more applicable, practice guidelines and best practices are developed. Colyer suggested that a varied, less restrictive approach be used for translating research into nursing practice.22 Similarly, Webb suggested that the nuances and context of a situation be considered when applying research to social work practice.23 Relating evidence-based practice to competence for family caregiving relies on the translation of research into practice.

 

Levels of evidence-based-practice translation. Organizations and health care systems change at multiple levels: state and federal agencies (macro), program and practitioner groups (mezzo), and individual patients and professionals (micro).

 

On the macro level, the Joint Commission has set competence standards for working with older adults.24 Two policies that have stimulated macro-level changes in caregiver practices are the Older Americans Act Amendments of 2000, which established the National Family Caregiver Support Program,25 and the 1999 Olmstead decision of the Supreme Court,26 a landmark legal decision based on the Americans with Disabilities Act of 1990. These policies require professionals to work closely with family caregivers, but do not provide the evidence or indicate the competence needed for intervening effectively.

 

Mezzo-level attempts at educational and program change are often framed as continuous quality improvement efforts.

 

Micro-level approaches to increasing competence in caregiver support for an individual or group of professionals work best in supportive organizational environments.

 

Educational strategies. Two systematic reviews27,28 identified effective and ineffective educational strategies used to translate evidence into practice and thereby develop competence.

 

* Ineffective strategies included the passive dissemination of information and didactic educational meetings or lectures. Used alone, these two interventions were found to prompt little or no change in professional practice.27,29

 

* Potentially effective strategies resulted in variable, small to modest improvements. Educational strategies in this category included summaries of clinical performance such as audit and feedback,30 local consensus processes (such as discussions among practitioners about a problem and possible solutions), and interventions based on information from patients.27 Some of the potentially effective strategies identified were mezzo-level interventions based on continuous quality improvement methodologies.31

 

* Consistently effective strategies included educational outreach visits or "academic detailing," manual or computerized reminders, and interactive educational forums that included practice and discussion.27,29,32,33 A Cochrane review of research on interventions for changing health professionals' practice found that interactive workshops could result in moderately large effects.32

 

* Most effective was a focused combination of strategies. The strength of a multifaceted approach was strongly supported.27,32,34 Efforts that included follow-up were more successful in altering practice.30,34

 

 

Systematic reviews point to the importance of recognizing the existence of environmental barriers to change (such as inadequate staffing) and the preparedness of clinicians to change. One study found that practitioner training needs to be flexible and that course goals must be explicitly related to applying the content rather than to the research itself.35 A systematic review of 23 studies found that stand-alone teaching improved knowledge but not skills; however, knowledge, skills, attitudes, and behavior were positively affected by clinical practice interventions.36

 

Example with nurses and social workers. The Improving Mood: Promoting Access to Collaborative Treatment (IMPACT) trial illustrates a successful multifaceted approach to evidence-based-practice postgraduate training. This randomized, multisite, controlled trial in older patients with depression demonstrated the advantages when interventions were provided by nurses and social workers who were trained as depression care specialists and worked collaboratively with primary care physicians.37,38

 

The educational interventions for IMPACT consisted of multiple stages. After receiving a two-hour interactive overview, nurses and social workers participated in 10 hours of multidisciplinary, case-based training in small groups. This was followed by eight hours of training in problem solving with clinical cases and four hours of phone supervision by an expert.

 

After the trial was completed, the IMPACT model was translated into practice in the "real world" setting of a health maintenance organization. Although patients had fewer treatment contacts than in the controlled trial, they achieved similar improvements in depression.39

 

ASSESSMENT OF COMPETENCE-BASED EDUCATION

A lack of assessment strategies has been the major challenge in moving to competence-based education.3,40,41 However, the desire for competence-based education of health care professionals has spurred the development of new ways to evaluate learning outcomes based on observable measures.

 

Self-efficacy-the belief that one is capable of performing specific skills in such a way that certain outcomes will be achieved42- is one way to measure competence. Self-efficacy has proven to be reliable and valid for predicting behavior and performance variation in multiple health disciplines.43 It also may serve as a way to assess needs when developing learning goals for postgraduate training. The Geriatric Social Work Competency Scale II is used in this way for graduate education.7

 

Simulation assessment provides a clinical approximate to patient care. The methods of simulation include role-playing, use of standardized patients, computer and videotaped vignettes, and use of mannequins.44

 

Objective Structured Clinical Examination (OSCE), which originated in medical education, has been introduced successfully in both nursing45 and social work.46 Developed originally for in-person assessments of actor "patients," the OSCE has evolved in video format for geriatric-focused primary care medicine. The piloting of the Objective Structured Video Examination resulted in 90% commitment to statewide adoption by residency programs in Wisconsin.47 The Geriatric Interdisciplinary Team Training Program funded by the John A. Hartford Foundation developed a similar scripted video assessment tool.48

 

FRAMEWORK FOR EVIDENCE-BASED COMPETENCE TRAINING

The strategies that promote postgraduate competence in evidence-based practice can be used to construct a framework for educating and training nurses and social workers who provide caregiver support (see Figure 1, page 43). The framework addresses four essential elements:

  
Figure 1 - Click to enlarge in new windowFIGURE 1. Framework for Evidence-Based Competence Training in Caregiver Support

* the content, or the "what," of training

 

* the approaches, or the "how," for teaching

 

* the strategies, or the "where" and "when," for educational interventions

 

* the assessment, or the "how well," of learning outcomes

 

 

The first step is to determine the content of the education. The Hartford geriatric competencies for nurses and social workers that are related to families can be used to identify evidence-based caregiver interventions. In addition, this supplement discusses competencies to support caregivers that were identified by nurses and social workers attending a state-of-the-science symposium (see page 7 of the "Executive Summary: Professional Partners Sup-porting Family Caregivers"). It is imperative that all of the skills identified are synthesized into an enhanced yet brief, coherent, and clearly measurable set of professional caregiver competencies.

 

The next step is to concentrate on employing effective strategies. Multidisciplinary postgraduate training should use learner-centered and problem-based learning approaches such as interactive training forums, consultation and follow-up, and case-based assignments. To be effective for professionals with multiple roles working with diverse populations, the educational interventions must be directly relevant to nurses' and social workers' current knowledge and experience. Whenever possible, teaching, mentoring, and consultation should be provided within the care environment.

 

The final step in developing competence is the objective assessment of skills. The OSCE, which has been proven effective in medical education and is increasingly being used in educating nurses and social workers, could be the gold standard for measuring postgraduate education in caregiver support.

 

TAKE-HOME MESSAGES

 

* Nurses and social workers require special skills to work with the family caregiving unit.

 

* Competence for practice with caregivers must be set as a measurable learning objective.

 

* Interdisciplinary competency-based education for practice with caregivers should be learner centered and problem focused.

 

REFERENCES

 

1. Pinquart M, Sorensen S. Correlates of physical health of informal caregivers: a meta-analysis. J Gerontol B Psychol Sci Soc Sci 2007;62(2):P126-P137. [Context Link]

 

2. Pinquart M, Sorensen S. Ethnic differences in stressors, resources, and psychological outcomes of family caregiving: a meta-analysis. Gerontologist 2005;45(1):90-106. [Context Link]

 

3. Carraccio C, et al. Shifting paradigms: from Flexner to competencies. Acad Med 2002;77(5):361-7. [Context Link]

 

4. National Center for Higher Education Management Systems. The competency standards project: another approach to accreditation review. Washington, D.C.: Council for Higher Education Accreditation; 2000 Aug. CHEA Occasional Paper. http://www.chea.org/pdf/Competency_Aug2000.pdf. [Context Link]

 

5. Hackett S. Educating for competency and reflective practice: fostering a conjoint approach in education and training. Journal of Workplace Learning 2001;13(3):103-12. [Context Link]

 

6. American Association of Colleges of Nursing. The John A. Hartford Foundation Institute for Geriatric Nursing. Older adults: recommended baccalaureate competencies and curricular guidelines for geriatric nursing care. Washington, D.C.; 2000 Jul. http://www.aacn.nche.edu/Education/pdf/Gercomp.pdf. [Context Link]

 

7. Damron-Rodriguez JA. Moving forward: developing geriatric social work competencies. In: Berkman B, editor. Handbook of social work in health and aging. New York: Oxford University Press; 2006. p. 1051-68. [Context Link]

 

8. Harden RM, et al. AMEE Guide No. 14: outcome-based education: part 5-from competency to meta-competency: a model for the specification of learning outcomes. Med Teach 1999;21(6):546-52. [Context Link]

 

9. Long DM. Competency-based residency training: the next advance in graduate medical education. Acad Med 2000;75(12):1178-83. [Context Link]

 

10. Ferraro KF. Is gerontology interdisciplinary? J Gerontol B Psychol Sci Soc Sci 2007;62(1):S2. [Context Link]

 

11. Cooper H, et al. Developing an evidence base for interdisciplinary learning: a systematic review. J Adv Nurs 2001;35(2):228-37. [Context Link]

 

12. Zwarenstein M, et al. Interprofessional education: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2001(1):CD002213. [Context Link]

 

13. Horsburgh M, et al. Multiprofessional learning: the attitudes of medical, nursing and pharmacy students to shared learning. Med Educ 2001;35(9):876-83. [Context Link]

 

14. Brush T, Saye J. Implementation and evaluation of a student-centered learning unit: a case study. Educational Technology Research and Development 2000;48(3):79-100. [Context Link]

 

15. Machemer PL, Crawford P. Student perceptions of active learning in a large cross-disciplinary classroom. Active Learning in Higher Education 2007;8(1):9-30. [Context Link]

 

16. Johnson DW, et al. Cooperative learning methods: a meta-analysis. Minneapolis: Cooperative Learning Center, University of Minnesota; 2000 May. http://www.co-operation.org/pages/cl-methods.html. [Context Link]

 

17. Dolmans DH, et al. Solving problems with group work in problem-based learning: hold on to the philosophy. Med Educ 2001;35(9):884-9. [Context Link]

 

18. Ozuah PO, et al. Impact of problem-based learning on residents' self-directed learning. Arch Pediatr Adolesc Med 2001;155(6):669-72. [Context Link]

 

19. Mamede S, et al. Innovations in problem-based learning: what can we learn from recent studies? Adv Health Sci Educ Theory Pract 2006;11(4):403-22. [Context Link]

 

20. Nieva VF, et al. From science to service: a framework for the transfer of patient safety research into practice. In: Advances in patient safety: from research to implementation, volume 2. AHRQ Publication No. 05-0021-2. Rockville, MD: Agency for Healthcare Research and Quality; 2005 May. http://stinet.dtic.mil/cgibin/GetTRDoc?AD=ADA434249&Location=U2&doc=GetTRDoc.pdf. [Context Link]

 

21. Walker JS, et al. Implementing and sustaining evidence-based practice in social work. J Soc Work Educ 2007;43(3):361-73. [Context Link]

 

22. Colyer H, Kamath P. Evidence-based practice. A philosophical and political analysis: some matters for consideration by professional practitioners. J Adv Nurs 1999;29(1):188-93. [Context Link]

 

23. Webb SA. Some considerations on the validity of evidence-based practice in social work. Br J Soc Work 2001;31(1):41-55. [Context Link]

 

24. The Joint Commission. Comprehensive accreditation manual for hospitals: the official handbook. Oakbrook Terrace, IL: The Commission; 2007. [Context Link]

 

25. National Family Caregiver Support Program. About the NFCSP. Administration on Aging, U.S. Department of Health and Human Services. 2004. http://www.aoa.gov/prof/aoaprog/caregiver/overview/overview_caregiver.asp. [Context Link]

 

26. Olmstead v. L.C. (98-536) 527 U.S. 581 (1999). 1999. [Context Link]

 

27. Bero LA, et al. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. BMJ 1998;317(7156):465-8. [Context Link]

 

28. Belfield C, et al. Measuring effectiveness for best evidence medical education: a discussion. Med Teach 2001;23(2):164-70. [Context Link]

 

29. Franklin C, Hopson LM. Facilitating the use of evidence-based practice in community organizations. J Soc Work Educ 2007;43(3):377-97. [Context Link]

 

30. Jamtvedt G, et al. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2006(2):CD000259. [Context Link]

 

31. Doran DM, Sidani S. Outcomes-focused knowledge translation: a framework for knowledge translation and patient outcomes improvement. Worldviews Evid Based Nurs 2007;4(1):3-13. [Context Link]

 

32. O'Brien MA, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2001(2):CD003030. [Context Link]

 

33. O'Brien MA, et al. Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2007(4):CD000409. [Context Link]

 

34. Renders CM, et al. Interventions to improve the management of diabetes mellitus in primary care, outpatient and community settings. Cochrane Database Syst Rev 2001(1):CD001481. [Context Link]

 

35. Greenhalgh T, Douglas HR. Experiences of general practitioners and practice nurses of training courses in evidence-based health care: a qualitative study. Br J Gen Pract 1999;49(444):536-40. [Context Link]

 

36. Coomarasamy A, Khan KS. What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJ 2004;329(7473):1017. [Context Link]

 

37. Unutzer J, et al. Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA 2002;288(22):2836-45. [Context Link]

 

38. Unutzer J, et al. Improving primary care for depression in late life: the design of a multicenter randomized trial. Med Care 2001;39(8):785-99. [Context Link]

 

39. Grypma L, et al. Taking an evidence-based model of depression care from research to practice: making lemonade out of depression. Gen Hosp Psychiatry 2006;28(2):101-7. [Context Link]

 

40. Watson R, et al. Clinical competence assessment in nursing: a systematic review of the literature. J Adv Nurs 2002;39(5):421-31. [Context Link]

 

41. Bogo M, et al. Evaluating a measure of student field performance in direct service: testing reliability and validity of explicit criteria. J Soc Work Educ 2002;38(3):385-401. [Context Link]

 

42. Bandura A. Self-efficacy: the exercise of control. New York: W.H. Freeman; 1997. [Context Link]

 

43. Holden G, et al. Outcomes of social work education: the case for social work self-efficacy. J Soc Work Educ 2002;38(1):115-33. [Context Link]

 

44. Lane JL, et al. Simulation in medical education: a review. Simul Gaming 2001;32(3):297-314. [Context Link]

 

45. Ryan S, et al. Assessment of clinical nurse specialists in rheumatology using an OSCE. Musculoskeletal Care 2007;5(3):119-29. [Context Link]

 

46. Baez A. Development of an Objective Structured Clinical Examination (OSCE) for practicing substance abuse intervention competencies: an application in social work education. Journal of Social Work Practice in the Addictions 2004;5(3):3-20. [Context Link]

 

47. Simpson D, et al. Objective Structured Video Examinations (OSVEs) for geriatrics education. Gerontol Geriatr Educ 2006;26(4):7-24. [Context Link]

 

48. Hyer K, et al. Using scripted video to assess interdisciplinary team effectiveness training outcomes. Gerontol Geriatr Educ 2003;24(2):75-91. [Context Link]