05.01.2013 Views

Using Practice Genograms To Understand And Describe ... - STFM

Using Practice Genograms To Understand And Describe ... - STFM

Using Practice Genograms To Understand And Describe ... - STFM

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

490 July-August 1998 Family Medicine<br />

<strong>Using</strong> <strong>Practice</strong> <strong>Genograms</strong> to <strong>Understand</strong><br />

and <strong>Describe</strong> <strong>Practice</strong> Configurations<br />

Helen McIlvain, PhD; Benjamin Crabtree, PhD; Jim Medder, MD, MPH;<br />

Kurt C. Stange, MD, PhD; William L. Miller MD, MA<br />

Background: Demands for change in medical practices are coming from multiple sources. Since<br />

interventions to change clinical practice continue to have limited success, understanding the functional<br />

structure of primary care practices and the dynamics of providing care have become increasingly<br />

important. Methods: <strong>To</strong> portray and understand the primary care office system, we developed<br />

“practice genograms” that describe practice participants and their relationships with each other.<br />

Formal organizational structure is evaluated using family systems theory and family of origin<br />

genogram techniques. Results: <strong>Practice</strong> genograms provided a more dynamic, relational model than<br />

the organizational chart and promoted identification of relationship strengths and weaknesses<br />

within a practice the same way that family genograms identify these characteristics in a family<br />

system. Conclusions: Research implications for the use of the practice genogram include enhanced<br />

data gathering, increased understanding of the complexity of practices as adaptive systems, and<br />

increased understanding of current and potential approaches to changing practices.<br />

(Fam Med 1998;30(7):490-6.)<br />

Facilitating change in clinical behavior is not always<br />

successful. 1-5 Yet, with the proliferation of clinical<br />

practice guidelines, the decrease in numbers of small,<br />

independent practices, and the growth of managed<br />

care, physicians are under pressure to change and<br />

adjust to change. Unfortunately, “one size fits all”<br />

interventions to facilitate change often don’t have<br />

long-term effects because physicians and their practices,<br />

while seeming similar, are each unique in practice<br />

behavior, motivation, and office culture. 6-9 Recent<br />

literature suggests that it may be effective to use<br />

systems theory models in which primary care practices<br />

are viewed as complex adaptive systems. 10-11<br />

However, little research has been done on systems<br />

models of change in clinical settings, and, therefore,<br />

tools to assess primary care practices are lacking. We<br />

developed such a tool, loosely based on the family<br />

genogram, 12 a technique with which most residency-<br />

From the Department of Family Medicine, University of Nebraska Medical<br />

Center, Omaha (Drs McIlvain, Crabtree, and Medder), the Department<br />

of Family Medicine, Case Western Reserve University, Cleveland,<br />

Ohio (Dr Stange), and the Department of Family Medicine, Lehigh Valley<br />

Hospital, Allentown, Pa (Dr Miller).<br />

trained family physicians are familiar. We created a<br />

“practice genogram” that allows researchers to understand<br />

practice behaviors and relationships in the same<br />

way that a family genogram promotes understanding of<br />

family dynamics. This paper defines the practice<br />

genogram, describes data-gathering methods, gives a<br />

case example, and discusses implications for use.<br />

Family <strong>Genograms</strong> and <strong>Practice</strong> <strong>Genograms</strong><br />

Systems theorists propose that individual actions<br />

by one part of a system can only be understood within<br />

the context of the entire system, since all individual<br />

actions are influenced by the functioning of the system<br />

as a whole. 13 Problems are assumed to reflect a<br />

system’s adaptation to its total context.<br />

The family genogram is an assessment tool used<br />

to identify patterns of family interaction and provide<br />

insights about system strengths and vulnerabilities. 12<br />

The genogram provides a visual “gestalt” of complex<br />

family patterns that is used to generate tentative hypotheses<br />

about the way in which problem behavior<br />

functions within the family context. 12,14,15 These hypotheses,<br />

if validated, may then suggest opportunities/avenues<br />

for positive change within a family<br />

system. The genogram has been adapted by family<br />

physicians as a tool to operationalize a family-cen-


Educational Research and Methods<br />

tered biopsychosocial approach to care. 16 Particular<br />

emphasis is placed on emotional connections among<br />

family members, across generations, and with important<br />

individuals or systems outside of the family system.<br />

Constructing a genogram involves three activities:<br />

1) visually mapping the structure of a family, 2)<br />

recording important information, ie, demographics,<br />

critical events, and crucial issues, and 3) showing<br />

emotional relationships and informal roles among<br />

members of the family.<br />

Increasingly, organizations are being viewed as<br />

complex, adaptive systems “that are conscious entities,<br />

possessing many of the properties of living systems.”<br />

17 The commonly used “machine” metaphor<br />

that emphasizes structure and parts is no longer adequate.<br />

Instead, organizations are now studied as<br />

“whole” systems, especially when considering<br />

change. 10 As family therapists discovered with families,<br />

to comprehend fully the “gestalt”of an organizational<br />

system, it is helpful to visualize the organization<br />

in terms of its complex relationships.<br />

Organizational charts can be used to understand<br />

how a practice functions; however, they are more<br />

likely to indicate how things are supposed to be than<br />

how they really are. Organizational charts rarely identify<br />

the informal, emotional, and relational patterns<br />

that are obvious to anyone who has ever worked in<br />

an organization. <strong>Genograms</strong> give that information,<br />

expanding a basic organizational chart into a more<br />

useful tool. It seemed a reasonable extension for us<br />

to use this tool to understand the organizational dynamics<br />

that could promote or prevent the implementation<br />

of change at the practice level. In constructing<br />

our practice genograms, we use similar concepts and<br />

terminology (Figure 1) to those used by McGoldrick<br />

and Gerson. 12<br />

Development of the <strong>Practice</strong> Genogram<br />

Since 1994, researchers in the departments of family<br />

medicine at the University of Nebraska Medical<br />

Center (UNMC) and Case Western Reserve University<br />

(CWRU) have been collaborating in the analysis<br />

of preventive service data from 82 primary care practices<br />

in northern Ohio. 18 Concurrently, UNMC researchers<br />

were initiating an intervention study in eight<br />

Nebraska family practices using the Put Prevention<br />

into <strong>Practice</strong> materials. 7 In the process of assessing<br />

those eight practices, one of the authors started informally<br />

using the genogram technique to keep track of<br />

the individuals involved in the practices and their formal<br />

and informal relationships to one another. This<br />

helped us understand the strengths and weaknesses<br />

of each system relative to the intervention. Although<br />

not formally used in all 82 Ohio practices, our knowledge<br />

of these practices provided an opportunity for<br />

discussion and expansion of the genogram concept.<br />

We currently have experience using the practice<br />

genogram in 59 locations, ranging from simply de-<br />

Figure 1<br />

Vol. 30, No. 7<br />

Symbols Used in <strong>Practice</strong> <strong>Genograms</strong><br />

491<br />

scribing some practices to interventional changes in<br />

others. These experiences are described in more depth<br />

as follows.<br />

The Nebraska Experience: <strong>Practice</strong> <strong>Genograms</strong><br />

Through Participant Observation<br />

The UNMC experience was designed to provide<br />

detailed descriptions of practices to understand their<br />

processes for providing preventive care. We used a<br />

case study framework employing a multi-method ethnographic<br />

data collection approach. 19-21 Research sites<br />

were told that we would like to study their practices<br />

and delivery of preventive services to better understand<br />

the barriers and facilitators to providing preventive<br />

care in real-life practices. Methods of data<br />

collection and analysis, including the genogram, were<br />

discussed prior to the practice agreeing to participate.<br />

<strong>Practice</strong>s were told that they would be given a summary<br />

of their prevention practices, including the<br />

genogram, at the end of the analysis.<br />

Primary data were participant observation field<br />

notes, 22-24 key informant interviews, 25,26 in-depth interviews<br />

of physicians and office staff, 27,28 documents<br />

used in the practice, 29 and medical record reviews. A<br />

research nurse collected these data as she observed<br />

practice activities. Observational field notes and key<br />

informant interviews were the primary data used to<br />

understand behavioral patterns within the practices.<br />

Field jottings (short reminders) taken during observation<br />

and clinical encounters were later expanded<br />

into more extensive field notes describing the research


492 July-August 1998 Family Medicine<br />

nurse’s impressions of the practice.<br />

Informal, unstructured key<br />

informant interviews with office<br />

personnel were undertaken to<br />

clarify observations. By reading<br />

the notes, the investigators got<br />

a sense of the practice before<br />

working with the research nurse<br />

to construct the genogram.<br />

Once the research nurse was<br />

in the practice long enough to<br />

understand the basic practice environment,<br />

the research team<br />

interviewed her to construct the<br />

genogram. We found that a<br />

large, easily erased white board<br />

is the best place to work on initial<br />

drafts of genograms. The<br />

organizational chart format was<br />

used, starting with the assumed<br />

hierarchy of authority and responsibility<br />

that would be expected<br />

with a given set of related<br />

roles (Figure 2). The research<br />

nurse was asked to identify all<br />

participants in the practice and<br />

their roles. Demographics of the<br />

Figure 2<br />

<strong>Practice</strong> Genogram Formatted in Organizational Chart Format<br />

Figure 3<br />

<strong>Practice</strong> Genogram With Relationships and Footnotes Obtained After 2 Days of <strong>Practice</strong> Observation<br />

FOOTNOTES:<br />

1. “Bee in bonnet” about prevention—<br />

wants to make changes


Educational Research and Methods<br />

individual members were elicited, including age, gender,<br />

number of years with the practice, current and<br />

past job responsibilities, percentage of time employed,<br />

and any characteristic personality traits identified<br />

during data gathering. Individuals or groups outside<br />

of the practice that significantly influenced the system<br />

were also included (eg, other clinics in Figure 3).<br />

Once the basic genogram structure had been constructed,<br />

it was expanded by asking the research nurse<br />

about functional and emotional relationships observed<br />

in the practices. Information was gathered in areas<br />

indicated by the questions listed in Table 1, which<br />

were developed from our own experience and from<br />

recommendations outlined in Webber et al. 30 A footnote<br />

process was used to highlight important information<br />

about a group or individual. Once the pen and<br />

paper version of the genogram was completed, computerized<br />

practice genograms were prepared using<br />

Visio ® 4.0, a software program specifically designed<br />

for creating flowcharts, network diagrams, organization<br />

charts, and cause-and-effect diagrams (Version<br />

4.0, 1995, Visio Corporation, Seattle, 206-521-4500).<br />

We have found that the length of time spent in the<br />

field has an impact on the depth of understanding.<br />

Figure 4<br />

Vol. 30, No. 7<br />

More Complex <strong>Practice</strong> Genogram Obtained After 2 Weeks of <strong>Practice</strong> Observation<br />

FOOTNOTES:<br />

1. “Bee in bonnet” about prevention—<br />

wants to make changes<br />

2. Left in 1992 after 7 years because of<br />

conflict with practice—now works<br />

for competing practice<br />

3. Considering retirement in a few<br />

years<br />

4. Concerned about practice survival if<br />

MD #1 retires and MD #2 leaves<br />

5. Supports projects of MD #1<br />

493<br />

Figure 3 shows a typical genogram after 2 days in a<br />

practice. Positive relationships were readily discernible,<br />

but there were no conflicts identified. After more<br />

extensive time at the practice (2 weeks), the picture<br />

became more complex (Figure 4), and some conflicts<br />

came to light. In our experience, it required a minimum<br />

of 1–2 weeks in the practice, depending on the<br />

number of physicians and staff, to get these types of<br />

details. Anecdotally, we have given reports to six of<br />

the 11 practices. In five of those six, we received positive<br />

feedback about the perceived validity of our<br />

analysis, including the genogram.<br />

The Case Western Experience: <strong>Practice</strong> <strong>Genograms</strong><br />

as Interview Guide<br />

Researchers at CWRU developed an alternative<br />

approach to practice genograms for their clinical trial,<br />

Study to Enhance Prevention by <strong>Understand</strong>ing <strong>Practice</strong><br />

(STEP-UP). This trial sought to increase prevention<br />

activities in randomly selected practices by tailoring<br />

office-level interventions based on a 2-day<br />

assessment of office practices. In the STEP-UP protocol,<br />

an initial practice genogram was completed by<br />

a research nurse during her first visit to each prac-


494 July-August 1998 Family Medicine<br />

Table 1<br />

Questions Used to Construct <strong>Genograms</strong><br />

• Who are the key members of the organization and what are their roles<br />

(formal and informal)?<br />

• What are the demographics for these individuals (age, gender, length<br />

of employment, etc)?<br />

• What are the important hierarchies, coalitions, triangles, and boundary<br />

problems in the organization?<br />

• How do the individuals and subsystems relate to each other with respect<br />

to professional roles and personal relationships?<br />

• What stage of the “life cycle” is the system in?<br />

• What are the important recent events or historical events that have<br />

shaped the practice?<br />

• How has the organization responded to recent changes?<br />

• What are the implicit and explicit belief systems within the practice?<br />

• Who are the most overtly and covertly powerful people in the system?<br />

• What is the overall communication style?<br />

• How is power shared in the system?<br />

Table 2<br />

STEP-UP Interview Guide for Developing a <strong>Practice</strong> Genogram<br />

Opening statement<br />

“I’m _____ from STEP-UP project. The practice is participating in _____. My role in STEP-UP is<br />

_____. I’m drawing an organizational chart to help me understand your practice.”<br />

Initial questions Follow-up questions<br />

“Who works here?” Demographics<br />

“Who works with whom?”<br />

“Who’s in charge?” “Who makes decisions:<br />

about patient care?”<br />

about personnel issues?”<br />

about office operations?”<br />

“Who reports to whom?” “Who supervises?”<br />

“Who can tell people what to do?”<br />

“How do the physicians communicate with each other? “Who are most powerful?”<br />

“How do physicians and staff communicate?”<br />

“How do staff members communicate?” “If you really want something done, who<br />

do you go to?”<br />

“What are recent events or changes?” “Who has left?”<br />

“Who owns the practice?”<br />

“Who is responsible for:<br />

patient care?”<br />

patient intake?”<br />

patient discharge?”<br />

billing and insurance?”<br />

patient education?”<br />

immunizations?”<br />

“What outside organizations affect the practice?”<br />

STEP-UP—Study to Enhance Prevention by <strong>Understand</strong>ing <strong>Practice</strong><br />

tice. The purpose for this initial visit, as presented to<br />

the practice, was to “get to know how the practice<br />

functions and learn who’s who.” The process began<br />

with the research nurse conducting brief structured<br />

interviews (Table 2) with the practice manager or lead<br />

physician and proceeded to interviews with other informants.<br />

<strong>To</strong> enhance validity and reliability, an<br />

emerging genogram was shared with other key informants<br />

with both similar and different roles in the office.<br />

These informants were asked to expand on, confirm,<br />

or disconfirm what had already been written.<br />

Also included in the assessment were medical record<br />

reviews; a structured practice environment checklist;<br />

brief qualitative field notes dictated by the facilitators;<br />

questionnaires completed by physicians, staff,<br />

and patients; and several patient-path diagrams. 1 Subsequent<br />

triangulation of information from these multiple<br />

sources was used to construct the final practice<br />

genogram. This was then used as one of the feedback<br />

tools when the facilitator subsequently met with the<br />

practice staff to plan their prevention enhancement<br />

intervention.<br />

Genogram Construction: A<br />

Case Example<br />

The role of the practice<br />

genogram is to provide a clear<br />

and succinct portrayal of an<br />

organization’s relational dynamics<br />

that highlights important patterns,<br />

strengths, and vulnerabilities.<br />

It focuses on multiple people<br />

and processes, using the organizational<br />

chart as a starting point,<br />

just as a family genogram uses a<br />

family tree. Multiple sources of<br />

data are combined to understand<br />

the complexity of a practice system.<br />

These can include checklists,<br />

surveys and questionnaires,<br />

observations, interviews, and<br />

medical record reviews.<br />

<strong>To</strong> illustrate the process, a fictitious<br />

practice was created based<br />

on several sites in the Nebraska<br />

study. Figure 2 is the organizational<br />

chart of the fictional practice,<br />

indicating formal levels of<br />

power, authority, and responsibility;<br />

Figure 4 is the final genogram.<br />

It reveals the greater complexity<br />

of the practice by including information<br />

on other important parts of<br />

the larger community system (eg,<br />

other clinics and physicians) and<br />

some of the key relationships<br />

among the physicians and staff.


Educational Research and Methods<br />

As shown in Figure 4, the important relationships<br />

identified in the fictional practice included the following:<br />

1) There is a competitive/conflicted relationship<br />

with the two other practices in town. 2) A previous<br />

partner (MD #3) left the practice after having disagreements<br />

with the senior physician (MD #1) and<br />

now works for a competing practice. 3) While MD<br />

#1 and MD #2 have an amicable relationship, the relationship<br />

between MD #1 and the physician assistant<br />

(PA) seems closer, as is that of MD #1 and the<br />

office manager. 4) MD #2 has a distant relationship<br />

with the PA and an amicable, but not close, relationship<br />

with the office manager. 5) The office manager’s<br />

relationship with the nurse (RN) who works with MD<br />

#2 is conflicted.<br />

MD #1 is considering retirement, which turns out<br />

to be an important issue in this system. The office<br />

manager has shifted away somewhat from the exclusionary<br />

triangle represented by MD #1, the PA, and<br />

the office manager. She voiced concern that the practice<br />

would probably close if the new physician left as<br />

the previous one did. At the same time, MD #2 wants<br />

to do some new things (prevention) that threaten the<br />

“old ways,” and he gets the RN involved in his new<br />

projects. This alliance seems to create tension between<br />

the office manager and the RN, possibly related to<br />

some perceived change in the power relationship.<br />

The strengths of this system include the positive<br />

relationship between the two physicians, the current<br />

positive relationship between MD #2 and the office<br />

manager, the office manager’s vested interest in keeping<br />

MD #2 in the practice, MD #2’s interest in prevention<br />

and willingness to make changes, and the<br />

close relationship between MD #2 and the RN and<br />

her willingness to participate in change. The vulnerabilities<br />

include the many levels of conflict that undermine<br />

cooperation and change, the strong coalition<br />

between MD #1, the PA, and the office manager that<br />

has been exclusionary in the past, and the lack of<br />

strong internal motivation for change on the part of<br />

this coalition.<br />

A reasonable but yet-to-be-validated hypothesis is<br />

that any planned intervention to change aspects of<br />

the system must account for these patterns of relationships.<br />

In this case, a possible opportunity to facilitate<br />

change in this practice might rest in the relationship<br />

between the office manager and MD #2.<br />

Given the office manager’s key role in the day-today<br />

functioning of the practice and MD #2’s interest<br />

in increasing preventive activities, it is plausible that<br />

fostering a creative alliance between the two of them<br />

that had mutual benefit might result in positive, and<br />

possibly enduring, change.<br />

Issues in <strong>Using</strong> <strong>Genograms</strong><br />

As is true when using any type of research or assessment<br />

tool, certain assumptions and limitations<br />

must be kept in mind. This is especially true for the<br />

Vol. 30, No. 7<br />

495<br />

practice genogram because it deals with emotional<br />

and relational issues, areas in which people and organizations<br />

often feel most vulnerable. Issues of confidentiality,<br />

how the information is gathered and used,<br />

and ethical issues are important. The following are<br />

some issues with which we have dealt.<br />

First, genograms are tools used to generate hypotheses,<br />

which must then be validated to be useful. Because<br />

they describe dynamic relationships, genograms<br />

are always considered to be in progress. <strong>Genograms</strong><br />

describe the way things may be now, but things can<br />

change at any time. <strong>Genograms</strong> can be used to describe<br />

outcome but usually only in the context of having<br />

a picture of how things are now as compared with<br />

a previous genogram of how things were then.<br />

Second, genograms are intended to be positively<br />

therapeutic and should never be used in a way that<br />

could injure the people involved. In family therapy,<br />

genograms are shared with the family when it is perceived<br />

that doing so will be therapeutic and used in a<br />

positive way.<br />

Third, genograms and systems theory constructs<br />

are complicated and easily misinterpreted or misused<br />

by those unfamiliar with them. Most family practice<br />

residencies teach these techniques and theoretical perspectives,<br />

and, thus, most family physicians are familiar<br />

with them.<br />

These precepts also hold for practice genograms.<br />

One approach to dealing with these ethical precepts<br />

is to fully involve the participants in genogram construction<br />

and to keep the genogram process available<br />

for their ongoing use. In the Nebraska study, for example,<br />

where more time is spent in each practice and<br />

the goal is descriptive understanding rather than intervention,<br />

we chose to share selected information on<br />

a case-by-case basis. Each practice is given options<br />

for different levels of feedback on our findings, including<br />

hypotheses generated by the genogram.<br />

Discussion<br />

It is inevitable that primary care practices and other<br />

aspects of the health care system will change. 31-35 It is<br />

our experience that efforts to change practices should<br />

be preceded by efforts to understand them. 9,36 While<br />

primary care practices have much in common, our<br />

research suggests that each is uniquely configured in<br />

response to the particular needs of its clinicians, staff,<br />

patients, and environment. <strong>Practice</strong> genograms have<br />

been useful to us in understanding these issues.<br />

<strong>To</strong> date, the lack of measurement methods that<br />

could increase our understanding of practice dynamics<br />

and characteristics have limited our success at<br />

understanding change. The practice genogram is one<br />

attempt to address this deficiency. Currently, it should<br />

be considered a research tool, because we do not feel<br />

that it has been sufficiently studied to recommend it<br />

for application as a practice management tool.<br />

Nonetheless, given their familiarity with the tool


496 July-August 1998 Family Medicine<br />

and concepts, many family physicians could consider<br />

experimenting with practice genograms during their<br />

individual efforts at change, keeping the previously<br />

mentioned caveats in mind.<br />

Theoretically, using practice genograms to understand<br />

practices prior to interventions is likely to have<br />

important consequences. First, the genogram may<br />

identify “lever points” in the practice through which<br />

small efforts could result in large changes. 36,37 The<br />

genogram may also identify approaches that are unlikely<br />

to be effective in a particular practice and may<br />

highlight unforeseen consequences of a planned intervention.<br />

Just as important, practice genograms may<br />

provide insights into the underlying reasons for current<br />

configurations and operations of practices.<br />

Whether the practice genogram is practical or costeffective<br />

as a general change technique is yet to be<br />

proven. The family genogram has proven helpful in<br />

family medical problems. For understanding the<br />

seemingly irrational and often paradoxical behavior<br />

of medical practices, the practice genogram contains<br />

exciting possibilities.<br />

Acknowledgments: The authors express their thanks to Diane Dodendorf,<br />

PhD, and Virginia Aita, PhD, for their invaluable assistance in the development<br />

and application of the practice genogram technique, Connie Gibb,<br />

RN, for her dedicated work in data collection, and Carol Gilbert, MS, for<br />

her assistance with research design. Portions of this work were supported<br />

by grants from the National Cancer Institute (1R01 60862 and 2R01<br />

60862), the Agency for Health Care Policy and Research (1R01 HS08776),<br />

and the Nebraska Cancer and Smoking Disease Research Program.<br />

Corresponding Author: Address correspondence to Dr McIlvain, Department<br />

of Family Medicine, University of Nebraska Medical Center, 600<br />

South 42nd Street, Omaha, NE 68198-3075. 402-559-5367. Fax: 402-<br />

559-8118. E-mail: hmcilva@unmc.edu.<br />

REFERENCES<br />

1. Pommerenke FA, Dietrich AJ. Improving and maintaining preventive<br />

services. Part I: identifying barriers and opportunities by applying<br />

the Patient Path Model. J Fam Pract 1992;34:86-91.<br />

2. Jaén CR, Stange KC, Nutting P. The competing demands of primary<br />

care: a model for the delivery of clinical preventive service. J Fam<br />

Pract 1994;38:166-71.<br />

3. Borkan J. Changing health provider behavior. In: Crabtree BF, Miller<br />

WL, Addison RB, et al, eds. Exploring collaborative research in primary<br />

care. Newbury Park, Calif: Sage Publications, 1994.<br />

4. Greco PJ, Eisenberg JM. Changing physicians’ practices. N Engl J<br />

Med 1993;329:1271-4.<br />

5. Davis DA, Thomson MA, Oxman AD, Hanes B. Changing physician<br />

performance: a systematic review of the effect of continuing<br />

medical education strategies. JAMA 1995;274:700-5.<br />

6. McIlvain HE, Crabtree BF, Gilbert C, Havranek R, Backer EL. Current<br />

trends in tobacco prevention and cessation in Nebraska physicians’<br />

offices. J Fam Pract 1997;44:193-202.<br />

7. McVea K, Crabtree BF, Medder JD, et al. An ounce of prevention?<br />

Evaluation of the “Put Prevention into <strong>Practice</strong>” program. J Fam Pract<br />

1996;43:361-9.<br />

8. Main DS, Cohen SJ, DiClemente CC. Measuring physician readiness<br />

to change cancer screening: preliminary results. Am J Prev Med<br />

1995;99:54-8.<br />

9. Stange KC. One size doesn’t fit all: multimethod research yields new<br />

insights into interventions to increase prevention in family practice.<br />

J Fam Pract 1996;43:358-60.<br />

10. McDaniel RR. Strategic leadership: a view from quantum and chaos<br />

theories. Health Care Manage Rev 1997;winter:21-37.<br />

11. Crabtree BF. Individual attitudes are no match for complex systems.<br />

J Fam Pract 1997;44:447-8.<br />

12. McGoldrick M, Gerson R. <strong>Genograms</strong> in family assessment. New<br />

York: WW Norton and Company, 1985.<br />

13. Bowen M. Family therapy in clinical practice. New York: Jason<br />

Aronson, 1978.<br />

14. Bowen M. Key to the use of the genogram. In: Carter EA, McGoldrick<br />

M, eds. The family life cycle: a framework for family therapy. New<br />

York: Gardner Press, 1980.<br />

15. Minuchin S. Families and family therapy. Cambridge, Mass: Harvard<br />

University Press, 1974.<br />

16. Doherty WJ, Baird MA. Family therapy and family medicine. New<br />

York: The Guilford Press, 1983.<br />

17. Wheatley MJ. Leadership and the new science. Learning about organization<br />

from an orderly universe. San Francisco: Berrett-Koehler<br />

Publishers, 1992.<br />

18. Crabtree BF, Miller WL, Aita VA, Flocke SA, Stange KC. Primary<br />

care practice organization and preventive service delivery: a qualitative<br />

analysis. J Fam Pract 1998;46:403-9.<br />

19. Stake RE. The art of case study research. Thousand Oaks, Calif: Sage<br />

Publications, 1995.<br />

20. Yin RK. Case study research: design and method. Newbury Park,<br />

Calif: Sage Publications, 1989.<br />

21. Creswell JW. Qualitative inquiry and research design: choosing<br />

among five traditions. Thousand Oaks, Calif: Sage Publications, 1998.<br />

22. Jorgensen DL. Participant observation. Newbury Park, Calif: Sage<br />

Publications, 1989.<br />

23. Bogdewic SP. Participant observation. In: Crabtree BF, Miller WL,<br />

eds. Doing qualitative research: multiple strategies. Newbury Park,<br />

Calif: Sage Publications, 1992.<br />

24. Bogdewic SP, Jamison PK. Participant observation. In: Crabtree BF,<br />

Miller WL, Addison RB, et al, eds. Exploring collaborative research<br />

in primary care. Newbury Park, Calif: Sage Publications, 1994.<br />

25. Gilchrist VJ. Key informant interviewing. In: Crabtree BF, Miller<br />

WL, eds. Doing qualitative research: multiple strategies. Newbury<br />

Park, Calif: Sage Publications, 1992.<br />

26. Johnson JC. Selecting ethnographic informants. Newbury Park, Calif:<br />

Sage Publications, 1990.<br />

27. Crabtree BF, Miller WL. A qualitative approach to primary care research:<br />

the long interview. Fam Med 1991;23(2):145-51.<br />

28. Miller WL, Crabtree BF. Depth interviewing: the long interview approach.<br />

In: Stewart M, Tudiver F, Bass M, Dunn E, Norton P, eds.<br />

<strong>To</strong>ols for primary care research. Newbury Park, Calif: Sage Publications,<br />

1992.<br />

29. Stanfield JH, Katerndahl DA. <strong>Using</strong> human documents. In: Crabtree<br />

BF, Miller WL, Addison RB, et al, eds. Exploring collaborative research<br />

in primary care. Newbury Park, Calif: Sage Publications, 1994.<br />

30. Weber TT, McDaniel SH, Wynne LC. Signposts for a systems consultation.<br />

In: Wynne LC, McDaniel SH, Weber TT, eds. Systems consultation.<br />

A new perspective for family therapy. New York: The<br />

Guilford Press, 1986.<br />

31. Lewis CE. Disease prevention and health promotion practices of primary<br />

care physicians in the United States. Am J Prev Med<br />

1988;4(suppl):9-16.<br />

32. <strong>And</strong>erson L, May DS. Has the use of cervical, breast, and colorectal<br />

cancer screening increased in the United States? Am J Public Health<br />

1995;85:840-2.<br />

33. Committee of the American College of Rheumatology Council on<br />

Health Care Research. Role of specialty care for chronic diseases: a<br />

report from an ad hoc committee of the American College of Rheumatology.<br />

Mayo Clin Proc 1996;71:1179-81.<br />

34. Jollis JG, DeLong ER, Peterson ED, et al. Outcome of acute myocardial<br />

infarction according to the specialty of the admitting physician.<br />

N Engl J Med 1996;335:1880-7.<br />

35. Wennberg JE. Small area analysis and the medical care outcome problem.<br />

In: Sechrest L, Perrin E, Bunker J, eds. AHCPR conference<br />

proceedings. Research methodology: strengthening causal interpretation<br />

of nonexperimental data. DHHS publication no. (PHS) 90-<br />

3454. Washington, DC: Public Health Service, Department of Health<br />

and Human Services, 1990;May:177-206.<br />

36. Stacey RD. Complexity and creativity in organizations. San Francisco:<br />

Berrett-Koehler Publishers, 1996.<br />

37. Senge PM. The fifth discipline. The art and practice of the learning<br />

organization. New York: Doubleday, 1990.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!