07.08.2014 Views

Comparing Outcomes of Voice Therapy - Stimm-und-sprachtherapie ...

Comparing Outcomes of Voice Therapy - Stimm-und-sprachtherapie ...

Comparing Outcomes of Voice Therapy - Stimm-und-sprachtherapie ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Comparing</strong> <strong>Outcomes</strong> <strong>of</strong> <strong>Voice</strong> <strong>Therapy</strong>: A<br />

Benchmarking Study Using the <strong>Therapy</strong> Outcome<br />

Measure<br />

*Alexandra John, *Pamela Enderby, and †Anthony Hughes<br />

Sheffield and Bristol, United Kingdom<br />

Summary: The quality cycle requires clinicians to assess the outcomes <strong>of</strong><br />

interventions. Benchmarking is an approach that has been advocated to compare<br />

current performance across different services to identify commonalities<br />

and significant differences. This article gives the results <strong>of</strong> a study <strong>of</strong> outcomes in<br />

speech and language therapy (SLT) using the therapy outcome measure (TOM)<br />

for patients with voice disorder (dysphonia) comparing outcomes <strong>of</strong> seven<br />

separate speech and language therapy services. The study aimed to identify<br />

the similarities and differences in outcomes <strong>of</strong> care provided by different<br />

services. Two h<strong>und</strong>red and forty patients with dysphonia (age range 3–87.5<br />

years, average 51.9 years) were treated. The results indicated that although<br />

there was no significant difference in the pr<strong>of</strong>ile <strong>of</strong> the severity <strong>of</strong> symptomology<br />

<strong>of</strong> patients referred to speech and language therapy in different geographical<br />

areas, there was a significant difference in the treatment outcomes across the<br />

services and in the stated reason for discharge from treatment. Nevertheless,<br />

most patients with dysphonia had a good outcome and this was associated<br />

with completion <strong>of</strong> the course <strong>of</strong> treatment. There were significant differences<br />

in the number <strong>of</strong> treatment contacts provided by the different services and in the<br />

duration (between admission and discharge) <strong>of</strong> treatment across the services.<br />

Benchmarking can provide useful information through use <strong>of</strong> routinely collected<br />

clinical data.<br />

Key Words: Benchmarking—Speech and language therapy—<strong>Therapy</strong> outcome<br />

measures—<strong>Voice</strong> outcomes.<br />

Accepted for publication January 26, 2004.<br />

From the *The University <strong>of</strong> Sheffield, United Kingdom;<br />

†Speech and Language <strong>Therapy</strong> Research Unit <strong>of</strong> North Bristol<br />

NHS Service, United Kingdom.<br />

Address correspondence and reprint requests to Alexandra<br />

John, Research Associate, University <strong>of</strong> Sheffield, Institute <strong>of</strong><br />

General Practice and Primary Care, Community Sciences Centre,<br />

Northern General Hospital, Herries Road, Sheffield S5 7AU,<br />

UK. E-mail: a.k.john@sheffield.ac.uk<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, pp. 114–123<br />

0892-1997/$30.00<br />

2005 The <strong>Voice</strong> Fo<strong>und</strong>ation<br />

doi:10.1016/j.jvoice.2004.01.008<br />

INTRODUCTION<br />

Political imperatives resulting from the U.K.<br />

Government White Paper “The NHS: Modern and<br />

Dependable” 1 have placed an emphasis on quality<br />

improvement, and to this end, different strategies<br />

have been put in place to promote the better use<br />

<strong>of</strong> existing resources (White Paper: “A First Class<br />

Service” 2 ). Clinical governance has been placed as a<br />

framework for such quality improvement, and<br />

although much <strong>of</strong> health care monitors outcomes<br />

and quality implicitly, there is a move to ensure<br />

114


THERAPY OUTCOME MEASURE 115<br />

that all health care pr<strong>of</strong>essionals actively monitor<br />

quality and effectiveness <strong>of</strong> their services in an explicit<br />

and coordinated fashion. This would ensure<br />

that services provide appropriate interventions and<br />

that variable quality is identified to improve confidence<br />

to users and purchasers <strong>of</strong> services.<br />

Swange 3 identified five areas to address to improve<br />

the quality <strong>of</strong> health services: the culture <strong>of</strong><br />

the organization, inequity and variability in the provision<br />

<strong>of</strong> services, involvement <strong>of</strong> users, sharing<br />

good practice, and detecting and dealing with poor<br />

performance. Benchmarking can assist with four <strong>of</strong><br />

these areas by making comparisons to identify best<br />

practice, providing a baseline for a repeated measure,<br />

facilitating the capacity to learn from variation,<br />

and contributing to the knowledge base. It has utility<br />

in the absence <strong>of</strong> other information on, for example,<br />

what works best for whom, and when relationships<br />

between processes and outcomes <strong>of</strong> care are not<br />

well <strong>und</strong>erstood. 4,5<br />

Benchmarking begins with the identification <strong>of</strong><br />

the specific area <strong>of</strong> the service to be investigated<br />

and compared. It requires four f<strong>und</strong>amental steps:<br />

planning the study, collecting the data, analyzing<br />

the data, and adapting services. 6 For valid comparisons<br />

to be made, it is essential that suitable process<br />

and outcome indicators are selected and data are<br />

collected in a systematic way. 7<br />

Health services internationally have a longer tradition<br />

<strong>of</strong> using benchmarking in financial and nonclinical<br />

services. 8 However, when it has been used<br />

for clinical practice, it has been fo<strong>und</strong> to be a useful<br />

tool. 9,10 In speech and language therapy, the few<br />

benchmarking studies reported in the literature have<br />

focused on internal benchmarking <strong>of</strong> services 11,12<br />

rather than external benchmarking, which compares<br />

one service against other services.<br />

This article describes the results <strong>of</strong> one client<br />

group studied within a larger benchmarking exercise,<br />

whichusedthetherapyoutcomemeasure(TOM) 13,14<br />

as an outcome indicator to compare the outcomes <strong>of</strong><br />

speech and language therapy for individuals with a<br />

voice disorder across different United Kingdom<br />

National Health Service (NHS) Speech and Language<br />

<strong>Therapy</strong> Service sites.<br />

This study aimed to investigate the question<br />

whether there was variability between seven sites<br />

<strong>of</strong>fering speech and language therapy services for<br />

people with a voice problem in terms <strong>of</strong> their severity<br />

on entry to treatment, if they changed in similar<br />

ways during treatment and whether they had similar<br />

pr<strong>of</strong>iles in terms <strong>of</strong> abilities and/or difficulties<br />

on discharge. The study addressed only the first three<br />

steps <strong>of</strong> benchmarking—planning, data collection,<br />

and analysis. The results <strong>of</strong> the analysis were fed<br />

back to the speech and language therapy services<br />

in each <strong>of</strong> the Services. How the services used<br />

this information and what changes resulted are not<br />

reported in this article.<br />

METHOD<br />

This benchmarking study was designed as a longitudinal<br />

cohort study covering a 20-month period.<br />

<strong>Voice</strong> specialists from seven speech and language<br />

therapy services were recruited. Service A provided<br />

a children’s service and Service B an adult service.<br />

The other Services covered both children and adults<br />

from the populations that they served.<br />

The TOM was selected as the outcome indicator.<br />

This is a single measure with four dimensions, specifically<br />

the Impairment (the degree <strong>of</strong> severity <strong>of</strong><br />

the voice disorder), Disability/Activity (the degree<br />

<strong>of</strong> limitation in use <strong>of</strong> voice to communicate), Handicap/Participation<br />

(amount <strong>of</strong> disadvantage to social<br />

participation), and Well-being <strong>of</strong> the patient (affect<br />

on emotion/level <strong>of</strong> distress). The first three dimensions<br />

are based on the WHO ICIDH. 15 The speech<br />

and language therapists (SLTs) were trained to use<br />

their clinical judgment based on the assessment and<br />

case history to rate the patient independently on each<br />

<strong>of</strong> these four dimensions. Each TOM dimension has<br />

an ordinal 11-point rating scale. Each scale has six<br />

integers defined by operational descriptors (see<br />

example in Appendix) with <strong>und</strong>efined half points<br />

that are included to increase the sensitivity <strong>of</strong> the<br />

measure. The development and psychometric properties<br />

<strong>of</strong> the TOM have been described in the<br />

<strong>Therapy</strong> Outcome Measures: Speech & Language<br />

Pathology Technical Manual. 14 The measure allows<br />

a quick, reliable representation <strong>of</strong> a clinician’s view<br />

<strong>of</strong> the speech and language condition and its impact.<br />

The participating speech and language therapists<br />

were adequately trained in the use <strong>of</strong> TOM 16 and<br />

achieved good levels <strong>of</strong> inter-rater reliability.<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, 2005


116<br />

ALEXANDRA JOHN ET AL<br />

TABLE 1. Number, Percentage, Mean Age and Age Range for “All Cases” and Cases by Service<br />

<strong>Voice</strong> disorder Service A Service B Service C Service D Service E Service F Service G All cases<br />

Number <strong>of</strong> cases 5 68 29 46 6 46 40 240<br />

Percentage 2.1% 28.3% 12.1% 19.2% 2.5% 19.2% 16.7% 100%<br />

Mean age*** 14.6 56.8 51.9 50.2 49.6 46.5 51.7 50.3<br />

Age range 11.9–16.5 28.4–87.6 18.4–79.6 7.2–78.3 3–82.8 10–76.6 5.62–86.7 3.1–87.6<br />

***p 0.001.<br />

The speech and language therapists used the TOM<br />

to rate consecutive new cases on admission to treatment,<br />

at the end <strong>of</strong> each episode <strong>of</strong> care and on<br />

discharge from therapy.<br />

The analysis <strong>of</strong> the data aimed to answer the<br />

study questions.<br />

Do clients have an equal opportunity <strong>of</strong> accessing<br />

voice therapy regardless <strong>of</strong> where they are<br />

treated?<br />

Does the application <strong>of</strong> voice therapy produce<br />

similar changes in clients’ abilities and/or disabilities,<br />

regardless <strong>of</strong> where the treatment is<br />

provided?<br />

Do clients have similar pr<strong>of</strong>iles <strong>of</strong> abilities and/<br />

or disabilities on discharge regardless <strong>of</strong> where<br />

they are treated?<br />

Is there a difference in the quantity and duration<br />

<strong>of</strong> treatment and is this associated with amount<br />

<strong>of</strong> change?<br />

Ordinal data were analyzed using a Kruskal–<br />

Wallis statistic, and interval data were analyzed<br />

using ANOVA.<br />

RESULTS<br />

At the end <strong>of</strong> the 18-month data collection period,<br />

TOM data for 240 cases had been coded by the SLTs<br />

as having a voice disorder. Of these, although 183<br />

(76%) had completed their treatment, 57 (24%) were<br />

still in treatment at the end <strong>of</strong> the study period.<br />

Table 1 shows the numbers <strong>of</strong> cases entered by each<br />

participating Service.<br />

There were a number <strong>of</strong> etiologies associated with<br />

dysphonia requiring a referral to speech and language<br />

therapy (see Figure 1). The diagnosis was<br />

provided by the SLTs from their clinical records and<br />

denotes SLT opinion based on assessment and<br />

medical information. Vocal misuse represented the<br />

largest group.<br />

Results related to Question 1<br />

Do clients have an equal opportunity<br />

<strong>of</strong> accessing voice therapy regardless <strong>of</strong> where<br />

they are treated?<br />

To address the first study question, the analysis<br />

investigated the age <strong>of</strong> patients on admission to treatment<br />

and the initial ratings for all patients (to act as<br />

a benchmark and, by Service, to provide comparison<br />

with the overall benchmark). The age pr<strong>of</strong>ile is<br />

shown in Table 1.<br />

The median age on entry to treatment for all patients<br />

was 51.9 years with an overall range <strong>of</strong> 3.1–<br />

87.6 years. The data analysis fo<strong>und</strong> a significant<br />

difference across the Services in the age <strong>of</strong> patients<br />

on entry to treatment (ANOVA F 4.0; df 6; p <br />

0.001). This may be explained, in part, by Service<br />

A providing services only to a pediatric population,<br />

whereas Service C did not rate any pediatric patients<br />

during the study. The other Services (B, D, E, F, C)<br />

showed a more similar pr<strong>of</strong>ile <strong>of</strong> ages (within a 6-<br />

year spread <strong>of</strong> ages). The initial TOM admission<br />

ratings showed variation with age. There was a<br />

tendency for the younger patients to have a higher<br />

initial rating on Participation and Well-being than<br />

older patients. Analysis showed a significant difference<br />

in the age <strong>of</strong> patients on admission to treatment<br />

and the initial start rating on Disability/Activity<br />

(Kruskal–Wallis H 104.5; df 73; p 0.009) and on<br />

Participation (Kruskal–Wallis H 93.5; df 73; p 0.05).<br />

However, there were no significant differences in the<br />

age <strong>of</strong> patients on admission and contacts or for age and<br />

duration <strong>of</strong> treatment for those completing treatment.<br />

Inspection <strong>of</strong> the data for patients with a structural<br />

voice pathology showed a tendency for patient to<br />

have a lower initial rating than the other conditions<br />

causing dysphonia, but this was not statistically significant.<br />

The analysis <strong>of</strong> the initial admission ratings<br />

data for all patients with dysphonia did not indicate<br />

any significant difference across the Services on<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, 2005


THERAPY OUTCOME MEASURE 117<br />

FIGURE 1. Etiologies associated with voice disorders.<br />

the dimensions <strong>of</strong> Impairment, Disability/Activity,<br />

and Participation/Handicap, although there were<br />

significant differences on the Well-being (Kruskal–<br />

Wallis H 12.8; df 6; p 0.04). Table 2 shows the<br />

mean, median, and range <strong>of</strong> the initial admission<br />

ratings for the Services.<br />

The results <strong>of</strong> analysis indicate that patients<br />

tended to enter treatment for voice therapy at similar<br />

points on the TOM with the exception <strong>of</strong> Well-being.<br />

This suggests that there was equity <strong>of</strong> access to<br />

treatment for patients with a voice disorder across<br />

these Services. The results do not indicate that the<br />

severity <strong>of</strong> the dysphonic condition, as rated on<br />

the TOM, produced any inequality in a client’s opportunity<br />

to access voice therapy.<br />

Results related to Question 2<br />

Does the application <strong>of</strong> voice therapy produce<br />

similar changes in clients’ abilities and/or<br />

disabilities, regardless <strong>of</strong> where the<br />

treatment is provided?<br />

Most patients made positive progress during<br />

treatment; a few made a negative change; and some<br />

sustained their positions on the rating scale; <strong>of</strong><br />

these, the dimension <strong>of</strong> Participation had the highest<br />

number <strong>of</strong> patients sustaining the initial rating. The<br />

patients who were rated at “5” at the start and end<br />

<strong>of</strong> treatment (in other words, had no difficulties on<br />

this dimension) were subtracted from the total sustained<br />

and the number shown in brackets in Table<br />

3. The number <strong>of</strong> patients showing positive improvement,<br />

sustaining their TOM rating, or changing negatively<br />

were analyzed using the Kruskal–Wallis<br />

statistic. There was a significant difference across<br />

Services on Impairment (Kruskal–Wallis H 13.2; df<br />

6; p 0.04) and a significant difference on Participation<br />

(Kruskal–Wallis H 24.7; df 6; p 0.0001). On<br />

this measure, the TOM ratings showed no significant<br />

differences between the Services on the dimensions<br />

<strong>of</strong> Disability/Activity, and Well-being. The dimension<br />

<strong>of</strong> Participation showed many patients (42%)<br />

were not rated as experiencing social disadvantages<br />

as a result <strong>of</strong> their dysphonia. The study findings indicated<br />

that most patients made a positive change<br />

and that the application <strong>of</strong> voice therapy produced<br />

variations in changes on specific dimensions dependant<br />

on where the patient was treated.<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, 2005


118<br />

ALEXANDRA JOHN ET AL<br />

TABLE 2. Initial Admission Rating Mean, Median, and Range for “All Cases” and by Service<br />

Statistic Service A Service B Service C Service D Service E Service F Service G All cases<br />

Impairment 5 68 29 46 6 46 40 240 cases<br />

Mean 2.6 2.9 2.8 2.9 2.8 2.9 2.7 2.8<br />

Median 3 3 3 3 3 3 3 3<br />

Range 1–3.5 1–4 1–4 1–4 1.5–4 0–5 0–4.5 0–5<br />

Disability/activity<br />

Mean 2.5 2.8 3 2.9 2.6 3.1 3 2.9<br />

Median 3 3 3 3 2.7 3 3 3<br />

Range 1–3.5 1–5 2–4 0–5 1.5–3.5 1–5 0–4 0–5<br />

Participation/handicap<br />

Mean 4 3.7 3.7 4.1 4 3.9 4 3.9<br />

Median 4 4 4 4 4 4 4 4<br />

Range 3–5 1–5 .5–5 3–5 3–5 1.5–5 2.5–5 .5–5<br />

Well-being<br />

Mean 2.7 3.4 3.5 3.1 3.3 3.2 2.9 3.2<br />

Median* 3 3.5 4 3 3.5 3.3 3 3.5<br />

Range 1–4 1–5 1–5 1–4.5 1–5 0–5 1–5 0–5<br />

*p 0.05.<br />

Results related to Question 3<br />

Do clients have similar pr<strong>of</strong>iles <strong>of</strong> abilities<br />

and/or disabilities on discharge regardless<br />

<strong>of</strong> where they are treated?<br />

At the end <strong>of</strong> the study, 183 patients had completed<br />

treatment and were discharged from voice<br />

therapy. The mean, median, and range <strong>of</strong> final TOM<br />

ratings are shown in Table 4.<br />

Statistical analysis fo<strong>und</strong> a significant difference<br />

across the Services on all TOM dimensions, a significant<br />

difference on all dimensions <strong>of</strong> the TOM;<br />

the results for Impairment were Kruskal–Wallis H<br />

19.9; df 6; p 0.003, Disability/Activity Kruskal–<br />

Wallis H 24; df 6; p 0.001, Participation Kruskal–<br />

Wallis H 23.9; df 6; p 0.001; and Well-being<br />

Kruskal–Wallis H 22; df 6; p 0.001. The results<br />

show a significant variation across the Services in<br />

the outcomes <strong>of</strong> treatment, for example, in one Service<br />

(Service G), patients were discharged when<br />

the TOM rating was at 5 (normal), whereas other<br />

Services discharged patients when some difficulties<br />

still remained.<br />

Analysis on the reason patients were discharged<br />

from treatment showed that those who had completed<br />

their treatment were the majority (83%)<br />

(Table 5). Nevertheless, there were significant differences<br />

across the Services in the reason for discharge.<br />

For example, Service B had patients in six <strong>of</strong> the categories<br />

for “Reason for discharge.” This contrasted<br />

with Service D where all patients were discharged as<br />

“Treatment complete.” On the overall benchmark,<br />

the categories <strong>of</strong> “Self discharge” and “Non attendance”<br />

were the main alternative reasons provided<br />

for discharge, comprising 5% <strong>of</strong> the cases. Analysis<br />

<strong>of</strong> the reason for discharge and each TOM dimension<br />

showed significant differences between the final ratings<br />

and the reason for discharge (Table 5). It was<br />

also noted by the authors from reviewing the data<br />

that patients who had completed their treatment<br />

achieved higher final ratings on all TOM dimensions,<br />

indicating a more positive outcome.<br />

Results related to Question 4<br />

Is there a difference in the quantity and<br />

duration <strong>of</strong> treatment and is this associated<br />

with amount <strong>of</strong> change?<br />

Table 6 shows the contacts and duration <strong>of</strong> treatment.<br />

There was a significant difference in the<br />

number <strong>of</strong> contacts received by the voice patients<br />

ANOVA F 2.4; df 6; p 0.03 and an even more<br />

significant different across the Services (ANOVA F<br />

5.6; df 6; p 0.001) for the duration <strong>of</strong> treatment. It<br />

can be seen that the benchmark for all patients shows<br />

5.9 contacts SD 3.9 and a duration <strong>of</strong> 5 months SD<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, 2005


THERAPY OUTCOME MEASURE 119<br />

TABLE 3. <strong>Voice</strong>: Cases Completing Treatment; Direction <strong>of</strong> Change for All Cases and by Service#<br />

Direction <strong>of</strong> Service Service Service Service Service Service Service<br />

TOM dimension change A B C D E F G All cases % All cases<br />

Number <strong>of</strong> cases 5 48 29 23 4 43 31 183 —<br />

Impairment* Negative change 0 0 0 0 0 1 0 1 0.5%<br />

Sustained 1 7 (2) 2 0 0 8 (2) 2 20 (4) 13%<br />

Positive change 4 39 27 23 4 32 29 158 86%<br />

Disability/activity Negative change 0 0 0 0 0 1 0 1 0.5%<br />

Sustained 0 4 (2) 2 1 (1) 0 7 (3) 2 16 (6) 12%<br />

Positive change 5 47 27 21 4 32 29 160 87%<br />

Participation*** Negative change 0 0 0 0 0 1 0 1 0.5%<br />

Sustained 2 (1) 10 (3) 2 (2) 1 (5) 3 (1) 8 (15) 1 (11) 27 (38) 36%<br />

Positive change 2 35 25 17 0 19 19 117 64%<br />

Well-being Negative change 0 0 0 1 0 1 0 2 1%<br />

Sustained 0 6 (3) 3 (3) 1 0 (1) 8 (3) 0 (1) 18 (11) 16%<br />

Positive change 5 39 23 21 3 31 30 152 83%<br />

#(The number <strong>of</strong> cases rated ‘5’ at start and finish are shown separately in the brackets).<br />

*p 0.05.<br />

***p 0.001.<br />

4.4, showing variation in the intervention provided<br />

to patients. Of all <strong>of</strong> the Services, Service G had a<br />

tendency to provide more intervention over a similar<br />

duration than the other Services.<br />

DISCUSSION<br />

This benchmarking study collected routine clinical<br />

outcome data on nonselected consecutively referred<br />

patients from seven speech and language<br />

therapy services using the TOM. Analysis <strong>of</strong> the data<br />

fo<strong>und</strong> that patients with voice disorders entered into<br />

the study and appeared to have equity <strong>of</strong> access<br />

to treatment regardless <strong>of</strong> location. Most patients referred<br />

were middle aged, but there was a wide overall<br />

age range represented. The literature relating to the<br />

epidemiology <strong>of</strong> voice disorders indicates a wide<br />

variation in the age pr<strong>of</strong>ile in the general population.<br />

Various studies quote different figures. 17,18 In this<br />

study, the analysis <strong>of</strong> initial rating showed variation<br />

with age across the TOM dimensions. There was a<br />

tendency for the younger patients to have a higher<br />

initial rating on Participation and Well-being than<br />

older patients. One might speculate that voice problems<br />

in children cause less impact on their social life<br />

in general than fo<strong>und</strong> in adults. One interpretation<br />

<strong>of</strong> these results is that voice disorders may present<br />

different difficulties to people at different stages in<br />

their life.<br />

The analysis <strong>of</strong> change over time in treatment<br />

fo<strong>und</strong> a significant difference across the Services<br />

only in the dimension <strong>of</strong> Handicap/Participation.<br />

There were differences in the number <strong>of</strong> patients who,<br />

on presentation to therapy, were graded as having<br />

no disadvantage in Participation versus those who<br />

were disadvantaged and sustained that disadvantage.<br />

The pr<strong>of</strong>ile across the Services varied, for example,<br />

Services B and G show a markedly different<br />

pattern. The overall benchmark shows that most<br />

made a positive change on each <strong>of</strong> the dimensions.<br />

It has proved difficult to compare the TOM findings<br />

directly with other research studies because <strong>of</strong><br />

the variation in the way other studies were conducted<br />

and reported and reviewed. The findings <strong>of</strong> this study<br />

showed positive change, and this reflects the findings<br />

from studies on effectiveness, which report that most<br />

patients do benefit from treatment. 17–20<br />

This study fo<strong>und</strong> significant variation across the<br />

Services in the outcomes to treatment. The variation<br />

appeared to relate to SLTs discharging patients at<br />

differing points. This suggests that SLTs use different<br />

judgments when discharging patients. Considerable<br />

variation in the frequency and duration <strong>of</strong><br />

treatment was reported in the literature. 18 The use<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, 2005


120<br />

ALEXANDRA JOHN ET AL<br />

TABLE 4. <strong>Voice</strong> Cases’ Final TOM Ratings; Mean, Median, and Range<br />

Statistic Service A Service B Service C Service D Service E Service F Service G All cases<br />

Number <strong>of</strong> cases 5 48 29 23 4 43 31 183<br />

Impairment<br />

Mean 3.9 4.4 4.2 4.5 4 4 4.6 4.3<br />

Median** 4.5 4.5 4.5 4.5 4 4 5 4.5<br />

Range 2–5 2–5 2.5–5 4–5 3–5 1.5–5 2–5 1.5–5<br />

Disability/activity<br />

Mean 3.8 4.4 4.2 4.6 4 4.1 4.7 4.3<br />

Median*** 4.5 4.5 4.5 5 4 4.5 5 4.5<br />

Range 2.5–5 3–5 2.5–5 4–5 3–5 2–5 3–5 2–5<br />

Participation<br />

Mean 4.6 4.6 4.6 4.9 4.2 4.4 4.8 4.6<br />

Median*** 5 4.5 5 5 4 5 5 5<br />

Range 4–5 4–5 2–5 4.5–5 4–5 2–5 3.5–5 2–5<br />

Well-being<br />

Mean 4.2 4.6 4.2 4.5 4.2 4.3 4.9 4.5<br />

Median*** 4.5 5 5 5 4.5 4.5 5 5<br />

Range 2.5 3.5–5 1.5–5 0–5 3–5 2–5 4–5 0–5<br />

**p 0.01.<br />

***p 0.001.<br />

<strong>of</strong> different measures in studies makes direct comparisons<br />

difficult; some studies reported sessions,<br />

others reported the actual time, and a few studies<br />

report the duration <strong>of</strong> treatment. The range varied<br />

considerably in the studies reported and reviewed by<br />

Pannbacker, 18 for example, 4 contacts to 51 contacts,<br />

whereas the duration <strong>of</strong> treatment ranged from 2<br />

weeks to 2 years. Few studies quoted both the<br />

number <strong>of</strong> contacts and the duration <strong>of</strong> treatment.<br />

For those studies that reported both, the intensity<br />

and duration ranged from 5 contacts in 5 days to 1<br />

contact a week over 3 to 7 months (approximately 12<br />

to 28 contacts). This is in contrast to this study<br />

where the range for all patients varied from 1 to 23<br />

contacts with the duration from 0.1 month to 20.2<br />

months. This variation shows the need to collect<br />

data routinely and systematically on contacts and<br />

duration if valid comparisons between pr<strong>of</strong>iles <strong>of</strong><br />

intervention intensity are to be gathered to inform<br />

and change practice to effect better care.<br />

We fo<strong>und</strong> a marked variation in the reasons for<br />

discharge from treatment, and in the final rating,<br />

with a highly significant difference across the Services.<br />

This study indicates that patients completing<br />

their full treatment had the best outcomes. However,<br />

some Services had more patients discharged for alternative<br />

reasons. It would have been useful to know<br />

why these patients chose not to complete their treatment<br />

(most self-discharged or did not attend) when<br />

they still had difficulties as reflected in the poorer<br />

outcomes recorded at the time they ceased attending<br />

for treatment. A future study might usefully follow<br />

up such patients to identify why they chose to end<br />

attendance. The different pr<strong>of</strong>iles on all dimensions<br />

on the TOM on discharge from treatment were dependent<br />

on location <strong>of</strong> treatment. The reason for<br />

this result is unknown and related to a number <strong>of</strong><br />

factors such as the type <strong>of</strong> treatment used in the<br />

intervention, the patients’ or SLTs’ characteristics,<br />

the etiology, or case management. However, the<br />

study results indicate that despite the variations in<br />

the outcomes <strong>of</strong> care on TOM across the Services,<br />

speech and language therapy treatment for patients<br />

with voice disorders is generally effective.<br />

This finding concurs with a number <strong>of</strong> studies conducted<br />

on voice disorders. 18–21<br />

CONCLUSION<br />

This study has shown the results <strong>of</strong> benchmarking<br />

outcomes in a specific client group. The analysis <strong>of</strong><br />

the TOM data to answer the study questions has<br />

highlighted similarities and differences between SLT<br />

Services. The benchmarking process enabled the<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, 2005


THERAPY OUTCOME MEASURE 121<br />

TABLE 5. Summary <strong>of</strong> Median TOM Ratings by Reason for Discharge Code<br />

Discharge code and number<br />

Disability/<br />

<strong>of</strong> cases Number Percentage Impairment*** Activity*** Participation*** Well-being***<br />

Remains on caseload 3 2% 4 4 4 4.5<br />

Treatment complete 151 83% 4.5 4.5 5 5<br />

Self-discharge 10 5% 3.5 4 4.5 4<br />

Transfer 4 2% 4.3 4 4 4.3<br />

Unlikely to reach potential 4 2% 2.3 3.0 4.3 4.5<br />

Did not attend 10 5% 3.5 3.8 4.3 4.3<br />

Other 1 0.5% 3 3 2 3<br />

All cases 183 100% 4.5 4.5 5 5<br />

***p 0.001.<br />

TABLE 6. Mean Contacts and Duration <strong>of</strong> Treatment<br />

for All Cases and by Service<br />

Duration <strong>of</strong><br />

Service and cases Statistic Contacts* therapy***<br />

A Mean 6.6 4.7<br />

n 5 SD 3.6 0.6<br />

B Mean 5.5 7.9<br />

n 48 SD 3.5 5.7<br />

C Mean 5.9 3.8<br />

n 29 SD 4.0 3.6<br />

D Mean 4.6 3.2<br />

n 23 SD 2.6 2.1<br />

E Mean 6.0 4.0<br />

n 4 SD 1.4 2.1<br />

F Mean 5.4 4.5<br />

n 43 SD 2.7 3.2<br />

G Mean 8.0 4.1<br />

n 31 SD 5.7 4.0<br />

All cases Mean 5.9 5.0<br />

n 183 SD 3.9 4.4<br />

*p 0.01.<br />

***p 0.001.<br />

participating SLTs to compare their data with that<br />

<strong>of</strong> the overall benchmark for all patients and then<br />

to compare this with other services to identify<br />

best performance.<br />

A future benchmarking study would aim to complete<br />

the benchmarking process by investigating<br />

how the information was used to effect change and<br />

link the process <strong>of</strong> care to that <strong>of</strong> outcomes. Ideally,<br />

this benchmarking process would be repeated once<br />

changes have been effected to identify whether better<br />

outcomes resulted. Benchmarking has the potential<br />

to inform SLTs on aspects <strong>of</strong> their practice and performance<br />

by using those tools in routine clinical<br />

practice. This can help SLTs to build a picture <strong>of</strong><br />

performance and engender change for quality<br />

improvement.<br />

REFERENCES<br />

1. Secretary <strong>of</strong> State for Health. The New NHS, Modern, Dependable.<br />

London, UK: HMSO; 1997.<br />

2. Secretary <strong>of</strong> State for Health. A First Class Service, Quality<br />

in the New NHS. London, U.K.: HMSO; 1998.<br />

3. Swage T. Clinical Governance in Healthcare Practice.<br />

Oxford, U.K.: Butterworth & Heinemann; 2000.<br />

4. Bullivant J. (1996) Benchmarking in the UK NHS. Int. J<br />

Health Care Quality Assurance. 1996;9:9–14.<br />

5. Bullivant J, Roberts A. Service benchmarking: to choose<br />

to improve. Health Service Manager (Special Report no.<br />

14). Kingston upon Thames, U.K.: Croner Publications<br />

Ltd; 1997.<br />

6. MacDonald J, Tanner S. Understanding Benchmarking.<br />

London, U.K.: Hodder & Stoughton; 1998.<br />

7. Johnson J. Making self-regulation credible through benchmarking,<br />

peer review, appraisal and management. Brit Med<br />

J. 1998;316:1847–1848.<br />

8. Franklin R. When Will the Penny Drop-the State <strong>of</strong> Benchmarking<br />

in the NHS? Manchester: McClean Jones McCarthy<br />

Ltd; 1995: 1–12.<br />

9. Higgins I. Benchmarking in health care: a review <strong>of</strong> the<br />

literature. Australian Health Rev. 1997;20:60–68.<br />

10. Ellis J. Sharing the evidence: clinical practice benchmarking<br />

to improve continuously the quality <strong>of</strong> care. J Adv<br />

Nursing. 2000;32:215–225.<br />

11. Yaruss J, La Salle L, Conture E. Evaluating stuttering in<br />

young children: diagnostic data. Amer J Speech-Lang Pathol.<br />

1998;7:62–76.<br />

12. Hunt J, Slater A. From start to outcome—and beyond.<br />

Speech Lang <strong>Therapy</strong> Practice. 1999;Autumn:4–6.<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, 2005


122<br />

ALEXANDRA JOHN ET AL<br />

13. Enderby P. Outcome measures in speech therapy: impairment,<br />

disability, handicap, and distress. Health Trends.<br />

1992;24:61–64.<br />

14. Enderby P, John A. <strong>Therapy</strong> Outcome Measures: Speech-<br />

Language Pathology. San Diego, CA: Singular Publishing<br />

Group, Inc.; 1997.<br />

15. World Health Organisation. International Classification <strong>of</strong><br />

Impairments, Disabilities, and Handicaps (ICIDH).<br />

Geneva, Switzerland: WHO; 1980.<br />

16. John A. <strong>Therapy</strong> Outcome Measures for Benchmarking in<br />

Speech and Language Theraphy. PhD dissertation (unpublished).<br />

University <strong>of</strong> Sheffield; 2001.<br />

17. Ramig LO, Verdolini K. Treatment efficacy: voice disorders.<br />

J Speech Lang Hear Res. 1998;41:101–116.<br />

18. Pannbacker M. <strong>Voice</strong> treatment techniques: a review and<br />

recommendations for outcome studies. Am J Speech Lang<br />

Pathol. 1998;7:49–64.<br />

19. Carding P, Horsley I, Docherty G. A study <strong>of</strong> the effectiveness<br />

<strong>of</strong> voice therapy in the treatment <strong>of</strong> 45 patients with<br />

non-organic dysphonia. J <strong>Voice</strong>. 1999;13:72–104.<br />

20. Verdolini K, Ramig LO, Jacobson B. Outcome measurement<br />

in voice disorders. In: Frattali CM, editor. Measuring<br />

<strong>Outcomes</strong> in Speech-Language Pathology, New York and<br />

Stuttgart: Thieme; 1998. p. 354–386.<br />

21. Enderby P, Emerson J. Does Speech and Language <strong>Therapy</strong><br />

Work? London, U.K.: Whurr Publishers Ltd.; 1995.<br />

APPENDIX: DYSPHONIA<br />

Identify descriptor that is “best fit.” The patient does not have to have each feature mentioned. Use 0.5<br />

to indicate if patient is slightly better or worse than a descriptor.<br />

Impairment (as appropriate to age)<br />

0 Severe persistent aphonia. Unable to phonate. Does not phonate.<br />

1 Consistent dysphonia. Occasional phonation. May be dysphonic with aphonic episodes.<br />

2 Moderate dysphonia. Can phonate but frequent episodes <strong>of</strong> marked vocal impairment occurring.<br />

3 Moderate/mild dysphonia. Less frequent episodes <strong>of</strong> dysphonia (eg occurs some time each day/or<br />

slight persistent "huskiness").<br />

4 Mild dysphonia. Occasional episodes <strong>of</strong> dysphonia occurring (eg on a weekly basis or less).<br />

5 No dysphonia. Appropriate/modal voice consistently used.<br />

Activity/Disability (as appropriate to age)<br />

0 <strong>Voice</strong> production is completely ineffective/inappropriate in all situations.<br />

1 <strong>Voice</strong> production is completely ineffective/inappropriate in most situations except occasionally with<br />

familiar listeners or modified environments.<br />

2 <strong>Voice</strong> production is effective/appropriate in modified environments (e.g. quiet situations, familiar<br />

situations).<br />

3 <strong>Voice</strong> production is effective/appropriate but can be unpredictable in some situations. <strong>Voice</strong> production<br />

requires less personal attention and effort in most situations.<br />

4 <strong>Voice</strong> production is effective/appropriate on most occasions. Rarely effortful. Very occasional difficulties<br />

experienced.<br />

5 <strong>Voice</strong> production is spontaneously effective and appropriate.<br />

Participation/Handicap (as appropriate to age)<br />

0 Unable to fulfil any social/educational/family role. Not involved in decision making/no autonomy/no<br />

control over environment. No social integration.<br />

1 Low self-confidence/poor self-esteem/limited social integration/socially isolated/contributes to some<br />

basic and limited decisions. Cannot achieve potential in any situation.<br />

2 Some self-confidence/some social integration/makes some decisions and influences control in familiar<br />

situations.<br />

3 Some self-confidence, autonomy emerging. Makes decisions and has control <strong>of</strong> some aspects <strong>of</strong> life.<br />

Able to achieve some limited social integration/educational activities. Diffident over control over<br />

life. Needs encouragement to achieve potential.<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, 2005


THERAPY OUTCOME MEASURE 123<br />

4 Mostly confident, occasional difficulties integrating or in fulfilling social/role activity. Participating in<br />

all appropriate decisions. May have difficulty in achieving potential in some situations occasionally.<br />

5 Achieving potential, autonomous and unrestricted. Able to fulfil social, educational, and family role.<br />

Well-being/Distress (as appropriate to age)<br />

0 Severe constant: upset/frustration/anger/distress/embarrassment/concern/withdrawal.<br />

1 Frequently severe: upset/frustration/anger/distress/embarrassment/concern/withdrawal.<br />

2 Moderate consistent: upset/frustration/anger/distress/embarrassment/concern/withdrawal.<br />

3 Moderate frequent: upset/frustration/anger/distress/embarrassment/concern/withdrawal.<br />

4 Mild occasional: upset/frustration/anger/distress/embarrassment/concern/withdrawal.<br />

5 No inappropriate: upset/frustration/anger/distress/embarrassment/concern/withdrawal.<br />

Journal <strong>of</strong> <strong>Voice</strong>, Vol. 19, No. 1, 2005

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!