08.01.2014 Views

Introduction to HCAHPS Survey Training Welcome!

Introduction to HCAHPS Survey Training Welcome!

Introduction to HCAHPS Survey Training Welcome!

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong><br />

<strong>Survey</strong> <strong>Training</strong><br />

January 2008<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Welcome</strong>!<br />

In the <strong>HCAHPS</strong> training sessions, we will:<br />

• Explain purpose and use of <strong>HCAHPS</strong> survey<br />

• Provide instruction on managing the survey<br />

• Discuss modes of survey administration<br />

• Instruct on sampling, data preparation, data<br />

submission and public reporting<br />

January 2008<br />

2


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Session I<br />

January 2008<br />

3<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Background and Development<br />

of the <strong>HCAHPS</strong> <strong>Survey</strong><br />

January 2008<br />

4


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Overview of Presentation<br />

• Background & Development of <strong>HCAHPS</strong><br />

• Composition of the <strong>Survey</strong><br />

• Public Reporting of <strong>HCAHPS</strong> Results<br />

• Roles and Responsibilities<br />

• Oversight and Compliance<br />

• How <strong>to</strong> Join <strong>HCAHPS</strong> in 2008<br />

January 2008<br />

5<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

The Name of the <strong>Survey</strong><br />

• Formal name: CAHPS ® Hospital <strong>Survey</strong><br />

• Also known as:<br />

– Hospital CAHPS ® or<br />

– <strong>HCAHPS</strong><br />

• Pronounced “H-caps”<br />

CAHPS ® is a registered trademark of the Agency for Healthcare Research and Quality,<br />

a U.S. Government agency.<br />

January 2008<br />

6


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

The Method of <strong>HCAHPS</strong><br />

• Ask patients (survey)<br />

• Collect in standardized, consistent manner<br />

• Analyze and adjust data<br />

• Publicly report hospital results<br />

• Use <strong>to</strong> improve hospital quality of care<br />

January 2008<br />

7<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Recent & Upcoming <strong>HCAHPS</strong> Miles<strong>to</strong>nes<br />

Oct. 2006:<br />

July 2007:<br />

National Implementation begins<br />

Participation linked <strong>to</strong> Annual<br />

Payment Update (APU) for FY2008+<br />

- RHQDAPU-eligible “subsection (d) hospitals”<br />

Jan.–Feb. 2008:Preview period for first public reporting<br />

Late March:<br />

April 9:<br />

First public reporting of results<br />

Submission deadline for<br />

Oct.-Dec. 2007 discharges<br />

January 2008<br />

8


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

New Era, New Challenges<br />

• Bold initiative, evolving scope<br />

• Appreciate cooperation, patience, and<br />

feedback from hospitals & survey vendors<br />

• Common goal: Continuously improve<br />

hospital quality of care<br />

January 2008<br />

9<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Objectives of <strong>HCAHPS</strong><br />

• Standardized survey for meaningful<br />

comparisons across hospitals for public<br />

reporting<br />

• Increased hospital accountability and<br />

incentives for quality improvement<br />

• Enhanced public accountability<br />

January 2008<br />

10


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> and the HQA<br />

• Implementation through national<br />

Hospital Quality Alliance (HQA)<br />

– Public-private partnership on hospital quality reporting<br />

– Members include: AHA, FAH, AAMC, JCAHO, AMA, ANA,<br />

AARP, AFL-CIO, AHRQ & CMS<br />

• Currently reporting heart attack, heart failure,<br />

pneumonia care, surgical infection and mortality<br />

January 2008<br />

11<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

CAHPS Family of <strong>Survey</strong>s<br />

Consumer Assessment of Healthcare Providers & Systems:<br />

January 2008<br />

- <strong>HCAHPS</strong><br />

- Home Health CAHPS<br />

- Health Plan CAHPS<br />

- Ambula<strong>to</strong>ry CAHPS<br />

- ESRD CAHPS<br />

- Nursing Home CAHPS<br />

- Prescription Drug Plan CAHPS<br />

- ECHO<br />

12


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> 101<br />

• IPPS and CAH hospitals<br />

– “General Hospitals” (AHA)<br />

• Eligible patients<br />

– Adult<br />

– Medical, surgical or maternity care<br />

– Overnight stay, or longer<br />

– Alive at discharge<br />

• <strong>Survey</strong> after discharge<br />

– Four modes of survey administration<br />

– Standardized pro<strong>to</strong>col<br />

January 2008<br />

13<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Making <strong>HCAHPS</strong> Credible<br />

• Issue call for measures (2002)<br />

• Review of literature (2002)<br />

• Cognitive testing in English and Spanish (2003)<br />

• Conduct Three-State Pilot Test (2003)<br />

• Conduct pilot test in Connecticut (2004)<br />

• Additional testing in voluntary test sites (2004-05)<br />

January 2008<br />

14


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Making <strong>HCAHPS</strong> Credible<br />

(cont’d)<br />

• NQF endorsement (May 2005)<br />

– “National voluntary consensus standard ”<br />

• Abt Associates’ cost-benefit analysis<br />

(Oc<strong>to</strong>ber 2005)<br />

– For cost information<br />

• Final approval from federal Office of<br />

Management and Budget (December 2005)<br />

January 2008<br />

15<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Making <strong>HCAHPS</strong> Useful<br />

• Qualitative research with consumers<br />

– Focus groups of hospital patients (2004)<br />

• Consumer testing of publicly reported<br />

<strong>HCAHPS</strong> results<br />

– “Look” on Hospital Compare website<br />

– Integration with existing measures<br />

– Ongoing<br />

January 2008<br />

16


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Making <strong>HCAHPS</strong> Practical<br />

• Hold stakeholder meetings<br />

• Presentations <strong>to</strong> interested groups<br />

• Meet with survey vendors<br />

•Web chats<br />

• Testing opportunities for hospitals, survey<br />

vendors<br />

• Solicit public comments<br />

January 2008<br />

17<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Making <strong>HCAHPS</strong> Practical<br />

(cont’d)<br />

• Hospital/vendor training and continuing support<br />

–Website (www.hcahpsonline.org)<br />

– <strong>HCAHPS</strong> Hotline (1-888-884-4007)<br />

• Compatibility with existing surveys<br />

• Flexibility in administration<br />

• Standardized survey<br />

• Centralized collection, reporting and oversight<br />

January 2008<br />

18


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Making <strong>HCAHPS</strong> Transparent<br />

• Several Federal Register notices and<br />

public comment periods<br />

• Review by National Quality Forum<br />

(2004-2005)<br />

– Final report at www.qualityforum.org<br />

• Review and endorsement by HQA<br />

January 2008<br />

19<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Making <strong>HCAHPS</strong> Pluralistic<br />

• Various models, interests, viewpoints<br />

– Much attention and input from beginning<br />

• Accommodated <strong>to</strong> extent possible<br />

– While adhering <strong>to</strong> goals of <strong>HCAHPS</strong><br />

January 2008<br />

20


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Composition of <strong>Survey</strong><br />

<strong>HCAHPS</strong> contains 27 items:<br />

• Items 1-22: Core of <strong>HCAHPS</strong><br />

– Put first; do not alter; keep <strong>to</strong>gether<br />

• 18 substantive questions<br />

• 4 “screener” items<br />

• Items 23-27: Demographic (“About You”)<br />

– Place later; do not alter<br />

January 2008<br />

21<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Six Composites<br />

What patients/consumers want <strong>to</strong> know:<br />

1. Communication with nurses<br />

2. Communication with doc<strong>to</strong>rs<br />

3. Responsiveness of hospital staff<br />

4. Pain management<br />

5. Communication about medicines<br />

6. Discharge information<br />

January 2008<br />

22


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Individual Items<br />

What patients/consumers want <strong>to</strong> know:<br />

1. Cleanliness of hospital environment<br />

2. Quietness of hospital environment<br />

January 2008<br />

23<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Global Ratings<br />

• ‘Overall rating of hospital’<br />

• 0 <strong>to</strong> 10 scale<br />

• ‘Recommend this hospital’<br />

• Four point scale<br />

January 2008<br />

24


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Core Items (1-22)<br />

Core <strong>HCAHPS</strong> items form module:<br />

• Can be followed by hospital-specific items<br />

in an integrated format<br />

—or —<br />

• Entire <strong>HCAHPS</strong> can be used as stand-alone<br />

questionnaire<br />

January 2008<br />

25<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Patient-Mix Adjus<strong>to</strong>rs<br />

• Service line (medical, surgical, maternity care)<br />

• Age<br />

• Education<br />

• Self-reported general health status<br />

• Language other than English spoken at home<br />

• Admission from Emergency Room<br />

• Lag time between discharge and survey completion<br />

January 2008<br />

26


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Public Reporting<br />

• Only <strong>HCAHPS</strong> items submitted and reported<br />

• Report hospital-level statistics that summarize responses <strong>to</strong><br />

<strong>HCAHPS</strong> items<br />

– All patient data is de-identified<br />

– On Hospital Compare website<br />

• Adjustment <strong>to</strong> achieve comparability of data<br />

– Patient-mix<br />

• Race and ethnicity items NOT used for patient-mix adjustment<br />

– Mode effects<br />

• Report available on www.hcahpsonline.org<br />

• Suppression of public reporting permitted in 2008<br />

– During public reporting Preview Period (Jan. 17 – Feb. 15)<br />

January 2008<br />

27<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Public Reporting Periods &<br />

Display<br />

• Public reporting periods are based on 12<br />

months of discharges<br />

– Rolling quarters<br />

– First public reporting (March 2008) based on 9<br />

months:<br />

• Oc<strong>to</strong>ber 2006 <strong>to</strong> June 2007<br />

– Public reporting display of <strong>HCAHPS</strong> results will<br />

include “bar graph” and “data table”<br />

January 2008<br />

28


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

“Drill-down” data table on Hospital Compare<br />

DRAFT – JANUARY 2008 (Fictitious hospitals & data)<br />

Hospital A<br />

Hospital B<br />

Hospital AC<br />

January 2008<br />

DRAFT<br />

29<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Footnote 6<br />

When the number of surveys the hospital provides <strong>to</strong> CMS is less<br />

than 100, the data table will show footnote 6; under the table,<br />

Footnote 6 will read:<br />

“Fewer than 100 patients completed the <strong>HCAHPS</strong><br />

survey. Use these rates with caution, as the<br />

number of surveys may be <strong>to</strong>o low <strong>to</strong> reliably<br />

assess hospital performance."<br />

The space in the bar graph for the measure will read:<br />

"Fewer than 100 patients completed the <strong>HCAHPS</strong><br />

survey for this hospital. For more information,<br />

click here.”<br />

January 2008<br />

30


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Footnote 7<br />

When CMS opts <strong>to</strong> display <strong>HCAHPS</strong> results calculated on fewer than<br />

the required months of data, the rate in the data table will show<br />

footnote 7; under the table, Footnote 7 will read:<br />

"This displays less than 9 months of accurate<br />

data.”<br />

• The bar graph will show the data without any notes<br />

− For March 2008 public reporting, the maximum and required number<br />

of months of data is 9<br />

• In subsequent public reporting periods, 12 months of data will be<br />

required and Footnote 7 will read, "This displays less than 12<br />

months of accurate data.”<br />

January 2008<br />

31<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Footnote 8<br />

• When a hospital has other data on Hospital<br />

Compare but did not participate in <strong>HCAHPS</strong>,<br />

• Or does not have enough months of <strong>HCAHPS</strong> data<br />

for public reporting purposes,<br />

• Or chose <strong>to</strong> suppress its <strong>HCAHPS</strong> results,<br />

Then Footnote 8 will appear in the bar graph and<br />

under the data table:<br />

“<strong>Survey</strong> results are not available for<br />

this reporting period.”<br />

January 2008<br />

32


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Footnote 9<br />

In rare instances in which a hospital has no<br />

patients eligible for the survey, the following<br />

footnote will be used in the bar graph and (as<br />

Footnote 9) under the data table:<br />

"No patients were eligible for the<br />

<strong>HCAHPS</strong> <strong>Survey</strong>”<br />

– Footnote 9 will not appear in the first <strong>HCAHPS</strong> public reporting<br />

January 2008<br />

33<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Roles and Responsibilities<br />

For hospitals using a survey vendor:<br />

Vendor’s role in data collection and submission<br />

– Develop sample frame of eligible discharges<br />

– Draw required sample of discharges<br />

– Administer survey<br />

– Submit <strong>HCAHPS</strong> data in standard format via QualityNet (QNet)<br />

Exchange<br />

– Moni<strong>to</strong>r submission reports<br />

– Moni<strong>to</strong>r <strong>HCAHPS</strong> website for updates<br />

January 2008<br />

34


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Roles and Responsibilities<br />

(cont’d)<br />

Self-administering hospital’s role in data<br />

collection and submission:<br />

– Develop sampling frame of eligible discharges<br />

– Draw required sample of discharges<br />

– Administer survey<br />

– Submit <strong>HCAHPS</strong> data in standard format via QualityNet (QNet)<br />

Exchange<br />

– Moni<strong>to</strong>r submission reports<br />

– Moni<strong>to</strong>r <strong>HCAHPS</strong> website for updates<br />

January 2008<br />

35<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Roles and Responsibilities<br />

(cont’d)<br />

All Hospitals’ role in Moni<strong>to</strong>ring:<br />

– Moni<strong>to</strong>r QualityNet Exchange feedback reports<br />

– Moni<strong>to</strong>r information from QIO<br />

– Moni<strong>to</strong>r/respond <strong>to</strong> your survey vendor<br />

• Ensure data gets <strong>to</strong> survey vendor on time<br />

– Moni<strong>to</strong>r <strong>HCAHPS</strong> website for updates<br />

January 2008<br />

36


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Roles and Responsibilities<br />

(cont’d)<br />

• Government Role: Support & Report<br />

– Provide training and technical assistance<br />

– Ensure integrity of data collection<br />

– Accumulate data from hospitals/survey vendors<br />

– Calculate and publicly report <strong>HCAHPS</strong> results<br />

January 2008<br />

37<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Oversight and Compliance<br />

As <strong>HCAHPS</strong> results play a greater<br />

role in hospital payment,<br />

the importance of compliance and<br />

oversight increase<br />

January 2008<br />

38


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Oversight<br />

July 1, 2007: Pay-for-Reporting Era began<br />

• Greater consequences for non-compliance<br />

• If a hospital (or its survey vendor) fails <strong>to</strong> adhere <strong>to</strong><br />

<strong>HCAHPS</strong> pro<strong>to</strong>cols, it must develop and implement a<br />

Corrective Action Plan (CAP)<br />

• If problems persist, the hospital may not qualify as<br />

meeting the APU requirements for <strong>HCAHPS</strong><br />

• This hospital’s APU may then be jeopardized<br />

January 2008<br />

39<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Oversight (cont’d)<br />

If survey vendor or selfadministering<br />

hospital does not<br />

fix persistent problems, it may<br />

lose its “approved” status for<br />

conducting <strong>HCAHPS</strong><br />

January 2008<br />

40


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Oversight (cont’d)<br />

A participating hospital should:<br />

• Work closely with its survey vendor (if using one)<br />

• Regularly moni<strong>to</strong>r QualityNet Exchange Feedback<br />

Reports<br />

• Read Quality Assurance Guidelines V3.0 and moni<strong>to</strong>r<br />

website for updates and announcements<br />

(www.hcahpsonline.org)<br />

• Comply with all <strong>HCAHPS</strong> oversight activities, as<br />

requested<br />

January 2008<br />

41<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Communicating with Patients<br />

about the <strong>HCAHPS</strong> <strong>Survey</strong><br />

• Hospital/<strong>Survey</strong> vendors are not allowed <strong>to</strong>:<br />

– Attempt <strong>to</strong> influence or encourage patients <strong>to</strong><br />

answer <strong>HCAHPS</strong> questions a particular way<br />

– Ask patients <strong>to</strong> explain why they didn’t rate a<br />

hospital with most favorable rating possible<br />

January 2008<br />

– Indicate the hospital’s goal is for all patients<br />

<strong>to</strong> rate them as an “Always” or other <strong>to</strong>p<br />

response<br />

42


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Advertising Guidelines<br />

•The Hospital Compare website is the<br />

official source of <strong>HCAHPS</strong> results<br />

•CMS does notendorse hospitals or survey<br />

vendors<br />

•The Hospital Compare website is intended<br />

<strong>to</strong> provide objective information <strong>to</strong> help<br />

consumers make informed decisions about<br />

health care providers<br />

January 2008<br />

43<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Non-Compliance<br />

with Program Requirements<br />

• Actions and possible penalties:<br />

– Hospitals/<strong>Survey</strong> vendors prepare written document<br />

within a specified time containing a root cause<br />

analysis and corrective actions for identified problems<br />

– <strong>Survey</strong> vendors’ names may be removed from CMS<br />

list of approved <strong>HCAHPS</strong> survey vendors<br />

– Hospitals’ data may not be reported on the Hospital<br />

Compare website<br />

– Hospitals’ data may not meet the <strong>HCAHPS</strong><br />

requirements for the Annual Payment Update<br />

January 2008<br />

44


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Steps <strong>to</strong> Join <strong>HCAHPS</strong> in 2008<br />

1. Submit <strong>HCAHPS</strong> Participation Form<br />

• For self-administering hospitals, hospitals administering survey<br />

for multiple sites and survey vendors<br />

• Form available ~Jan. 30 (online)<br />

2. Do a <strong>HCAHPS</strong> Dry Run<br />

• Voluntary in 2008, but strongly suggested<br />

• Last month in calendar quarter<br />

• Contact <strong>HCAHPS</strong> Project Team for details<br />

− <strong>HCAHPS</strong>@azqio.sdps.org<br />

3. Collect and submit <strong>HCAHPS</strong> survey data<br />

on continuous basis<br />

January 2008<br />

45<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

More information on <strong>HCAHPS</strong><br />

• Background and reports on <strong>HCAHPS</strong>:<br />

www.cms.hhs.gov/HospitalQualityInits<br />

• Registration, applications and updates:<br />

www.hcahpsonline.org<br />

• Submitting <strong>HCAHPS</strong> data:<br />

www.qualitynet.org<br />

• Publicly reported <strong>HCAHPS</strong> results:<br />

www.hospitalcompare.hhs.gov<br />

January 2008<br />

46


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Questions?<br />

January 2008<br />

47<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong><br />

Participation and Program<br />

Requirements<br />

January 2008<br />

48


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Participation Overview<br />

• <strong>HCAHPS</strong> Website and Technical Assistance<br />

• Rules of Participation<br />

– Step 1: <strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

– Step 2: Program Participation Form<br />

– Step 3: QualityNet Exchange Registration<br />

– Step 4: Data collection (voluntary dry run)<br />

– Step 5: Update <strong>Training</strong><br />

– Step 6: Participate in Oversight Activities<br />

– Step 7: Public Reporting<br />

• Minimum Requirements<br />

• Exceptions Request/Discrepancy Report<br />

January 2008<br />

49<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Website and Technical Support<br />

www.hcahpsonline.org<br />

• Official website for content, announcements, updates,<br />

reminders<br />

• Moni<strong>to</strong>r weekly for “What’s New”<br />

• Quick links <strong>to</strong> Current News, Background, Participation,<br />

etc.<br />

January 2008<br />

50


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>HCAHPS</strong> Website and<br />

Technical Support<br />

– Website: www.hcahpsonline.org<br />

– E-mail: hcahps@azqio.sdps.org<br />

– Telephone: 1-888-884-4007<br />

January 2008<br />

51<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Step 1: <strong>Introduction</strong> <strong>to</strong><br />

<strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

• Who is required <strong>to</strong> attend?<br />

– <strong>Survey</strong> Vendors<br />

– Hospitals conducting <strong>HCAHPS</strong> for multiple sites<br />

– Hospitals self-administering <strong>HCAHPS</strong><br />

• Who is recommended <strong>to</strong> attend?<br />

– Hospitals contracting with a survey vendor or another<br />

hospital for survey administration<br />

– Quality Improvement Organizations (QIOs)<br />

January 2008<br />

52


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Step 2: Program<br />

Participation Form<br />

• Available online at www.hcahpsonline.org<br />

• Includes Rules of Participation<br />

• Complete Exceptions Request Form if applicable<br />

• Who needs <strong>to</strong> submit a Participation Form?<br />

– Hospitals self-administering <strong>HCAHPS</strong><br />

– Hospitals conducting <strong>HCAHPS</strong> for multiple sites<br />

– <strong>Survey</strong> vendors (administering on behalf of hospitals)<br />

– Not required for hospitals contracting with survey<br />

vendor<br />

January 2008<br />

53<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Step 3: QualityNet Exchange<br />

Registration<br />

• Contact:<br />

– State QIO (hospitals)<br />

– <strong>HCAHPS</strong> Information and Technical Support<br />

(survey vendors)<br />

• If already registered with QualityNet, register<br />

specifically for <strong>HCAHPS</strong> and obtain necessary roles<br />

• Contact QualityNet Help Desk for questions on how<br />

<strong>to</strong> complete the forms at:<br />

qnetsupport@ifmc.sdps.org<br />

January 2008<br />

54


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Step 4: Data Collection<br />

• Hospitals/<strong>Survey</strong> vendors will:<br />

– Adhere <strong>to</strong> the Quality Assurance Guidelines V3.0<br />

– Submit an Exceptions Request Form for approval for<br />

any variations in survey administration<br />

– Review the accuracy of their data collection processes<br />

– Alert <strong>HCAHPS</strong> Project Team <strong>to</strong> any discrepancies<br />

occurring during survey administration<br />

– Submit data by submission deadline<br />

January 2008<br />

55<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

• Dry run<br />

Step 4: Data Collection<br />

(cont’d)<br />

– Participation in a dry run is voluntary for<br />

2008<br />

• Strongly suggested<br />

• Last month in calendar quarter<br />

• Contact the <strong>HCAHPS</strong> Project Team for details<br />

–<strong>HCAHPS</strong>@azqio.sdps.org<br />

January 2008<br />

56


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Step 5: Future Update <strong>Training</strong>s<br />

• As scheduled by CMS<br />

• Details <strong>to</strong> be posted on www.hcahpsonline.org<br />

• Required for all approved survey vendors, hospitals<br />

conducting survey for multiple sites, and selfadministering<br />

hospitals<br />

• Recommended for hospitals using a survey vendor<br />

• Recommended for Quality Improvement<br />

Organizations<br />

January 2008<br />

57<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Step 6: Participate in<br />

Oversight Activities<br />

• Submit <strong>HCAHPS</strong> Quality Assurance Plan<br />

• Comply with on-site visit requests<br />

• Comply with conference call requests<br />

• Implement corrective action plan, if necessary<br />

January 2008<br />

58


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Step 7: Public Reporting<br />

• <strong>HCAHPS</strong> results will be publicly reported on<br />

a quarterly basis on Hospital Compare<br />

website<br />

January 2008<br />

59<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Minimum Requirements<br />

1. Relevant survey experience<br />

– Demonstrated experience in fielding surveys<br />

using requested mode(s) of administration<br />

• <strong>Survey</strong> experience<br />

• Number of years in business<br />

• Number of years conducting surveys<br />

January 2008<br />

60


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Minimum Requirements<br />

(cont’d)<br />

2. Organizational/survey capacity<br />

– Capability and capacity <strong>to</strong> handle a<br />

required volume of surveys and conduct<br />

surveys in specified time frame<br />

• Personnel<br />

• System resources<br />

• <strong>Survey</strong> administration<br />

• Data submission<br />

• Technical assistance/cus<strong>to</strong>mer support<br />

January 2008<br />

61<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Minimum Requirements<br />

(cont’d)<br />

3. Quality control procedures<br />

– Personnel training and quality control<br />

mechanisms<br />

• Demonstrated quality control procedures<br />

January 2008<br />

62


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Exceptions Request<br />

Discrepancy Report<br />

• Exceptions Request<br />

– Request alternative methodologies<br />

• Discrepancy Report<br />

– Notification of variation from pro<strong>to</strong>cols<br />

during survey administration<br />

January 2008<br />

63<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Exceptions Request<br />

• Allowable exceptions <strong>to</strong> standard pro<strong>to</strong>cols<br />

– Disproportionate stratified random sampling<br />

– Service line determination<br />

– Other exceptions<br />

• Exception request proposal demonstrates that<br />

approach will result in a minimum of 300<br />

completes in reporting period<br />

• Exceptions not allowed for modes of survey<br />

administration<br />

January 2008<br />

64


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Exceptions Request (cont’d)<br />

• Request for exceptions<br />

– Submit Exceptions Request Form(s)<br />

• Justification for exception<br />

• Submit Exceptions Request Form through www.hcahpsonline.org<br />

– Submit an exception request before planning <strong>to</strong><br />

implement<br />

– Exceptions may be submitted by hospitals or survey<br />

vendors on their behalf<br />

– <strong>Survey</strong> vendors may submit one Exceptions Request form<br />

on behalf of multiple hospitals as long as the hospitals are<br />

listed on the form<br />

January 2008<br />

65<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Exceptions Request (cont’d)<br />

• Appeals process for unapproved exception<br />

– Written notification with explanation provided<br />

by <strong>HCAHPS</strong> Project Team<br />

– Hospital/<strong>Survey</strong> vendor has five business days<br />

<strong>to</strong> appeal an unapproved exception<br />

– Use Exceptions Request Form<br />

January 2008<br />

66


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Discrepancy Report<br />

• Notification of inadvertent and temporary<br />

survey administration discrepancies<br />

– Examples: missing eligible discharges from a<br />

particular date or computer programming<br />

issues that caused an otherwise eligible<br />

discharge <strong>to</strong> be excluded from the sample<br />

frame<br />

January 2008<br />

67<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Discrepancy Report (cont’d)<br />

• Complete and submit report immediately<br />

upon discovery of issue<br />

– Provide sufficient detail<br />

• How issue was discovered<br />

• Number of eligible discharges affected<br />

• Corrective action plan<br />

• Other pertinent information<br />

January 2008<br />

68


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Discrepancy Report (cont’d)<br />

• Review Process<br />

– Assessment of actual or potential impact on<br />

publicly reported results<br />

– Formal review may be required<br />

January 2008<br />

69<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Questions?<br />

January 2008<br />

70


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

BREAK<br />

January 2008<br />

71<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Sampling Pro<strong>to</strong>col<br />

January 2008<br />

72


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Overview<br />

•Flow Chart<br />

•Population<br />

• Eligibility Criteria<br />

•Exclusions<br />

• Sample Frame<br />

• De-duplication<br />

• How <strong>to</strong> Draw a Sample<br />

• How <strong>to</strong> Calculate the Sample Size<br />

• Select Method of Sampling<br />

January 2008<br />

73<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Flow chart<br />

Population<br />

(All patient<br />

Discharges)<br />

Step 1<br />

Identify Eligible<br />

Patients<br />

Step 2<br />

All Eligible<br />

Patients<br />

January 2008<br />

Step 3<br />

Step 5<br />

Remove Excluded<br />

Sample Frame<br />

Calculate<br />

Sample Size<br />

De-Duplication<br />

Process<br />

Step 4<br />

Select random sample<br />

of patients using:<br />

SRS or PSRS or DSRS<br />

Sampling type<br />

Step 6<br />

74


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Population (step 1)<br />

(All Patient Discharges)<br />

• Patients of all payer types are eligible for sampling<br />

• Hospitals contracting with survey vendors are<br />

strongly encouraged <strong>to</strong> provide entire discharge list<br />

<strong>to</strong> their survey vendor<br />

January 2008<br />

75<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Eligibility Criteria (step 2)<br />

Who should be included in <strong>HCAHPS</strong>?<br />

• Adult Inpatients – 18 years or older<br />

• Hospital Admission – minimum one overnight<br />

stay, or longer<br />

• Alive at discharge<br />

January 2008<br />

76


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Eligibility Criteria (cont’d)<br />

• Non-Psychiatric MS-DRG/principal diagnosis at<br />

discharge<br />

Patient Classification Service Lines<br />

The hospital/survey vendor should use the principal discharge<br />

MS-DRG <strong>to</strong>…<br />

– Identify the eligible patients<br />

– Classify in<strong>to</strong> the Service Line as either:<br />

»Medical<br />

»Surgical<br />

»Maternity Care<br />

January 2008<br />

77<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Eligibility Criteria (cont’d)<br />

Service Line MS-DRG Crosswalk Table:<br />

• To classify in<strong>to</strong> Medical and Surgical service lines<br />

- The Federal Register Notice – (updated approximately twice<br />

per year)<br />

• To classify in<strong>to</strong> Maternity Care service line<br />

- Use MS-DRGs 765 – 768, 774, 775<br />

• Current table information<br />

- Quality Assurance Guidelines (Version 3.0)<br />

- www.hcahpsonline.org<br />

January 2008<br />

78


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Summary Facts<br />

• Hospitals without surgical or maternity care departments<br />

may participate<br />

• Missing MS-DRG does not exclude patient from being<br />

sampled<br />

• If patient deemed ineligible prior <strong>to</strong> survey administration<br />

– do not administer survey<br />

• Hospitals not using MS-DRG codes must submit an<br />

Exceptions Request Form<br />

January 2008<br />

79<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Exclusions (step 3)<br />

Who should be excluded from <strong>HCAHPS</strong>?<br />

• “No Publicity” patients<br />

• Court/Law enforcement<br />

• Foreign home address<br />

• Discharged <strong>to</strong> hospice care<br />

• Excluded as a result of state regulation<br />

• Do not exclude patients if their eligibility is<br />

uncertain (i.e. missing information)<br />

• Hospitals or survey vendors must retain<br />

documentation that verifies all ineligible/excluded<br />

patients<br />

January 2008<br />

80


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Sample Frame<br />

• Include all patients:<br />

– Who meet eligible population criteria<br />

– Discharged between first and last days of<br />

month<br />

• Include patients even if:<br />

– Missing or incomplete address/telephone<br />

numbers<br />

– Missing eligibility criteria<br />

January 2008<br />

81<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Sample Frame (cont’d)<br />

• Sample frame file layout example<br />

– Appendix P -Quality Assurance Guidelines<br />

– Not required <strong>to</strong> use this exact layout<br />

• De-duplicate within each month<br />

• Remove patient-identifying information<br />

before submitting the data <strong>to</strong> CMS via<br />

QualityNet Exchange<br />

January 2008<br />

82


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

De-duplicating (step 4)<br />

• De-duplication by Household<br />

– Sample only one patient per household in a<br />

given month<br />

• De-duplicate addresses from medical records and<br />

patient unique IDs within each month<br />

• Do not de-duplicate addresses for nursing homes,<br />

long-term care facilities, etc., unless residents are<br />

family members<br />

January 2008<br />

83<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

De-duplicating (cont’d)<br />

• De-duplication by Multiple Discharges<br />

– Sample patient only once in a given month<br />

• For continuous sampling, use the first discharge<br />

for a patient closest <strong>to</strong> when the sample is pulled<br />

• For end of the month sampling, de-duplicate<br />

across all discharges in the month and use only<br />

the last discharge<br />

Patients are eligible <strong>to</strong> be included in the sample<br />

in consecutive months.<br />

January 2008<br />

84


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

How <strong>to</strong> Draw the Sample<br />

• Target: Obtain at least 300 completed <strong>HCAHPS</strong><br />

surveys over the 12-month public reporting<br />

period<br />

– Small hospitals<br />

•If canno<strong>to</strong>btain 300 completed surveys, sample<br />

all eligible discharges<br />

• Complete as many surveys as possible<br />

January 2008<br />

85<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

How <strong>to</strong> Draw the Sample<br />

(cont’d)<br />

• Why 300?<br />

– Target for the statistical precision of the ratings<br />

which is based on a reliability criterion<br />

– 300 completes ensures that the reliability for the<br />

global ratings and composites will be .80 or<br />

higher<br />

– All hospitals must calculate sample size based on<br />

at least 300 completes no matter the number of<br />

discharges<br />

January 2008<br />

86


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

How <strong>to</strong> Draw the Sample<br />

(cont’d)<br />

• Draw a random sample of eligible discharges on<br />

a monthly basis<br />

– Sampling may be continuous or at the end of the<br />

month<br />

• Continuous – every two days, each week, every two<br />

weeks, etc.<br />

– Same sampling ratio or timeframe maintained<br />

• End of month – one sample is drawn following last day<br />

of the month<br />

– Sample represents entire month of discharges<br />

January 2008<br />

87<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

How <strong>to</strong> Draw the Sample<br />

(cont’d)<br />

• Same sampling type must be maintained<br />

throughout the quarter<br />

• Sample must include discharges from each<br />

month in the 12-month reporting period<br />

• <strong>HCAHPS</strong> random sample drawn first if multiple<br />

surveys administered<br />

• Do not s<strong>to</strong>p sampling/surveying if 300 completes<br />

attained<br />

January 2008<br />

88


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

How <strong>to</strong> Draw the Sample<br />

(cont’d)<br />

• Hospitals that share a Medicare Provider<br />

Number (MPN)<br />

– 300 completes are required per MPN<br />

– All hospitals under one MPN must participate<br />

– Use same survey vendor<br />

– Use same mode of administration<br />

– Use same sample type and frequency<br />

January 2008<br />

89<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

How <strong>to</strong> Calculate the Sample size<br />

(Step 5)<br />

• Estimate the proportion of patients expected <strong>to</strong> complete the<br />

survey:<br />

I = proportion of discharged patients who are ineligible<br />

R = expected response rate among eligible patients<br />

P = the proportion of discharged patients who<br />

actually respond <strong>to</strong> the survey<br />

P = (1 - I) x R<br />

• How many discharges are needed <strong>to</strong> produce 300 completes?<br />

C/P = N 12 (Number of discharges <strong>to</strong> be sampled over 12 month<br />

period )<br />

N 12 /12 = N 1 (Number of discharges sampled each month)<br />

January 2008<br />

90


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Example: Sample Size<br />

Calculation<br />

Assumptions:<br />

• ≈17% of discharged patients will be ineligible for<br />

the survey<br />

– Source: National Hospital Discharge <strong>Survey</strong><br />

• ≈40% of eligible patients will respond <strong>to</strong> the<br />

survey<br />

– Source: CMS Three State Pilot<br />

• Ineligible rates and response rates should be<br />

adjusted based on each hospital’s experience<br />

January 2008<br />

91<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Example: Sample Size Calculation<br />

(cont’d)<br />

• Therefore,<br />

P = (1 - I) x R<br />

= (1 - .17) x .40<br />

= .33<br />

300 / P = 300 / .33 = 909 discharged patients should be surveyed<br />

• Twelve-month public reporting period:<br />

• Number of discharges needed per month<br />

= 909 / 12 = 76<br />

January 2008<br />

92


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

How <strong>to</strong> Calculate the Sample size<br />

(cont’d)<br />

• Should estimate I and R from hospital’s<br />

own data<br />

• Should adjust the target in subsequent<br />

quarters<br />

January 2008<br />

93<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

If More than 300 Completes:<br />

• Do not s<strong>to</strong>p surveying when a <strong>to</strong>tal of 300 is<br />

reached<br />

• Continue <strong>to</strong> survey every patient in the sample<br />

• <strong>Survey</strong>ing must continue even if predetermined<br />

target (quota) is met<br />

• Full pro<strong>to</strong>col for each mode of administration<br />

must be completed<br />

• Submit the entire sample<br />

January 2008<br />

94


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

If Less Than 300 Completes:<br />

• Attempt <strong>to</strong> obtain as many as possible<br />

• <strong>Survey</strong> all eligible discharges<br />

• All hospital results will be publicly reported on<br />

Hospital Compare website<br />

• If a hospital obtains less than 300 completed<br />

surveys during the reporting period<br />

– Lower precision of the ratings will be noted for less than<br />

100 completes<br />

January 2008<br />

95<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Select Method of Sampling<br />

(step 6)<br />

Simple Random sampling:<br />

• <strong>HCAHPS</strong> preferred sampling method<br />

• Group of patients randomly selected from a<br />

larger group<br />

• Census sample is considered a simple random<br />

sample<br />

January 2008<br />

96


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Select Method of Sampling<br />

(cont’d)<br />

Proportionate Stratified Random Sampling<br />

(PSRS):<br />

• Patient discharge population divided in<strong>to</strong> strata<br />

– Due <strong>to</strong> continuous sampling (by day, or week, etc.)<br />

– Divided by hospital unit, or floor, etc<br />

– Multiple hospitals share the same Medicare Provider Number (MPN)<br />

and the random sample is drawn separately from each hospital<br />

before each hospital’s data is combined<br />

• Same sampling ratio applied <strong>to</strong> each stratum<br />

• Exceptions Request Form not required<br />

January 2008<br />

97<br />

January 2008<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Select Method of Sampling (cont’d)<br />

Example of PSRS<br />

• Hospital pulls sample each week, creating 4 strata named wk1, wk2,<br />

wk3 and wk4<br />

• Even though the number of eligible discharges differs between<br />

weeks, the hospital takes the same proportion of ‘sampled’ <strong>to</strong><br />

‘eligibles’ each week.<br />

• 20% of eligible discharges are randomly pulled from each stratum<br />

Number of ‘eligibles’ per week X proportion of 20/100 or .2<br />

– Wk1 20 X .2 = 4 sampled<br />

– Wk2 25 X .2 = 5 sampled<br />

– Wk3 30 X .2 = 6 sampled<br />

– Wk4 15 X .2 = 3 sampled<br />

• Results in different number sampled from each week, but each<br />

eligible discharge had an equal chance of being chosen<br />

98


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Select Method of Sampling<br />

(cont’d)<br />

Disproportionate Stratified Random sampling<br />

(DSRS):<br />

Patient discharge population divided in<strong>to</strong> strata<br />

• Dissimilar sampling ratio applied <strong>to</strong> each stratum<br />

• Additional data collected<br />

• Sampling data will be used <strong>to</strong> weight monthly data<br />

• Exceptions Request Form required<br />

January 2008<br />

99<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Select Method of Sampling (cont’d)<br />

Example of DSRS<br />

• Hospital pulls a sample each month, creating four strata: Unit 1,<br />

Unit 2, Unit 3 and Unit 4<br />

• Ten eligible discharges are randomly pulled from each Unit<br />

• The number of eligible discharges selected for the sample does not<br />

result in the same proportion of discharges across the four units<br />

– Unit 1: 10 selected of 20 eligible = a proportion of 50%<br />

– Unit 2: 10 selected of 25 eligible = a proportion of 40%<br />

– Unit 3: 10 selected of 30 eligible = a proportion of 33%<br />

– Unit 4: 10 selected of 15 eligible = a proportion of 67%<br />

• DSRS sampling results in the same number of sampled patients<br />

from each unit, but the proportion (percentage) of the eligible<br />

discharges selected from each unit is different<br />

January 2008<br />

100


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Questions?<br />

January 2008<br />

101<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Administration<br />

Pro<strong>to</strong>col<br />

January 2008<br />

102


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Overview<br />

• <strong>Survey</strong> Instrument<br />

• Supplemental Questions<br />

• Options for <strong>Survey</strong> Integration<br />

• Modes of <strong>Survey</strong> Administration<br />

• Polling Question<br />

• <strong>Survey</strong> Management<br />

January 2008<br />

103<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Instrument<br />

• <strong>Survey</strong> content<br />

– Core <strong>Survey</strong> questions 1-22<br />

– “About You” questions 23-27<br />

• <strong>Survey</strong> instrument availability<br />

– English language survey (Appendix A)<br />

– Spanish language survey (Appendix D)<br />

– Chinese language survey (Appendix G)<br />

– English telephone script (Appendix K)<br />

– Spanish telephone script (Appendix L)<br />

– English IVR script (Appendix M)<br />

January 2008<br />

104


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Supplemental Questions<br />

• May add a reasonable number of supplemental questions<br />

<strong>to</strong> the survey after the core survey items (1-22)<br />

– Must ask the “About You” questions (23-27) following the core<br />

survey items but placement in the survey is at the discretion of<br />

the hospital/survey vendor<br />

• Use appropriate phrasing <strong>to</strong> transition from the <strong>HCAHPS</strong><br />

survey <strong>to</strong> the supplemental items<br />

– “Now we would like <strong>to</strong> gather some additional detail on <strong>to</strong>pics<br />

we have asked you about before. These items use a somewhat<br />

different way of asking for your response since they are getting<br />

at a little different way of thinking about <strong>to</strong>pics.”<br />

January 2008<br />

105<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Supplemental Questions<br />

(cont’d)<br />

• Recommend avoiding the following types<br />

of supplemental questions<br />

- Numerous, lengthy and complex questions<br />

- Questions with potential impact on responses<br />

<strong>to</strong> <strong>HCAHPS</strong> questions<br />

- Sensitive medical or personal <strong>to</strong>pics which<br />

may cause a person <strong>to</strong> terminate the survey<br />

- Questions that may jeopardize a patient’s<br />

confidentiality such as SSN<br />

January 2008<br />

106


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Three Options for Integration<br />

of Hospital <strong>Survey</strong>s<br />

1. Integrate hospital’s existing survey in<strong>to</strong> <strong>HCAHPS</strong><br />

survey using one consistent format and transitions<br />

– <strong>HCAHPS</strong> Items 1-22 (Core questions) are first<br />

questions<br />

– <strong>HCAHPS</strong> Items 23-27 (“About You” questions)<br />

2. Have a separate <strong>HCAHPS</strong> survey and hospital<br />

survey in the same mailing<br />

3. Send two separate mailings – one with the <strong>HCAHPS</strong><br />

survey and another with the hospital-specific<br />

survey<br />

January 2008<br />

107<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Modes of <strong>Survey</strong><br />

Administration<br />

• Mail Only<br />

• Telephone Only<br />

• Mixed (Mail with Telephone Follow-up)<br />

• Active Interactive Voice Response (IVR)<br />

January 2008<br />

108


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Modes of Administration<br />

Overview<br />

• Modes of administration designed <strong>to</strong> achieve, on average, a 40%<br />

response rate<br />

• No proxy respondents<br />

• No communication <strong>to</strong> patients that is intended <strong>to</strong> influence survey<br />

results<br />

• No incentives of any kind<br />

• Data collection begins within 48 hours <strong>to</strong> 6 weeks (42 days) after<br />

discharge<br />

• If a patient is found <strong>to</strong> be ineligible, discontinue survey<br />

administration for that patient<br />

• Final data files submitted <strong>to</strong> CMS via QualityNet Exchange by the<br />

data submission deadline<br />

January 2008<br />

109<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode<br />

• Pro<strong>to</strong>col<br />

- Send first questionnaire with initial cover letter <strong>to</strong><br />

sampled patient(s) between 48 hours and 6 weeks (42<br />

days) after discharge<br />

- Send second questionnaire with follow-up cover letter<br />

<strong>to</strong> non-respondent(s) approximately 21 days after the<br />

first questionnaire mailing<br />

- Complete data collection within 42 days after the first<br />

questionnaire mailing<br />

- Submit data <strong>to</strong> CMS via QualityNet Exchange by the<br />

data submission deadline<br />

January 2008<br />

110


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Cover letter specifications<br />

– Name and address of sampled patient included<br />

• “To Whom It May Concern” is not acceptable<br />

– OMB language included<br />

– Letter is not attached <strong>to</strong> the survey<br />

– Cus<strong>to</strong>mization is acceptable; cannot add content that<br />

would introduce bias<br />

January 2008<br />

111<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Cover letter language requirements:<br />

– Purpose of survey<br />

• “Questions 1-22 in the enclosed survey are part of a national<br />

initiative by the United States Department of Health and<br />

Human Services <strong>to</strong> measure the quality of care in hospitals.”<br />

– Answers may be shared with hospitals for the<br />

purposes of quality improvement<br />

– Participation is voluntary<br />

– Hospital name and discharge date of patient<br />

– Patient’s health benefits will not be affected by<br />

participation in the survey<br />

– Cus<strong>to</strong>mer support number<br />

January 2008<br />

112


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Cover letter requirements (cont’d):<br />

– OMB Paperwork Reduction Act language: “According <strong>to</strong> the<br />

Paperwork Reduction Act of 1995, no persons are required <strong>to</strong><br />

respond <strong>to</strong> a collection of information unless it displays a valid<br />

OMB control number. The valid OMB control number for this<br />

information collection is 0938-0981. The time required <strong>to</strong><br />

complete this information collected is estimated <strong>to</strong> average 7<br />

minutes per response for questions 1-22 on the survey, including<br />

the time <strong>to</strong> review instructions, search existing data resources,<br />

gather the data needed, and complete and review the<br />

information collection. If you have any comments concerning the<br />

accuracy of the time estimate(s) or suggestions for improving<br />

this form, please write <strong>to</strong>: Centers for Medicare & Medicaid<br />

Services, 7500 Security Boulevard, S1-13-05, Baltimore, MD<br />

21244-1850.”<br />

January 2008<br />

113<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Cover letter options:<br />

– Language about why there are two mailings in one<br />

envelope<br />

– Spanish and Chinese versions of cover letters<br />

– Language directing the patient how <strong>to</strong> request the<br />

mail survey in Spanish or Chinese<br />

– Repetition of any instructions that appear on the<br />

questionnaire<br />

– Name and return address of hospital/survey vendor<br />

January 2008<br />

114


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Questionnaire guidelines and formatting<br />

requirements<br />

- Question and answer category wording is not changed nor is<br />

the order of core <strong>HCAHPS</strong> questions (items 1-22)<br />

- “About You” questions follow the core <strong>HCAHPS</strong> questions<br />

- Question and answer categories remain <strong>to</strong>gether in the same<br />

columns and on the same pages<br />

- Randomly generated unique identifiers for patient tracking<br />

purposes are placed on the first or last page of the survey<br />

- All instructions on the <strong>to</strong>p of the survey are copied verbatim<br />

- The patient’s name is not printed on the survey<br />

- No matrix formats for question and answer categories<br />

- The OMB control number must appear on the front page of the<br />

survey or on the cover letter. It is OMB # 0938-0981<br />

January 2008<br />

115<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Questionnaire guidelines and<br />

formatting options<br />

– Small coding numbers next <strong>to</strong> response<br />

choices<br />

– Patient discharge date<br />

– Place for patients <strong>to</strong> voluntarily fill in their<br />

name/telephone number placed after the core<br />

<strong>HCAHPS</strong> questions (1-22)<br />

January 2008<br />

116


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Questionnaire guidelines and formatting<br />

suggestions<br />

– Minimum font size 10 point<br />

– Readable font such as Arial<br />

– Margins are wide (at least 3/4 inch) and survey has<br />

white space <strong>to</strong> enhance its readability<br />

– Question formatting in two columns<br />

– Name and return address of hospital/survey vendor<br />

January 2008<br />

117<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Guidelines for mailings<br />

– Addresses acquired from hospital record<br />

– Addresses updated using commercial software<br />

– Mailings sent <strong>to</strong> patients by name<br />

• Mailing content<br />

– <strong>Survey</strong> mailings include<br />

• Cover letter<br />

• Questionnaire(s)<br />

• Self-addressed, stamped business reply envelope<br />

• First class postage or indicia, suggested<br />

January 2008<br />

118


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Data receipt and entry<br />

– <strong>Survey</strong>s recorded in a timely manner<br />

– <strong>Survey</strong>s are date stamped<br />

– Ambiguous situations follow <strong>HCAHPS</strong> decision rules<br />

– Key-entry or scanning allowed for data entry<br />

• A sample of key-entered data is entered a second time<br />

by different staff and any discrepancies between the two<br />

entries are identified. Supervisors reconcile any<br />

discrepancies<br />

• Programs verify that record is unique and has not been<br />

returned already<br />

• Programs identify invalid or out-of-range responses<br />

January 2008<br />

119<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Data retention/s<strong>to</strong>rage guidelines<br />

– Paper questionnaires that are key-entered<br />

must be s<strong>to</strong>red in a secure and<br />

environmentally controlled location for a<br />

minimum of three years<br />

– Optically scanned questionnaire images must<br />

be retained in a secure manner for a<br />

minimum of three years<br />

January 2008<br />

120


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Quality control guidelines<br />

– Validate address information<br />

• National Change of Address (NCOA)<br />

• USPS CASS Certified Zip+4 software<br />

• Other commercial software/search engines<br />

– Check quality of printed materials<br />

– Check survey packet contents<br />

– Check a sample of mailings for inclusion<br />

of all sampled patients<br />

– Check for timeliness of manual or au<strong>to</strong>mated date<br />

stamping<br />

January 2008<br />

121<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mail Only Mode (cont’d)<br />

• Quality control guidelines (cont’d)<br />

– Oversight of staff and subcontrac<strong>to</strong>rs<br />

– Strongly recommend seeded mailings <strong>to</strong><br />

project staff<br />

• Timeliness and accuracy of delivery<br />

• Accuracy of mailing contents<br />

January 2008<br />

122


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Telephone Only Mode<br />

• Pro<strong>to</strong>col<br />

– Initiate systematic telephone contact with sampled<br />

patient(s) between 48 hours and 6 weeks (42 days)<br />

after discharge<br />

– Complete telephone sequence within 42 days of<br />

initiation so that a <strong>to</strong>tal of 5 telephone calls are<br />

attempted<br />

• at different times of day<br />

• on different days of the week<br />

• and in different weeks<br />

– Submit data <strong>to</strong> CMS via QualityNet Exchange by the<br />

data submission deadline<br />

January 2008<br />

123<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Telephone Only Mode (cont’d)<br />

• Telephone script<br />

– Standardized telephone script provided for<br />

<strong>HCAHPS</strong> portion of survey<br />

• Question and answer category wording may not be changed<br />

nor the order of questions for the <strong>HCAHPS</strong> core questions<br />

• “About You” questions 23-27 must be placed anywhere after<br />

the core survey questions 1-22<br />

• Supplemental questions may be added after the core survey<br />

questions 1-22<br />

• Transitional phrases should be added for supplemental<br />

questions<br />

January 2008<br />

124


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Telephone Only Mode (cont’d)<br />

• Interviewing systems<br />

– Electronic telephone interviewing, including CATI or<br />

other alternative systems (required of survey<br />

vendors and of hospitals conducting surveys for<br />

multiple sites)<br />

• Programmed with standardized <strong>HCAHPS</strong> telephone script<br />

– Manual data collection (allowed only for hospitals<br />

self-administering surveys)<br />

• Follow standardized <strong>HCAHPS</strong> telephone script using paper<br />

questionnaires<br />

January 2008<br />

125<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Telephone Only Mode (cont’d)<br />

• Obtaining telephone numbers<br />

– Main source of telephone numbers is<br />

hospital discharge records<br />

– Update missing or incorrect telephone<br />

numbers using<br />

• commercial software<br />

• internet direc<strong>to</strong>ries<br />

• direc<strong>to</strong>ry assistance<br />

• other tested methods<br />

January 2008<br />

126


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Telephone Only Mode (cont’d)<br />

• Data receipt and data entry<br />

– Electronic data collection, CATI<br />

• Linked electronically <strong>to</strong> survey management system<br />

– Manual data collection of paper questionnaires<br />

• Key entry<br />

• Scanning<br />

January 2008<br />

127<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Telephone Only Mode (cont’d)<br />

• Data retention/s<strong>to</strong>rage guidelines<br />

– Data collected through electronic telephone<br />

interviewing systems must be maintained in a secure<br />

manner for a minimum of three years<br />

– Paper questionnaires collected manually and then<br />

key-entered must be s<strong>to</strong>red in a secure and<br />

environmentally controlled location for a minimum of<br />

three years<br />

– Optically scanned paper questionnaire images must<br />

be retained in a secure manner for a minimum of<br />

three years<br />

January 2008<br />

128


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Telephone Only Mode (cont’d)<br />

• Quality control guidelines<br />

– Formal interviewer training <strong>to</strong> ensure<br />

standardized, non-directive interviews<br />

– Telephone moni<strong>to</strong>ring and oversight<br />

• At least 10% of interviews are moni<strong>to</strong>red<br />

January 2008<br />

129<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mixed Mode<br />

• Pro<strong>to</strong>col—Mail followed by telephone<br />

- Send questionnaire with cover letter <strong>to</strong> sampled patient(s)<br />

between 48 hours and 6 weeks (42 days) after discharge<br />

- Initiate systematic telephone contact for all non-respondent(s)<br />

approximately 21 days after mailing the questionnaire<br />

- Complete telephone sequence within 42 days of initiation so that<br />

a <strong>to</strong>tal of 5 telephone calls are attempted<br />

- at different times of day<br />

- on different days of the week<br />

- and in different weeks<br />

- Submit data <strong>to</strong> CMS via QualityNet Exchange by the data<br />

submission deadline<br />

January 2008<br />

130


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Mixed Mode (cont’d)<br />

• Mixed mode survey administration<br />

– Follow guidelines for mail only mode<br />

•Use onequestionnaire mailing instead of two<br />

– Follow guidelines for telephone only mode<br />

January 2008<br />

131<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Active Interactive Voice<br />

Response (IVR) Mode<br />

• Pro<strong>to</strong>col<br />

– Initiate systematic IVR contact <strong>to</strong> sampled patient(s)<br />

between 48 hours and 6 weeks (42 days) after<br />

discharge<br />

– Complete IVR sequence within 42 days after<br />

initiation so that a <strong>to</strong>tal of 5 telephone calls are<br />

attempted<br />

• at different times of day<br />

• on different days of the week<br />

• and in different weeks<br />

– Submit data <strong>to</strong> CMS via QualityNet Exchange by the<br />

data submission deadline<br />

January 2008<br />

132


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Active IVR Mode (cont’d)<br />

• IVR interviewing systems<br />

– Programmed with standardized <strong>HCAHPS</strong> IVR script<br />

– Capable of recording and s<strong>to</strong>ring patient answers<br />

– Capable of <strong>to</strong>uch <strong>to</strong>ne key pad response<br />

– Opt out option available for patients who do not want<br />

<strong>to</strong> continue with IVR (other interviewing option<br />

available)<br />

January 2008<br />

133<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Active IVR Mode (cont’d)<br />

• Live opera<strong>to</strong>r<br />

– Introduces patient <strong>to</strong> the survey and IVR system<br />

– Obtains patient consent <strong>to</strong> participate<br />

– Transitions patient <strong>to</strong> IVR<br />

– Available <strong>to</strong> answer questions/FAQs<br />

– Available <strong>to</strong> triage patients <strong>to</strong> another electronic<br />

system (CATI) or <strong>to</strong> conduct the interview themselves<br />

for reluctant respondents<br />

January 2008<br />

134


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Active IVR Mode (cont’d)<br />

• Follow telephone only mode guidelines<br />

– Data collection<br />

– Data receipt and retention<br />

– Quality control guidelines<br />

• Staff training<br />

• Moni<strong>to</strong>ring and oversight<br />

January 2008<br />

135<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Polling Question<br />

• Which primary mode of survey<br />

administration are you requesting <strong>to</strong><br />

use?<br />

A. Mail Only<br />

B. Telephone Only<br />

C. Mixed (Mail with Telephone follow-up)<br />

D. Active Interactive Voice Response (IVR)<br />

January 2008<br />

136


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Management<br />

• Establish survey management process <strong>to</strong><br />

administer survey<br />

– System resources<br />

– Cus<strong>to</strong>mer support lines<br />

– Personnel training<br />

– Moni<strong>to</strong>ring and quality oversight<br />

– Safeguarding patient confidentiality and privacy<br />

– Data security<br />

– Data retention<br />

January 2008<br />

137<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Management (cont’d)<br />

•System resources<br />

– Adequate physical plant resources available <strong>to</strong><br />

handle survey volume<br />

– <strong>Survey</strong> system <strong>to</strong> track sampled patients<br />

through the data collection pro<strong>to</strong>col<br />

•S<strong>to</strong>re the sample frame<br />

• Track key events<br />

• Assign unique IDs and match <strong>to</strong> outcome for each<br />

sampled patient<br />

January 2008<br />

138


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Management (cont’d)<br />

• Recommended cus<strong>to</strong>mer support telephone line<br />

options<br />

– Staffed live 9 AM <strong>to</strong> 8 PM Monday thru Friday<br />

– Sufficient capacity – 90% answered live<br />

– Voice mailbox for nights and weekends<br />

– Messages returned within one business day<br />

– Established return call standard of two business days<br />

for questions that cannot be answered at the time of<br />

the call<br />

– Database or tracking log of calls<br />

• Optional support via the Internet<br />

January 2008<br />

139<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Management (cont’d)<br />

• Personnel training<br />

– Project staff<br />

– Cus<strong>to</strong>mer support personnel<br />

– Mail data entry personnel<br />

– Telephone interviewers and IVR opera<strong>to</strong>rs<br />

January 2008<br />

140


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Management (cont’d)<br />

• Moni<strong>to</strong>ring and quality oversight<br />

– Ongoing moni<strong>to</strong>ring of staff and the survey<br />

administration process<br />

– Performance evaluations and feedback<br />

– System <strong>to</strong> evaluate patterns of errors<br />

– Detection and correction of performance<br />

problems<br />

January 2008<br />

141<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Management (cont’d)<br />

• Safeguarding patient data<br />

– Follow HIPAA guidelines<br />

– Restrict access <strong>to</strong> confidential data<br />

– Obtain confidentiality agreements from staff<br />

and subcontrac<strong>to</strong>rs who have access <strong>to</strong><br />

confidential information<br />

– Establish pro<strong>to</strong>cols for identifying security<br />

breaches and instituting corrective actions<br />

January 2008<br />

142


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Management (cont’d)<br />

• Confidentiality and privacy assurances<br />

<strong>to</strong> patient<br />

– <strong>HCAHPS</strong> survey question responses will be<br />

confidential and private and reported in an<br />

aggregate format <strong>to</strong> CMS<br />

– Hospital supplemental questions may<br />

voluntarily ask for patient name<br />

• Patients <strong>to</strong>ld that only hospital/survey vendor staff<br />

will see their responses<br />

January 2008<br />

143<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> Management (cont’d)<br />

• Physical and electronic data security<br />

– S<strong>to</strong>re returned mail surveys in secure location<br />

– Firewalls and other mechanisms for<br />

preventing unauthorized system access<br />

– Access levels and security passwords <strong>to</strong><br />

safeguard sensitive data<br />

– Backup procedures <strong>to</strong> safeguard system data<br />

– Frequent saves <strong>to</strong> media <strong>to</strong> minimize data<br />

losses<br />

January 2008<br />

144


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Questions?<br />

January 2008<br />

145<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Telephone and Active IVR<br />

<strong>Training</strong><br />

January 2008<br />

146


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Overview<br />

• Telephone and Active IVR Script and Programs<br />

• Introducing the <strong>Survey</strong><br />

• Reaching Respondents/Telephone and IVR<br />

Attempts<br />

• Interviewing Guidelines and Conventions<br />

– Avoiding Refusals<br />

–Probing for Complete Answers<br />

– System Conventions<br />

• Cus<strong>to</strong>mer Service FAQs<br />

January 2008<br />

147<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Telephone & Active IVR Script<br />

and Programs<br />

• No changes allowed <strong>to</strong> question and answer wording or ordering<br />

• All transitional wording is read verbatim<br />

• Supplemental questions allowed for hospital-specific items<br />

• Skip patterns should be programmed in<strong>to</strong> the telephone and IVR<br />

systems<br />

• Conventions provide instructions for programmers and<br />

interviewers<br />

• Every question should have a “Missing/Don’t Know” option<br />

programmed<br />

• See Appendices K, L, & M in the Quality Assurance Guidelines<br />

V3.0 for scripts<br />

January 2008<br />

148


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

<strong>Survey</strong> <strong>Introduction</strong><br />

• Critical <strong>to</strong> gaining cooperation<br />

• Provides survey purpose<br />

• Confirms respondent eligibility<br />

• Informs respondent that survey will take<br />

about seven minutes<br />

• Any changes <strong>to</strong> introduction require an<br />

approved Exceptions Request<br />

January 2008<br />

149<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Identifying Possible Ineligible<br />

Respondents<br />

• INEL1: Were you ever at this hospital?<br />

– YES [GO TO INEL2]<br />

– NO [GO TO END2]<br />

• INEL2: Were you a patient at this hospital in the last year?<br />

– YES [GO TO INEL3]<br />

– NO [GO TO END2]<br />

• INEL3: When was this?<br />

– IF ANY PERIOD WAS WITHIN TWO WEEKS OF [DISCHARGE DATE], GO<br />

TO Q1; OTHERWISE, GO TO END2.<br />

• END2: Thank you for your time. It looks like we made a mistake. I<br />

apologize for taking up your time. Have a good (day/evening).<br />

January 2008<br />

150


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Introducing the <strong>Survey</strong><br />

• <strong>Introduction</strong> script provided<br />

• Speak professionally and with confidence<br />

• After gaining agreement <strong>to</strong> participate,<br />

interviewers should move swiftly in<strong>to</strong> first<br />

question without rushing<br />

• Maintain pace and avoid long pauses<br />

January 2008<br />

151<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Introducing Active IVR<br />

• Live opera<strong>to</strong>r connects patient <strong>to</strong> active<br />

IVR system after:<br />

– gaining participation through initial telephone<br />

contact<br />

– confirming patient eligibility<br />

• Patient will hear electronic message<br />

confirming successful connection <strong>to</strong> active<br />

IVR system<br />

January 2008<br />

152


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Reaching Respondents<br />

• Five attempts <strong>to</strong> reach patient<br />

• Do not leave messages on answering machines<br />

since this could violate a patient’s privacy<br />

• Maximize the probability of reaching the patient<br />

by attempting contacts<br />

– at various times of the day<br />

– on different days of the week<br />

– in different weeks<br />

January 2008<br />

153<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Guidelines for Reaching<br />

Respondents (cont’d)<br />

• If the patient is away temporarily, he or she is<br />

contacted upon return<br />

• If the patient does not speak the language the<br />

survey is being administered in, thank the patient<br />

for his or her time and terminate the interview<br />

• If the patient is temporarily ill, re-contact the<br />

patient <strong>to</strong> see if there has been a recovery before<br />

the end of data collection<br />

• Attempt <strong>to</strong> correct wrong telephone numbers<br />

January 2008<br />

154


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Definition of a Telephone/<br />

Active IVR Attempt<br />

• Telephone rings six times with no answer<br />

• Busy signal—interviewer gets a busy signal on<br />

each of 3 consecutive attempts (counts as one<br />

attempt)<br />

• Interviewer or opera<strong>to</strong>r reaches the household<br />

and is <strong>to</strong>ld that the patient is not available <strong>to</strong><br />

come <strong>to</strong> the telephone<br />

• Patient asks the interviewer or opera<strong>to</strong>r <strong>to</strong> call<br />

back at a more convenient time<br />

January 2008<br />

155<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Interviewing Guidelines and<br />

Conventions<br />

• Interviewer/Opera<strong>to</strong>r <strong>to</strong>ne:<br />

– Speak in an upbeat and courteous <strong>to</strong>ne<br />

– Establish rapport<br />

– Maintain professional and neutral relationship<br />

– Do not provide personal information or opinions<br />

– Do not try <strong>to</strong> influence patients’ responses <strong>to</strong><br />

questions in a certain way<br />

• See Appendix N in Quality Assurance Guidelines V3.0<br />

January 2008<br />

156


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Interviewing Guidelines and<br />

Conventions (cont’d)<br />

• Question asking:<br />

– Questions, transitions and response choices<br />

are read exactly as worded on script<br />

– Do not provide extra information or lengthy<br />

explanations <strong>to</strong> respondent questions<br />

– Never skip questions<br />

– End the survey by thanking the respondent<br />

for his or her time<br />

January 2008<br />

157<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Interviewing Guidelines and<br />

Conventions (cont’d)<br />

• System conventions<br />

– Text that appears in lower case letters should be read<br />

– Text in UPPER CASE letters should not be read out<br />

loud<br />

– Text that is underlined should be emphasized by the<br />

interviewer<br />

– Characters in < > should not be read out loud<br />

– [Square brackets] are used <strong>to</strong> show programming<br />

instructions which would not actually appear on the<br />

computerized interviewing screens<br />

January 2008<br />

158


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Interviewing Guidelines and<br />

Conventions (cont’d)<br />

• Avoiding refusals<br />

– Be prepared <strong>to</strong> convert a refusal in<strong>to</strong> a<br />

completed survey<br />

– Emphasize importance of participation<br />

– Never argue with or antagonize a patient<br />

– Remember! First moments of the interview<br />

are most critical for gaining participation<br />

January 2008<br />

159<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Interviewing Guidelines and<br />

Conventions (cont’d)<br />

• Probing for complete data<br />

– When respondent fails <strong>to</strong> provide<br />

adequate answer<br />

– Never interpret answers for respondents<br />

– Code “Missing/Don’t Know” when<br />

respondent cannot/does not provide<br />

complete answer after probing<br />

January 2008<br />

160


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Interviewing Guidelines and<br />

Conventions (cont’d)<br />

• Types of probes:<br />

• Repeat question and answer categories<br />

• Interviewer says:<br />

–“Take a minute <strong>to</strong> think about it”<br />

–“So would you say…”<br />

–“Which would you say is closer <strong>to</strong> the<br />

answer?”<br />

January 2008<br />

161<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Interviewing Guidelines and<br />

Conventions (cont’d)<br />

Example of response probe: Question 23<br />

In general, how would you rate your overall health? Would you say that it<br />

is…<br />

1 Excellent,<br />

2 Very good,<br />

3 Good,<br />

4 Fair, or<br />

5 Poor?<br />

M<br />

MISSING/DK<br />

Probe: “We’re asking you <strong>to</strong> choose one response.<br />

Would you say your overall health is….”<br />

January 2008<br />

162


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Interviewing Guidelines and<br />

Conventions (cont’d)<br />

Example of response probe: Question 21<br />

We want <strong>to</strong> know your overall rating of your stay at<br />

[FACILITYNAME]. This is the stay that ended around<br />

[DISCHARGE DATE]. Please do not include any other hospital<br />

stays in your answer.<br />

Using any number from 0 <strong>to</strong> 10, where 0 is the worst hospital<br />

possible and 10 is the best hospital possible, what number would<br />

you use <strong>to</strong> rate this hospital during your stay?<br />

Probe: “Please pick a number from 0-10, where 0 is the<br />

worst hospital possible and 10 is the best hospital<br />

possible. What number would you say is closest <strong>to</strong> your<br />

answer?”<br />

January 2008<br />

163<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Interviewing Guidelines and<br />

Conventions (cont’d)<br />

• [FOR TELEPHONE INTERVIEWING THIS QUESTION IS BROKEN INTO PARTS A-E]<br />

• Q26 When I read the following list, please tell me if the category describes your<br />

race. You may choose one or more.<br />

– Q26A Are you White?<br />

– YES/WHITE<br />

– NO/NOT WHITE<br />

– MISSING/DK<br />

– Q26B Are you Black or African-American?<br />

– YES/BLACK OR AFRICAN-AMERICAN<br />

– NO/NOT BLACK OR AFRICAN-AMERICAN<br />

– MISSING/DK<br />

Read Q.’s A through E <strong>to</strong> capture multiple races. Do not s<strong>to</strong>p<br />

reading the list when you get a Yes answer.<br />

January 2008<br />

164


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Cus<strong>to</strong>mer Service FAQs<br />

• Interviewers/Opera<strong>to</strong>rs should be<br />

knowledgeable about the survey and its goals,<br />

and be prepared <strong>to</strong> answer questions<br />

• FAQs provide answers <strong>to</strong>:<br />

– General questions about the survey<br />

– Concerns about participating in the survey<br />

– Questions about completing/returning the survey<br />

• See Appendix O in Quality Assurance Guidelines<br />

V3.0<br />

January 2008<br />

165<br />

<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Questions?<br />

January 2008<br />

166


<strong>Introduction</strong> <strong>to</strong> <strong>HCAHPS</strong> <strong>Survey</strong> <strong>Training</strong><br />

Contact Us<br />

<strong>HCAHPS</strong> Information and Technical Support<br />

•Website: www.hcahpsonline.org<br />

• E-mail: hcahps@azqio.sdps.org<br />

• Telephone: 1-888-884-4007<br />

January 2008<br />

167

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!