PDF, 3.8 MB - Substance Abuse and Mental Health Services ...

quality errors, and willingness to take on additional work (particularly to work on hard refusals).
To decide how to divide bonus funds, the FS ranked each FI. Additionally, pay raises were not
necessarily related to bonus money; an FI might not receive a bonus but could still be eligible for
a raise. For both bonuses and pay raises, RSs and RDs reviewed the FS's decisions.
8.1.6 FS Final Evaluations of FIs
At the end of the calendar year, each FS used a standard RTI multiple-choice form to
generate an annual evaluation of FIs who were active on the NSDUH. FIs were rated on a 5-
point scale (unsatisfactory, poor, satisfactory, above average, and exceptional) on such standard
interviewing skills as quality of work, data collection skills, adherence to deadlines, and
productivity. The FS also commented on the FI's strengths and any areas needing improvement.
The FS used this same form to provide a final evaluation of FIs who "attrited." Completed
evaluations were added to the interviewer's personal data file at RTI. The FS generally
completed this form without RS or RD input.
8.1.7 FI Exit Interviews
Every month, NSDUH management personnel received a listing of those field
interviewers who had voluntarily chosen to leave the project (those terminated did not appear on
this list). The listed FIs were contacted and a short questionnaire was administered (see Exhibit
8.2) to determine the reasons they left the project. These data were then keyed and used to
produce a quarterly report for project management summarizing the reasons. Of the 185 FIs who
were terminated from the NSDUH in 2003, 109 voluntarily chose to leave the project. The exit
interview was completed with 61 of these FIs. Exhibit 8.3 contains the total results for all FI exit
interviews conducted during 2003. Table 8.1 summarizes the most important reasons reported by
FIs for their resignation. Nine FIs completing the exit interview (15 percent) indicated the most
important reason for leaving was some difficulty working with their supervisor, while seven (12
percent) said they did not like working at night and six others (10 percent) found another job.
8.2 Web-based Case Management System (CMS)
Each FS was equipped with a laptop computer and given access to the NSDUH Webbased
Case Management System (CMS). FIs transmitted screening data daily from the Newton,
including record of calls data, verification information for non-interview cases, added DUs, and
address updates. Newton screening data transmitted to RTI were checked by the control system's
defined consistency checks, and then posted to the CMS for monitoring purposes. The completed
interview data were transmitted to RTI by FIs from their laptop computers and checked against
screening data to ensure each completed case was received and that the correct respondent was
interviewed.
The FS System on the CMS included the following data quality functions:
• Daily and Weekly Reports with access to archived reports (for comparison data).
• An interactive data information page for monitoring production.
• An interactive record of calls page for monitoring FI work patterns.
333