03.03.2015 Views

EDP801 Syllabus - Cardinal Stritch University

EDP801 Syllabus - Cardinal Stritch University

EDP801 Syllabus - Cardinal Stritch University

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

1<br />

CARDINAL STRITCH<br />

U N I V E R S I T Y<br />

SYLLABUS OF COURSE<br />

Course No: EDP 801<br />

Credit Hours: 2.0<br />

Title of Course: Survey Research<br />

Scheduled Class Time: Friday/Saturday<br />

Hours: 4:00-8:00 and 8:00-4:00 p.m.<br />

Instructor: Dr. Donna Recht Semester & Year/Beg & End Dates: Fall 2009<br />

11/15/09-1/23/10<br />

<strong>Syllabus</strong> Outline<br />

a. Course title<br />

b. Course description (should match the <strong>University</strong> Catalog)<br />

c. Measurable course objectives<br />

d. Methods of assessment linked to each course objective<br />

e. Criteria for assessment that describe how the performances will be judged and ultimately<br />

graded. Assessment criteria must be clearly specified in a list, paragraph or scoring rubric<br />

format. A suggested grading scheme, which includes weighting of assignments, assessments<br />

or other measured performances, must be included here as well.<br />

f. Outline of the sequence of topics and content covered in the course.<br />

g. Required materials and other relevant supportive references cited in APA, MLA, or other<br />

style appropriate to the discipline.<br />

h. Textbook(s) used<br />

i. Writing and speaking across the curriculum<br />

j. Policy on class attendance<br />

k. Policy on cheating and plagiarism (reference the Institutional Policy on Academic Integrity)<br />

l. Policy on late assignments<br />

m. Policy on missed exams and assignments<br />

n. Office hours<br />

o. Last date for withdrawal (2/3 of semester for courses with unusual start dates or which don’t<br />

last 15 weeks)<br />

p. Policy statement for Rehabilitation Act 504<br />

Revised Fall 2002 to reflect requirements of the Undergraduate and Graduate Curriculum<br />

Committees and the assessment requirements of NCA.


2<br />

<strong>Cardinal</strong> <strong>Stritch</strong> <strong>University</strong><br />

Graduate Education<br />

Survey Research, ED 801<br />

2 credits<br />

Instructor: Donna Recht, PhD<br />

Office Phone 414 410-4369<br />

FAX 414-410-4377<br />

E-Mail drrecht@stritch.edu<br />

Office Hours as needed<br />

Seminar Meeting Times 11/15/09, 12/13/09, 1/23/10<br />

Seminar Locations City Center<br />

Course Description<br />

This advanced course in research is one of the elective courses in the Ph.D. sequence.<br />

This course prepares doctoral students to design and conduct their own survey. The<br />

course takes students through the stages in survey design from the preplanning phase,<br />

through question design, to field testing, to statistical analysis and reporting of the<br />

results. The focus of this course is the design and understanding of research through<br />

achievement of the following primary learning objectives:<br />

1. Understand and demonstrate the importance of preplanning including<br />

determination of the objectives of the survey, focus on the variables which flow<br />

from the research question, linkages of relevant research literature, and use of<br />

the knowledge of others to focus on critical ideas.<br />

2. Translate the objectives into a survey which considers the proposed subjects,<br />

format, methodology and analysis plan.<br />

3. Design and field-test the survey to achieve clarity of directions and valid and<br />

reliable questions<br />

4. Understand how to sample a relevant population while minimizing sample error.<br />

5. Understand how to match statistics with the objectives of the study.<br />

6. Understand how to administer, analyze and report the survey results.<br />

Program Outcomes<br />

The following program outcomes evolve from the Franciscan values and describe the<br />

goals for doctorally prepared students:<br />

I. Demonstrates knowledge of the nature and nurture of leadership, learning,<br />

service, and research. (Related to state administrative standards: 1, 2)<br />

II. Demonstrates knowledge of the relationship among leadership, learning, service,<br />

and research. (Related to state standard: 3)


3<br />

III. Facilitates organizational vision, purpose, intelligence, and the commitment to<br />

serve. (Related to state administrative standards: 1, 3, 4)<br />

IV. Analyzes, engages, and develops organizational culture that supports shared<br />

leadership, learning, service, and research. (Related to state administrative<br />

standards: 1, 3)<br />

V. Cultivates individual and collective intelligence as a means to advance and<br />

transform the human condition. (Related to state standard: 2)<br />

VI. Applies service and social transformation to enhance the human condition.<br />

(Related to state standard: 3)<br />

VII. Designs, conducts, and communicates original research. (Related to state<br />

administrative standards: 4)<br />

VIII. Critically interprets research and literature related to leadership, learning, and<br />

service. (Related to state standard: 6)<br />

IX. Applies technology to the development of leadership, learning, service, and<br />

research. (Related to state standard: 6)<br />

X. Demonstrates ethical and moral leadership. (Related to state administrative<br />

standards: 5)<br />

XI. Utilizes theory, research, and reflection in practice as stimuli for continuous<br />

development. (Related to state administrative standards: 3, 6)<br />

Required Textbooks:<br />

Suskie, L. A. (1996). Questionnaire survey research: What works, 2 nd ed.<br />

Tallahassee, FL: AIR.<br />

Recommended text:<br />

Fink, A. (2006). How to conduct surveys: A step by step guide, 3 rd ed. Thousand Oaks,<br />

CA: Sage.<br />

Assignment I<br />

Draft of the preplanning stage of the survey Based on a<br />

paragraph describing the subject of the survey, draft a<br />

research question, cite relevant research literature,<br />

determine key variables, conduct a focus group and draft<br />

survey questions.<br />

Assessment Criteria<br />

The written formats should follow APA format, research<br />

guidelines related to content, organizational format, and<br />

conventions of writing. See rubric.<br />

Timeline Paper due in class 2<br />

Performance Indicator II<br />

Understand and practice the dispositions of critical thinking<br />

and analysis. Identify and analyze research argument and<br />

logic as presented in established literature. (Program<br />

Outcomes: VII, VIII, XI)


4<br />

Assignment II<br />

Timeline<br />

Assessment Criteria<br />

Final draft of the survey. This written paper describes the<br />

survey including the research question, independent and<br />

dependent variables, relation to the research literature,<br />

population, format and analysis plan. It includes the field<br />

tested survey with attached statistics, the final draft of the<br />

survey itself, and the letter to the participants and timetable.<br />

Project paper is due two weeks after the final class<br />

The written formats should follow APA format, research<br />

guidelines related to content, organizational format, and<br />

conventions of writing: appropriateness, theory,<br />

organization, understanding, critical thinking, writing skills,<br />

structure, and format. See rubric.<br />

Performance Indicator Apply knowledge of research theory and survey<br />

methodology (Program Outcomes: I, VII, VIII, XI)<br />

Grading:<br />

Draft of the survey 20% of final grade<br />

Final survey 80%<br />

Context of Class:<br />

A deeper understanding of the philosophical and methodological underpinnings of<br />

research is an important part of a Ph.D. program in Leadership. Leaders who hope to<br />

have an impact in leadership, learning and service should have a sophisticated<br />

understanding of a variety of ways to ask questions, ways to answer those questions,<br />

and be an exemplar of effective, critical, creative problem-solving. An attitude of<br />

openness, inquiry, questioning, curiosity for investigation, willingness and readiness to<br />

test alternatives, and an understanding of calculated risk-taking should be cultivated<br />

among future leaders. This objective is made tangible by having students engage in a<br />

course where they learn how to ascertain information from a variety of sources by<br />

learning all the parts of survey development from preplanning to execution.<br />

Skills: The student will be able to:<br />

1. formulate a plan for inquiry that is thoughtful, logical, and feasible and execute<br />

that plan in the form of survey development<br />

2. think critically throughout the development of the survey<br />

3. reflect critically on one’s own research discipline to complete a project that meets<br />

a high quality of personal, academic, professional, and ethical standards<br />

4. understand the rigors of survey development<br />

Values/Attitudes: The student will be able to:<br />

1. appreciate the role of research as adding to a body of knowledge and the<br />

student’s responsibility to that endeavor


5<br />

2. promote the growth of community, collaboration, and collegiality through<br />

investigation<br />

3. recognize one’s commitment to this research process<br />

4. gain confidence in one’s ability to conduct research<br />

Course Topics<br />

• The history of surveys<br />

• The preplanning process of deciding what to measure, who to measure and how<br />

to measure<br />

• Integration of the literature review with the research question and articulation of<br />

variables<br />

• Deciding on a sample and how to minimize sample error<br />

• Writing valid and reliable questions<br />

• Deciding on format, methodology and analysis plan<br />

• Revision and redesign of the survey based on field testing<br />

• Matching statistics to the purpose of the survey<br />

• Attending to the ethics of survey administration<br />

• Integrating inquiry, method, and design<br />

• Writing research reports on the survey that people will read<br />

Bibliography<br />

Braverman, M. T., & Slater, J. K. (1996) Advances in survey research. San Francisco,<br />

CA: Jossey Bass.<br />

Czaja, R., & Blair, J. (2005). Designing surveys: A guide to decisions and procedures.<br />

(2 nd ed). Thousand Oaks, CA: Sage.<br />

Dillman, D. (2000). Mail and internet surveys: The total design method. New York, NY:<br />

Wiley.<br />

Fink, A. (1995) The survey kit. Thousand Oaks, CA: Sage.<br />

Fink, A., & Kosecoff, J. (l998) How to conduct surveys ( 2 nd ed.) Thousand Oaks, CA:<br />

Sage.<br />

Fowler, F.J. (2002) Survey research methods (3 rd ed.) Thousand Oaks, CA: Sage.<br />

Fowler, F., & Mangione, T. (1990) Standardized survey interviewing: Minimizing<br />

interview related error. Thousand Oaks, CA: Sage.<br />

Gall, M., Borg, W., & Gall, J. (1996). Education research (6th ed.) New York, NY:


6<br />

Longman.<br />

Grover, R. M. (l989). Survey errors and survey costs. New York, NY: Wiley.<br />

Sudman, S., Badburn, N., & Schwarz, N. (1996) Thinking about answers: The<br />

application of cognitive processes to survey methodology. San Francisco, CA:<br />

Jossey Bass.<br />

Thomas, S. J. (1999) Designing surveys that work: A step by step guide. Thousand<br />

Oaks, CA: Sage.<br />

General Course Expectations<br />

• Because of the accelerated nature of this program, it is crucial that students attend<br />

all classes and study team meetings. If an absence is deemed necessary, this will<br />

be handled on an individual basis.<br />

• Active class and study team participation is an important component.<br />

• Word-processed work is expected unless otherwise indicated.<br />

• All work is to be in the student's own words unless quotation marks and referenced<br />

pages are provided.<br />

• APA style should be used for documentation of references.<br />

• It is expected that work will be turned in on the assigned date. If there is a problem,<br />

please contact the instructor.<br />

• If a student misses a course and wants to continue in the program, the student must<br />

make up the missed course either with another cohort or on campus. There is no<br />

directed study or independent study done through Outreach. Therefore, the student<br />

will have to make a commitment to take the course missed.<br />

• Academic integrity is expected. Refer to the Student handbook.<br />

• <strong>Cardinal</strong> <strong>Stritch</strong> <strong>University</strong> and this instructor wish to positively affirm the intent of the<br />

American Disability Act. Any person enrolling in this course who may require<br />

alternative instructional and/or evaluative procedures due to a disability should feel<br />

free to discuss these needs with the instructors so that appropriate arrangements<br />

can be made.


7<br />

Assignment I<br />

Preplanning Stage Draft of Survey<br />

The goal of this course is for you to write a decent survey. The goal of this assignment<br />

is for you to do the critical preplanning steps.<br />

Name of student:______________________________<br />

Date:_______________<br />

Assessment Criteria<br />

- Does not meet<br />

expectations<br />

Performance<br />

√ Meets<br />

expectations<br />

+ Exceeds<br />

expectations<br />

Your paragraph(s) describe<br />

the topic of the survey. You<br />

give relevant background<br />

information, your purpose,<br />

and proposed subjects.<br />

The research question that<br />

you want to answer by<br />

conducting the survey is clear,<br />

concise (one sentence) and is<br />

linked to topic/background.<br />

The literature review relevant<br />

to the topic is summarized.<br />

Two to five variables are<br />

clearly identified and linked to<br />

the research question and<br />

literature review<br />

You conduct and summarize<br />

the results from the focus<br />

group.<br />

Your draft of survey questions<br />

is linked to your variables and<br />

research question.<br />

You’ve included a preliminary<br />

timeline<br />

Your paper is well organized,<br />

clear and written according to<br />

APA<br />

Grade<br />

A grade of high pass requires that 6 of 8 are in the exceeds expectation column and there are no checks<br />

in the does not meet expectation column. A grade of pass indicates that the majority of<br />

checks are in the meets expectation column.<br />

Comments:


8<br />

Assignment II Final draft of the survey<br />

Name:______________________________<br />

Date:_______________<br />

Comments:<br />

Assessment Criteria<br />

Part 1: your written paper clearly<br />

describes your research<br />

question, variables & how the<br />

variables are related to the<br />

research literature.<br />

Part 1: you have a reasonable<br />

selected sample/ population and<br />

plan for adjusting for error<br />

Part 1: your analysis plan is<br />

coherent and effective and is<br />

linked to your goals and the<br />

survey design.<br />

Part 2: your description of the<br />

field testing is clear<br />

Part 2: your field test statistics<br />

are appropriate to the number of<br />

subjects and the purpose of<br />

your survey<br />

Part 2: You are reflective and<br />

evaluative about what the field<br />

test told you about your survey<br />

Part 3: your revised survey<br />

reflects good practice and<br />

incorporates your field test<br />

analysis<br />

- Does not meet<br />

expectations<br />

Performance<br />

√ Meets<br />

expectations<br />

+ Exceeds<br />

expectations<br />

(in addition to<br />

items in Meets)<br />

You have appropriately<br />

addressed reliability and validity<br />

in your analysis<br />

plan.<br />

Part 4: your letter to participants<br />

reflects is clear and well written<br />

Part 5: your timetable is<br />

reasonable<br />

A grade of high pass requires that 8 of 10 are in the exceeds expectation column and there are no checks<br />

in the does not meet expectation column. A grade of pass indicates that the majority of<br />

checks are in the meets expectation column.


9<br />

Session One<br />

Preplanning<br />

A survey is a major project, involving considerable time and resources. To make sure your<br />

efforts pay off, it is critical that you spend time planning (Suskie, 1996, p.1).<br />

History of surveys<br />

Begin at the beginning: establish the purpose of the survey<br />

1. Do you want to describe a population around a certain subject?<br />

2. Do you want to compare the responses of subgroups?<br />

3. Do you want to explain or explore causality?<br />

Deciding what to measure<br />

1. Decide on the most important ideas that you want to ask (write the research question)<br />

2. Determine the objectives of your survey<br />

3. Test out your ideas on knowledgeable others<br />

4. Form an analysis plan<br />

5. Develop a preliminary timetable<br />

Deciding who to measure<br />

Writing clear questions<br />

1. Writing questions that are good measures of your objectives<br />

2. Writing clear instructions<br />

Putting this all together<br />

Assignments<br />

Individual<br />

1. Read text chapter 1 and 2 before you begin your survey construction. Read chapter 3<br />

before you come to class for session 2.<br />

2. The goal of this course is for you to write a decent survey. Between Session 1 and 2,<br />

you'll do the critical preplanning steps. For session 2, prepare a written paper that has the<br />

following components:<br />

Draft a paragraph(s) which describes the subject of your survey (include relevant<br />

background information, your purpose, proposed subjects. .) From the paragraph,<br />

draft your research question.<br />

In 2 pages, summarize the research literature relevant to the topic. You should<br />

have 3-5 studies reviewed.<br />

From the lit review and research questions, compile and list 2-5 variables.<br />

Connect the variables to the lit review and research questions.<br />

Conduct a focus group with colleagues knowledgeable about your topic.<br />

Summarize the major ideas that emerge from the focus group<br />

Using the focus group results, lit review and research questions, draft survey<br />

questions. Use text chapter 2 as a reference for question construction.


10<br />

<br />

<br />

After your Study Group meeting, redraft questions. Attach redrafted questions to<br />

your written paper.<br />

Construct a preliminary timeline and estimate of costs.<br />

Study Group<br />

The intent of the study group is to provide colleague(s) as critical friends to carefully<br />

review the description paragraph, research question, variables, focus group info, and draft<br />

questions of each member.


11<br />

What do you have so far?<br />

Session Two<br />

Planning<br />

Writing good questions<br />

1. What goes into a good survey question?<br />

2. How to write reliable questions<br />

3. How to write valid questions<br />

Making decisions about the survey<br />

Deciding on a sample<br />

1. Who should you survey?<br />

2. How to define the population<br />

3. How to determine sample size<br />

4. Types of samples (random, systematic, stratified, nonprobability)<br />

5. Minimizing sample error<br />

Deciding on the measurement appropriate to your purpose<br />

1. nominal<br />

2. ordinal<br />

3. interval<br />

Constructing an analysis plan<br />

Independent and dependent variables<br />

The advantages and disadvantages of nominal, ordinal and interval measures<br />

Choosing appropriate statistical techniques for your survey<br />

Pilot-testing the instrument<br />

Assignments<br />

Individual<br />

1. Read text chapters 4, 5 and 6; Ethics Code Appendix A<br />

2. Revise survey based on class feedback<br />

3. Decide on sample population for the pilot<br />

4. Field test the survey on at least 10 people<br />

Bring 6 copies of your revised surveys for colleague help!<br />

Study group<br />

1. Check partner’s survey revision using checklist from text p. 71-2<br />

2. Help with setting up fieldtest


12<br />

Session Three<br />

Analyzing the data<br />

Review<br />

1. Deciding on the measurement appropriate to your purpose and analysis<br />

2. Writing valid and reliable questions<br />

Insuring data accuracy<br />

1. Editing<br />

2. Preparation of the codebook<br />

Designing coding systems and constructing a codebook<br />

Entry of data into the computer<br />

Data cleaning<br />

Data analysis of the pilot<br />

1. Reliability<br />

What is reliability?<br />

Why is reliability important?<br />

Cronbach alpha<br />

2. Validity<br />

What is validity<br />

Why is validity important?<br />

Face, content and construct validity<br />

Development of an analysis plan<br />

1. Descriptive statistics<br />

2. Cronbach<br />

3. Factor analysis<br />

4. Display of data<br />

5. What stats can I use with a bigger N?<br />

inferential statistics<br />

Writing research reports that people will read<br />

Constructing data tables<br />

Power of graphics<br />

Explaining complicated data in clear language<br />

What else to think about?<br />

Measuring the influence of nonresponse<br />

Why increasing sample size does not solve the nonresponse problem<br />

Planning follow-up to accommodate nonresponse issues<br />

Writing effective cover letters<br />

Using incentives to increase response rates<br />

Checking for effective questionnaire formating<br />

Revisiting survey format: differences between web/e-mail, mail and interview<br />

formats


13<br />

<br />

<br />

<br />

<br />

<br />

Designing a clear, uncluttered survey<br />

Collecting demographic information: how much to ask?<br />

Designing questionnaire layouts that make data analysis easier<br />

Deciding how many response options to include<br />

Formats that avoid response bias<br />

Ethics<br />

Assignment<br />

Your written work is due not more than 2 weeks after the completion of session three. Your<br />

survey should be revised and ready to administer to your chosen population. The written<br />

paper includes five parts:<br />

1. The first part is a 2-5 page paper describing your survey including your<br />

research question, the dependent/independent variables, how the variables<br />

are related to the research literature in this area, the population that you are<br />

interested in exploring, how the population was selected (random..), how you<br />

will adjust for error and your proposed analysis plan. The description is a<br />

revision of the assignment submitted for class 2 combined with information<br />

obtained in class 3.<br />

2. The second part describes your field testing and includes a copy of your fieldtested<br />

survey, a copy of the SPSS statistics on the field-test survey and a 1-3<br />

page explanation of pretesting (what did the experience of conducting the field<br />

test tell you? What did the descriptive statistics tell you?)<br />

3. The third part contains a copy of your revised survey with a description of the<br />

decisions that you made on format, question clarity, length and delivery<br />

(paper/computer/interview) of survey.<br />

4. The fourth part includes your letter to your participants which clearly explains<br />

the purpose of your study. Use text p. 73-8 and Appendix 5 as a guide.<br />

5. The final part includes your revised timetable and cost estimate for your<br />

survey. See model text Appendix 2.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!