EDP801 Syllabus - Cardinal Stritch University
EDP801 Syllabus - Cardinal Stritch University
EDP801 Syllabus - Cardinal Stritch University
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
1<br />
CARDINAL STRITCH<br />
U N I V E R S I T Y<br />
SYLLABUS OF COURSE<br />
Course No: EDP 801<br />
Credit Hours: 2.0<br />
Title of Course: Survey Research<br />
Scheduled Class Time: Friday/Saturday<br />
Hours: 4:00-8:00 and 8:00-4:00 p.m.<br />
Instructor: Dr. Donna Recht Semester & Year/Beg & End Dates: Fall 2009<br />
11/15/09-1/23/10<br />
<strong>Syllabus</strong> Outline<br />
a. Course title<br />
b. Course description (should match the <strong>University</strong> Catalog)<br />
c. Measurable course objectives<br />
d. Methods of assessment linked to each course objective<br />
e. Criteria for assessment that describe how the performances will be judged and ultimately<br />
graded. Assessment criteria must be clearly specified in a list, paragraph or scoring rubric<br />
format. A suggested grading scheme, which includes weighting of assignments, assessments<br />
or other measured performances, must be included here as well.<br />
f. Outline of the sequence of topics and content covered in the course.<br />
g. Required materials and other relevant supportive references cited in APA, MLA, or other<br />
style appropriate to the discipline.<br />
h. Textbook(s) used<br />
i. Writing and speaking across the curriculum<br />
j. Policy on class attendance<br />
k. Policy on cheating and plagiarism (reference the Institutional Policy on Academic Integrity)<br />
l. Policy on late assignments<br />
m. Policy on missed exams and assignments<br />
n. Office hours<br />
o. Last date for withdrawal (2/3 of semester for courses with unusual start dates or which don’t<br />
last 15 weeks)<br />
p. Policy statement for Rehabilitation Act 504<br />
Revised Fall 2002 to reflect requirements of the Undergraduate and Graduate Curriculum<br />
Committees and the assessment requirements of NCA.
2<br />
<strong>Cardinal</strong> <strong>Stritch</strong> <strong>University</strong><br />
Graduate Education<br />
Survey Research, ED 801<br />
2 credits<br />
Instructor: Donna Recht, PhD<br />
Office Phone 414 410-4369<br />
FAX 414-410-4377<br />
E-Mail drrecht@stritch.edu<br />
Office Hours as needed<br />
Seminar Meeting Times 11/15/09, 12/13/09, 1/23/10<br />
Seminar Locations City Center<br />
Course Description<br />
This advanced course in research is one of the elective courses in the Ph.D. sequence.<br />
This course prepares doctoral students to design and conduct their own survey. The<br />
course takes students through the stages in survey design from the preplanning phase,<br />
through question design, to field testing, to statistical analysis and reporting of the<br />
results. The focus of this course is the design and understanding of research through<br />
achievement of the following primary learning objectives:<br />
1. Understand and demonstrate the importance of preplanning including<br />
determination of the objectives of the survey, focus on the variables which flow<br />
from the research question, linkages of relevant research literature, and use of<br />
the knowledge of others to focus on critical ideas.<br />
2. Translate the objectives into a survey which considers the proposed subjects,<br />
format, methodology and analysis plan.<br />
3. Design and field-test the survey to achieve clarity of directions and valid and<br />
reliable questions<br />
4. Understand how to sample a relevant population while minimizing sample error.<br />
5. Understand how to match statistics with the objectives of the study.<br />
6. Understand how to administer, analyze and report the survey results.<br />
Program Outcomes<br />
The following program outcomes evolve from the Franciscan values and describe the<br />
goals for doctorally prepared students:<br />
I. Demonstrates knowledge of the nature and nurture of leadership, learning,<br />
service, and research. (Related to state administrative standards: 1, 2)<br />
II. Demonstrates knowledge of the relationship among leadership, learning, service,<br />
and research. (Related to state standard: 3)
3<br />
III. Facilitates organizational vision, purpose, intelligence, and the commitment to<br />
serve. (Related to state administrative standards: 1, 3, 4)<br />
IV. Analyzes, engages, and develops organizational culture that supports shared<br />
leadership, learning, service, and research. (Related to state administrative<br />
standards: 1, 3)<br />
V. Cultivates individual and collective intelligence as a means to advance and<br />
transform the human condition. (Related to state standard: 2)<br />
VI. Applies service and social transformation to enhance the human condition.<br />
(Related to state standard: 3)<br />
VII. Designs, conducts, and communicates original research. (Related to state<br />
administrative standards: 4)<br />
VIII. Critically interprets research and literature related to leadership, learning, and<br />
service. (Related to state standard: 6)<br />
IX. Applies technology to the development of leadership, learning, service, and<br />
research. (Related to state standard: 6)<br />
X. Demonstrates ethical and moral leadership. (Related to state administrative<br />
standards: 5)<br />
XI. Utilizes theory, research, and reflection in practice as stimuli for continuous<br />
development. (Related to state administrative standards: 3, 6)<br />
Required Textbooks:<br />
Suskie, L. A. (1996). Questionnaire survey research: What works, 2 nd ed.<br />
Tallahassee, FL: AIR.<br />
Recommended text:<br />
Fink, A. (2006). How to conduct surveys: A step by step guide, 3 rd ed. Thousand Oaks,<br />
CA: Sage.<br />
Assignment I<br />
Draft of the preplanning stage of the survey Based on a<br />
paragraph describing the subject of the survey, draft a<br />
research question, cite relevant research literature,<br />
determine key variables, conduct a focus group and draft<br />
survey questions.<br />
Assessment Criteria<br />
The written formats should follow APA format, research<br />
guidelines related to content, organizational format, and<br />
conventions of writing. See rubric.<br />
Timeline Paper due in class 2<br />
Performance Indicator II<br />
Understand and practice the dispositions of critical thinking<br />
and analysis. Identify and analyze research argument and<br />
logic as presented in established literature. (Program<br />
Outcomes: VII, VIII, XI)
4<br />
Assignment II<br />
Timeline<br />
Assessment Criteria<br />
Final draft of the survey. This written paper describes the<br />
survey including the research question, independent and<br />
dependent variables, relation to the research literature,<br />
population, format and analysis plan. It includes the field<br />
tested survey with attached statistics, the final draft of the<br />
survey itself, and the letter to the participants and timetable.<br />
Project paper is due two weeks after the final class<br />
The written formats should follow APA format, research<br />
guidelines related to content, organizational format, and<br />
conventions of writing: appropriateness, theory,<br />
organization, understanding, critical thinking, writing skills,<br />
structure, and format. See rubric.<br />
Performance Indicator Apply knowledge of research theory and survey<br />
methodology (Program Outcomes: I, VII, VIII, XI)<br />
Grading:<br />
Draft of the survey 20% of final grade<br />
Final survey 80%<br />
Context of Class:<br />
A deeper understanding of the philosophical and methodological underpinnings of<br />
research is an important part of a Ph.D. program in Leadership. Leaders who hope to<br />
have an impact in leadership, learning and service should have a sophisticated<br />
understanding of a variety of ways to ask questions, ways to answer those questions,<br />
and be an exemplar of effective, critical, creative problem-solving. An attitude of<br />
openness, inquiry, questioning, curiosity for investigation, willingness and readiness to<br />
test alternatives, and an understanding of calculated risk-taking should be cultivated<br />
among future leaders. This objective is made tangible by having students engage in a<br />
course where they learn how to ascertain information from a variety of sources by<br />
learning all the parts of survey development from preplanning to execution.<br />
Skills: The student will be able to:<br />
1. formulate a plan for inquiry that is thoughtful, logical, and feasible and execute<br />
that plan in the form of survey development<br />
2. think critically throughout the development of the survey<br />
3. reflect critically on one’s own research discipline to complete a project that meets<br />
a high quality of personal, academic, professional, and ethical standards<br />
4. understand the rigors of survey development<br />
Values/Attitudes: The student will be able to:<br />
1. appreciate the role of research as adding to a body of knowledge and the<br />
student’s responsibility to that endeavor
5<br />
2. promote the growth of community, collaboration, and collegiality through<br />
investigation<br />
3. recognize one’s commitment to this research process<br />
4. gain confidence in one’s ability to conduct research<br />
Course Topics<br />
• The history of surveys<br />
• The preplanning process of deciding what to measure, who to measure and how<br />
to measure<br />
• Integration of the literature review with the research question and articulation of<br />
variables<br />
• Deciding on a sample and how to minimize sample error<br />
• Writing valid and reliable questions<br />
• Deciding on format, methodology and analysis plan<br />
• Revision and redesign of the survey based on field testing<br />
• Matching statistics to the purpose of the survey<br />
• Attending to the ethics of survey administration<br />
• Integrating inquiry, method, and design<br />
• Writing research reports on the survey that people will read<br />
Bibliography<br />
Braverman, M. T., & Slater, J. K. (1996) Advances in survey research. San Francisco,<br />
CA: Jossey Bass.<br />
Czaja, R., & Blair, J. (2005). Designing surveys: A guide to decisions and procedures.<br />
(2 nd ed). Thousand Oaks, CA: Sage.<br />
Dillman, D. (2000). Mail and internet surveys: The total design method. New York, NY:<br />
Wiley.<br />
Fink, A. (1995) The survey kit. Thousand Oaks, CA: Sage.<br />
Fink, A., & Kosecoff, J. (l998) How to conduct surveys ( 2 nd ed.) Thousand Oaks, CA:<br />
Sage.<br />
Fowler, F.J. (2002) Survey research methods (3 rd ed.) Thousand Oaks, CA: Sage.<br />
Fowler, F., & Mangione, T. (1990) Standardized survey interviewing: Minimizing<br />
interview related error. Thousand Oaks, CA: Sage.<br />
Gall, M., Borg, W., & Gall, J. (1996). Education research (6th ed.) New York, NY:
6<br />
Longman.<br />
Grover, R. M. (l989). Survey errors and survey costs. New York, NY: Wiley.<br />
Sudman, S., Badburn, N., & Schwarz, N. (1996) Thinking about answers: The<br />
application of cognitive processes to survey methodology. San Francisco, CA:<br />
Jossey Bass.<br />
Thomas, S. J. (1999) Designing surveys that work: A step by step guide. Thousand<br />
Oaks, CA: Sage.<br />
General Course Expectations<br />
• Because of the accelerated nature of this program, it is crucial that students attend<br />
all classes and study team meetings. If an absence is deemed necessary, this will<br />
be handled on an individual basis.<br />
• Active class and study team participation is an important component.<br />
• Word-processed work is expected unless otherwise indicated.<br />
• All work is to be in the student's own words unless quotation marks and referenced<br />
pages are provided.<br />
• APA style should be used for documentation of references.<br />
• It is expected that work will be turned in on the assigned date. If there is a problem,<br />
please contact the instructor.<br />
• If a student misses a course and wants to continue in the program, the student must<br />
make up the missed course either with another cohort or on campus. There is no<br />
directed study or independent study done through Outreach. Therefore, the student<br />
will have to make a commitment to take the course missed.<br />
• Academic integrity is expected. Refer to the Student handbook.<br />
• <strong>Cardinal</strong> <strong>Stritch</strong> <strong>University</strong> and this instructor wish to positively affirm the intent of the<br />
American Disability Act. Any person enrolling in this course who may require<br />
alternative instructional and/or evaluative procedures due to a disability should feel<br />
free to discuss these needs with the instructors so that appropriate arrangements<br />
can be made.
7<br />
Assignment I<br />
Preplanning Stage Draft of Survey<br />
The goal of this course is for you to write a decent survey. The goal of this assignment<br />
is for you to do the critical preplanning steps.<br />
Name of student:______________________________<br />
Date:_______________<br />
Assessment Criteria<br />
- Does not meet<br />
expectations<br />
Performance<br />
√ Meets<br />
expectations<br />
+ Exceeds<br />
expectations<br />
Your paragraph(s) describe<br />
the topic of the survey. You<br />
give relevant background<br />
information, your purpose,<br />
and proposed subjects.<br />
The research question that<br />
you want to answer by<br />
conducting the survey is clear,<br />
concise (one sentence) and is<br />
linked to topic/background.<br />
The literature review relevant<br />
to the topic is summarized.<br />
Two to five variables are<br />
clearly identified and linked to<br />
the research question and<br />
literature review<br />
You conduct and summarize<br />
the results from the focus<br />
group.<br />
Your draft of survey questions<br />
is linked to your variables and<br />
research question.<br />
You’ve included a preliminary<br />
timeline<br />
Your paper is well organized,<br />
clear and written according to<br />
APA<br />
Grade<br />
A grade of high pass requires that 6 of 8 are in the exceeds expectation column and there are no checks<br />
in the does not meet expectation column. A grade of pass indicates that the majority of<br />
checks are in the meets expectation column.<br />
Comments:
8<br />
Assignment II Final draft of the survey<br />
Name:______________________________<br />
Date:_______________<br />
Comments:<br />
Assessment Criteria<br />
Part 1: your written paper clearly<br />
describes your research<br />
question, variables & how the<br />
variables are related to the<br />
research literature.<br />
Part 1: you have a reasonable<br />
selected sample/ population and<br />
plan for adjusting for error<br />
Part 1: your analysis plan is<br />
coherent and effective and is<br />
linked to your goals and the<br />
survey design.<br />
Part 2: your description of the<br />
field testing is clear<br />
Part 2: your field test statistics<br />
are appropriate to the number of<br />
subjects and the purpose of<br />
your survey<br />
Part 2: You are reflective and<br />
evaluative about what the field<br />
test told you about your survey<br />
Part 3: your revised survey<br />
reflects good practice and<br />
incorporates your field test<br />
analysis<br />
- Does not meet<br />
expectations<br />
Performance<br />
√ Meets<br />
expectations<br />
+ Exceeds<br />
expectations<br />
(in addition to<br />
items in Meets)<br />
You have appropriately<br />
addressed reliability and validity<br />
in your analysis<br />
plan.<br />
Part 4: your letter to participants<br />
reflects is clear and well written<br />
Part 5: your timetable is<br />
reasonable<br />
A grade of high pass requires that 8 of 10 are in the exceeds expectation column and there are no checks<br />
in the does not meet expectation column. A grade of pass indicates that the majority of<br />
checks are in the meets expectation column.
9<br />
Session One<br />
Preplanning<br />
A survey is a major project, involving considerable time and resources. To make sure your<br />
efforts pay off, it is critical that you spend time planning (Suskie, 1996, p.1).<br />
History of surveys<br />
Begin at the beginning: establish the purpose of the survey<br />
1. Do you want to describe a population around a certain subject?<br />
2. Do you want to compare the responses of subgroups?<br />
3. Do you want to explain or explore causality?<br />
Deciding what to measure<br />
1. Decide on the most important ideas that you want to ask (write the research question)<br />
2. Determine the objectives of your survey<br />
3. Test out your ideas on knowledgeable others<br />
4. Form an analysis plan<br />
5. Develop a preliminary timetable<br />
Deciding who to measure<br />
Writing clear questions<br />
1. Writing questions that are good measures of your objectives<br />
2. Writing clear instructions<br />
Putting this all together<br />
Assignments<br />
Individual<br />
1. Read text chapter 1 and 2 before you begin your survey construction. Read chapter 3<br />
before you come to class for session 2.<br />
2. The goal of this course is for you to write a decent survey. Between Session 1 and 2,<br />
you'll do the critical preplanning steps. For session 2, prepare a written paper that has the<br />
following components:<br />
Draft a paragraph(s) which describes the subject of your survey (include relevant<br />
background information, your purpose, proposed subjects. .) From the paragraph,<br />
draft your research question.<br />
In 2 pages, summarize the research literature relevant to the topic. You should<br />
have 3-5 studies reviewed.<br />
From the lit review and research questions, compile and list 2-5 variables.<br />
Connect the variables to the lit review and research questions.<br />
Conduct a focus group with colleagues knowledgeable about your topic.<br />
Summarize the major ideas that emerge from the focus group<br />
Using the focus group results, lit review and research questions, draft survey<br />
questions. Use text chapter 2 as a reference for question construction.
10<br />
<br />
<br />
After your Study Group meeting, redraft questions. Attach redrafted questions to<br />
your written paper.<br />
Construct a preliminary timeline and estimate of costs.<br />
Study Group<br />
The intent of the study group is to provide colleague(s) as critical friends to carefully<br />
review the description paragraph, research question, variables, focus group info, and draft<br />
questions of each member.
11<br />
What do you have so far?<br />
Session Two<br />
Planning<br />
Writing good questions<br />
1. What goes into a good survey question?<br />
2. How to write reliable questions<br />
3. How to write valid questions<br />
Making decisions about the survey<br />
Deciding on a sample<br />
1. Who should you survey?<br />
2. How to define the population<br />
3. How to determine sample size<br />
4. Types of samples (random, systematic, stratified, nonprobability)<br />
5. Minimizing sample error<br />
Deciding on the measurement appropriate to your purpose<br />
1. nominal<br />
2. ordinal<br />
3. interval<br />
Constructing an analysis plan<br />
Independent and dependent variables<br />
The advantages and disadvantages of nominal, ordinal and interval measures<br />
Choosing appropriate statistical techniques for your survey<br />
Pilot-testing the instrument<br />
Assignments<br />
Individual<br />
1. Read text chapters 4, 5 and 6; Ethics Code Appendix A<br />
2. Revise survey based on class feedback<br />
3. Decide on sample population for the pilot<br />
4. Field test the survey on at least 10 people<br />
Bring 6 copies of your revised surveys for colleague help!<br />
Study group<br />
1. Check partner’s survey revision using checklist from text p. 71-2<br />
2. Help with setting up fieldtest
12<br />
Session Three<br />
Analyzing the data<br />
Review<br />
1. Deciding on the measurement appropriate to your purpose and analysis<br />
2. Writing valid and reliable questions<br />
Insuring data accuracy<br />
1. Editing<br />
2. Preparation of the codebook<br />
Designing coding systems and constructing a codebook<br />
Entry of data into the computer<br />
Data cleaning<br />
Data analysis of the pilot<br />
1. Reliability<br />
What is reliability?<br />
Why is reliability important?<br />
Cronbach alpha<br />
2. Validity<br />
What is validity<br />
Why is validity important?<br />
Face, content and construct validity<br />
Development of an analysis plan<br />
1. Descriptive statistics<br />
2. Cronbach<br />
3. Factor analysis<br />
4. Display of data<br />
5. What stats can I use with a bigger N?<br />
inferential statistics<br />
Writing research reports that people will read<br />
Constructing data tables<br />
Power of graphics<br />
Explaining complicated data in clear language<br />
What else to think about?<br />
Measuring the influence of nonresponse<br />
Why increasing sample size does not solve the nonresponse problem<br />
Planning follow-up to accommodate nonresponse issues<br />
Writing effective cover letters<br />
Using incentives to increase response rates<br />
Checking for effective questionnaire formating<br />
Revisiting survey format: differences between web/e-mail, mail and interview<br />
formats
13<br />
<br />
<br />
<br />
<br />
<br />
Designing a clear, uncluttered survey<br />
Collecting demographic information: how much to ask?<br />
Designing questionnaire layouts that make data analysis easier<br />
Deciding how many response options to include<br />
Formats that avoid response bias<br />
Ethics<br />
Assignment<br />
Your written work is due not more than 2 weeks after the completion of session three. Your<br />
survey should be revised and ready to administer to your chosen population. The written<br />
paper includes five parts:<br />
1. The first part is a 2-5 page paper describing your survey including your<br />
research question, the dependent/independent variables, how the variables<br />
are related to the research literature in this area, the population that you are<br />
interested in exploring, how the population was selected (random..), how you<br />
will adjust for error and your proposed analysis plan. The description is a<br />
revision of the assignment submitted for class 2 combined with information<br />
obtained in class 3.<br />
2. The second part describes your field testing and includes a copy of your fieldtested<br />
survey, a copy of the SPSS statistics on the field-test survey and a 1-3<br />
page explanation of pretesting (what did the experience of conducting the field<br />
test tell you? What did the descriptive statistics tell you?)<br />
3. The third part contains a copy of your revised survey with a description of the<br />
decisions that you made on format, question clarity, length and delivery<br />
(paper/computer/interview) of survey.<br />
4. The fourth part includes your letter to your participants which clearly explains<br />
the purpose of your study. Use text p. 73-8 and Appendix 5 as a guide.<br />
5. The final part includes your revised timetable and cost estimate for your<br />
survey. See model text Appendix 2.