final version of the self-study document - Keuka College's Middle ...

Program and the Keuka Vietnam Program. For example, the same learning goals exist in
the overseas Business programs as in the traditional program in New York.
Consequently, the assessment measures are aligned among all three general locations
(i.e., Keuka Park, China, Vietnam), with all students completing the capstone course BUS
444 Strategic Management and taking a comprehensive business exam covering the
functional components of business, administered at the completion of the capstone
course.
Annual assessment reports for the Keuka China Program (KCP) reveal significant
challenges of meeting the target goals for the comprehensive business exam, linked to
English language proficiency and some coursework reflecting American principles and
practices. This exam has been a struggle for students since piloting in Dec. 2008, and as
a result, the test items were revised and a number of questions were eliminated. Poor
results in subsequent years were a factor in the revision of the curriculum in 2010 and the
implementation of curriculum mapping and syllabus template updates in 2011 and 2012
to focus on student learning outcomes. This year the spring faculty workshop will focus
on assessment at course level, with an aim to build up the English vocabulary, content
knowledge and analytical skills needed for business in general and for the comprehensive
exam in particular. The Business Division is also considering the adoption of a different
exam for 2013.
Analysis of the second direct measure of program outcomes, the capstone project in BUS
444 Strategic Planning, shows that 90% of all students (n=784) met the criteria for
success (a grade of C). Indirect measures employed in the Keuka China Program include
the Comprehensive Alumni Assessment Survey and the National Survey of Student
Engagement. Customized relevant questions were combined into the Chinese student
survey that Keuka administered online in May 2012 to students from the entering classes
of 2008, 2009, 2010 and 2011, with a response rate of 701 students or 24%. The overall
question measuring student satisfaction with the program was “If you had to do it all
over, would you attend the Keuka Program?” The target is for 80% of students to
respond positively, across all Keuka China campuses. Overall, Keuka met its goal for
2012, with 88.4% of respondents said they would definitely (51%) or possibly (38%)
attend the Keuka China program again. (In 2010, 6% had said they would not choose
Keuka again, and in 2011, 17.5% had said they would not attend the Keuka China
program again.) Other questions reflected student engagement, with 70% of students
responding positively that they experienced intellectual growth; a focus on experiential
learning, with 98% saying they worked with other students on class projects; and variety
in learning style, with student responses reflecting a distribution of student experience
over a range of learning styles rather than on one dominant type. Retention and
graduation rates are a reflection of the faculty and student efforts throughout the program,
and the overall cumulative graduation rate for the program from 2003-2012 is 85%.
Recent improvements that were implemented in 2011-2012 include providing a study
guide for the comprehensive exam to KCP students, more tightly constructed syllabus
templates with assessment measures tied more explicitly to course outcomes, and
development of a common rubric for the final project, with sharing of work samples that
Page 21 of 31 Chapter 4: Inst. Effectiveness & Assessment