22.08.2015 Views

The Program Evaluation Standards in International Settings

The Program Evaluation Standards in International Settings - IOCE

The Program Evaluation Standards in International Settings - IOCE

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

14 Sandy Tautpower, roles and resources as desirable and legitimate. People are socialized to comply with theirroles and the obligations related to each role. Society often penalizes people for fail<strong>in</strong>g tocomply with the obligations imparted by their social status (Berry et al., 1997, Vol. 3, p. 79).Thus, paradoxically, what the <strong>Standards</strong> list as Common Errors may serve as Guidel<strong>in</strong>es <strong>in</strong> highhierarchy cultures, e.g., when stat<strong>in</strong>g: "Assum<strong>in</strong>g that persons <strong>in</strong> leadership or decision-mak<strong>in</strong>groles are the only, or most important, stakeholders." (Jo<strong>in</strong>t Committee, 1994, p. 26. For example,for South Korea, Jang (2000, p. 10) po<strong>in</strong>ts out that “the project focus is likely to be determ<strong>in</strong>edby the specific client group that supports and controls the project.” Throughout her analysis ofthe applicability of the <strong>Standards</strong> <strong>in</strong> South Korean society, Jang stresses the importance of thefocus on the top client group (see Jang, 2000, pp. 10) and she concludes that “evaluators […]need to meet only the immediate stakeholder’s expectations” (p. 24).U2 Evaluator Credibility <strong>The</strong> persons conduct<strong>in</strong>g the evaluation shouldbe both trustworthy and competent to perform the evaluation, so that the evaluationf<strong>in</strong>d<strong>in</strong>gs achieve maximum credibility and acceptance.<strong>The</strong> second Utility Standard U2, Evaluator Credibility, also touches upon culturallyrelevant value dimensions. As po<strong>in</strong>ted out before by Smith et al. (1994, p. 7), the concept of aprofessional differs across cultures (e.g., between Malta, India, and the U.S.). <strong>The</strong>y state that “<strong>in</strong>the U.S., a professional is someone who […] has acquired a certa<strong>in</strong> expertise [which] isofficially acknowledged through certification and licensure […],” whereas <strong>in</strong> Malta, “the notionof professional is much looser […].” In India, “‘Professionalism’ is not a common word and tothe orthodox or older generation it connotes a lack of love for the job […]. Professionalism hasnoth<strong>in</strong>g to do with the level of one’s expertise” (p. 7). Consequently, the notion of ‘competence’as specified <strong>in</strong> the <strong>Program</strong> <strong>Evaluation</strong> <strong>Standards</strong> (see Jo<strong>in</strong>t Committee, 1994, p. 31) is not aprerequisite for an evaluator’s credibility across all cultures. <strong>The</strong> characteristics that causeclients to judge the professional evaluator as competent and trustworthy differ across cultures.For example, cross-cultural organizational psychology uses the pr<strong>in</strong>ciple of seniority to describedifferences <strong>in</strong> authority held by members of an organization (Berry et al., 1997, Vol. 3, p. 379).Accord<strong>in</strong>g to this pr<strong>in</strong>ciple, older people are per se attributed a higher degree of competence <strong>in</strong>certa<strong>in</strong> cultures, regardless of other factors also <strong>in</strong>fluenc<strong>in</strong>g competence, e.g., level of education(see Jang 2000, p. 26). <strong>The</strong> social status of a person (often positively correlated with age) alsoaffects the attribution of competence and trustworth<strong>in</strong>ess <strong>in</strong> certa<strong>in</strong> cultures, contrary to a moreachievement-oriented, <strong>in</strong>dividualistic approach to professional worth<strong>in</strong>ess. <strong>The</strong> latter is conveyed<strong>in</strong> the <strong>Standards</strong> when stat<strong>in</strong>g that "evaluators are credible to the extent that they exhibit thetra<strong>in</strong><strong>in</strong>g, technical competence, substantive knowledge, experience, <strong>in</strong>tegrity, public relationsskills, and other characteristics considered necessary by clients […]" (Jo<strong>in</strong>t Committee, 1994, p.31). For example, Jang (2000, p. 11) notes that the well-known “name” of the evaluator is thebasis for be<strong>in</strong>g considered competent by South Korean clients. As another example, an Indianevaluator (see Hendricks & Conner, 1995, p. 83) describes his culture as one <strong>in</strong> which“personalized relationships and connections matter more than public <strong>in</strong>terest,” so that “a nexus

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!