icegov2012 proceedings

A structure oriented evaluation model for readiness of egovernance
Uranchimeg Tudevdagva
Mongolian University of Science and Technology
Ulaanbaatar-46
976-11-323579
uranchimeg@must.edu.mn
ABSTRACT
This paper deals with a measure theoretical method for evaluation
of logically describable target structures.
The presented evaluation approach includes the following steps:
key targets definition , sub targets description, general target
structure formulation, selection of fitting assessment instrument,
development of an adapted questionnaire or check list, data
collection, data processing in sense of our general
evaluation model and report of results.
The advantage of presented model is that it is very versatile for
applications where the target can be described by a logical target
structure. By the measure theoretical background the evaluation is
very objective. The scoring method in the whole becomes open,
comprehensible and traceable.
Categories and Subject Descriptors
K.3.2 [COMPUTERS AND EDUCATION]: Computer and
Information Science Education – Self-assessment.
General Terms
Management, Measurement, Performance, Standardization,
Verification.
Keywords
Evaluation, evaluation model, evaluation theory, e-governance, egovernance
assessment, logical target structure, scoring method,
assessment method.
1. INTRODUCTION
E-governance is a complex topic which covers very different
fields with own characteristics and special aims. If we want to
score or to evaluate how a special sector of e-governance is
achieving the given aims, corresponding or adapted evaluation
approaches are required.
Each consistent formulated aim possesses a logical inner
structure. Hence, basic property of any evaluation approach
should be that the method is compatible to logical structure of
Permission to make digital or hard copies of part or all of this work for
personal or classroom use is granted without fee provided that copies are
not made or distributed for profit or commercial advantage and that copies
bear this notice and the full citation on the first page. Copyrights for
components of this work owned by others than ACM must be honored.
Abstracting with credit is permitted. To copy otherwise, to republish, to
post on servers or to redistribute to lists, requires prior specific permission
and/or a fee.
ICEGOV '12, October 22 - 25 2012, Albany, NY, USA
Copyright 2012 ACM 978-1-4503-1200-4/12/10...$15.00
454
Uyanga Sambuu
National University of Mongolia
Ulaanbaatar-46
976-11-320159
uyanga@magicnet.mn
aims which we want to achieve. In this sense each evaluation
begins with an analysis of the logical structure of key aims under
consideration. If the logical structure of key aims is clear we can
try to score how the aim has been achieved by measurement
methods as they are applied in natural sciences, technique and
other fields, too. Theoretical background or basis of
corresponding methods of measurement is the general measure
theory (see e.g. [1]).
This paper presents a measure theoretical evaluation model which
is oriented at the logical structure of key aims for scoring
readiness of e-governance.
The frequently applied additive models do not include an
adequate reference to the logical structure of target. Readiness
assessments provide important information to policy and decision
makers for strategic planning of e-governance and its
implementation [5].
2. LOGICAL STRUCTURE AND
EVALUTAION MODEL
To evaluate how a special aim has been achieved we have to
analyse the logical structure of considered target. We have to
think about, what are the key targets, what are sub targets, what
we want to evaluate or to check, how the key and sub targets are
logically connected with each other.
For instance, we want to score how successful the targets in sense
of the online service index have been reached. This index is one
of the three basic indices which is included into the calculation of
the E-Government-Readiness-Index. Then we have first to find
out the key targets. For this we assume, we have six key targets.
We denote these targets by B1, B2, B3, B4, B5 and B6 and we
suppose that our main target C is reached if all of our six key
targets are reached.
B1 B2 B3 B4 B5 B6
Figure 1. Logical structure of key targets
The target C is not reached if at least one of key targets is not
reached. Then the main target C can be described as the logical
intersection of key targets B1, B2, B3, B4, B5, B6 and we have
!
𝐶 = 𝐵 ! ∩ 𝐵 ! ∩ 𝐵 ! ∩ 𝐵 ! ∩ 𝐵 ! ∩ 𝐵 ! = !!! 𝐵 ! .
This is visualized by Figure 1 via a series circuit.