pdf 820Kb - INSEAD CALT

Evaluation level
Level 0:
Technical
performance
Level 1:
User’s
acceptance
Level 2:
Functionalities
Level 3:
Transfer
Level 4:
Impact
Level 5:
Economic
performance
Evaluation report of the use of Onto-Logging
platform in the user site
Structuring role
Performance of the
ontology authoring
tools.
Easiness to author
an ontology (create
new concepts &
properties)
Features of the
ontology editor.
Level of adoption of
Ontologies.
Do the structuring
of the knowledge
(via ontology)
brings a better
performance for the
organization.
What is the effort /
benefits to structure
the knowledge
Deliverable ID: D8b
Knowledge processes & Goals
Capitalise
knowledge
Performance of
the DUI
(publisher mode)
and of the MS
Word extensions.
Ergonomics of
entering and
annotating new
documents in the
DUI, and the MS
Word extensions.
Features &
limitation of the
DUI-publishing
function, and of
the MS Word
extensions.
level of
capitalization of
knowledge
Do the
capitalisation of
the knowledge
assets provide
benefit to the
organization.
What is the cost
of capitalizing the
knowledge?
Retrieve
knowledge
Performance of the
DUI (user mode).
General ergonomics
of the DUI.
Capability to display
and manipulate
complex
information.
level of reuse of
existing knowledge
Is the knowledge use
in the organization
less reinvented,
conducing to a more
efficient
organization.
What is the effort /
benefits of searching
the knowledge
(training, support,
etc.).
Table 1: Examples of level evaluation according to the knowledge processes
Page : 30 of 110
Version: 1.0
Date: 27 january 2004
Status: Final
Confid.: Public
Share knowledge
Scala bility of the
multi-ontology
mapping.
3.3.3 The different phases of the evaluation
As indicated in the first section, the evaluation will fulfil three objectives:
• Provide some first feedback to the design process (formative evaluation).
Performance of the
user profile editor
Ergonomics of the
user profile editor.
Scalability of the
multi-ontology
mapping.
Evolutivity of the
User Ontology in
the user profile
editor
level of sharing
knowledge amongst
people
Is the acceleration
of the diffusion of
knowledge inside
the organization
translated to
tangible benefit for
the organization
(reactivity,
flexibility, etc.)?
What is the effort /
benefits to put to
facilitate the
knowledge sharing.
(facilitator,
incentives, etc.)