pdf 820Kb - INSEAD CALT

More documents

Recommendations

Info

Evaluation report of the use of Onto-Logging platform in the user site Deliverable ID: D8b Page : 20 of 110 Version: 1.0 Date: 27 january 2004 Status: Final Confid.: Public their definition as well as building evidence, which measure them in each case. Another step is verifying that the emergent relationships between constructs fit with the evidence in each case. Enfolding Literature. Linking results to the literature is crucial in theory building research because the findings often rest on a very limited number of cases. Reaching Closure. Two issues are important in reaching closure: when to stop adding cases and when to stop iterating between theory and data. In both cases, researchers should stop when a theoretical saturation is reached. That is when the incremental improvement to the theory is minimal.
Evaluation report of the use of Onto-Logging platform in the user site Deliverable ID: D8b 3 Evaluating the Ontologging System Page : 21 of 110 Version: 1.0 Date: 27 january 2004 Status: Final Confid.: Public This section of the document will present now how the principles that have been presented previously are being applied for the evaluation of the Ontologging knowledge management system. 3.1 Overview The evaluation of the Ontologging project will consist in the use of a combination of different techniques described in the previous section and in particular: (1) predictive methods aiming at exploiting the expertise and know-how present in the consortium related to knowledge management (both from a technical and an organizational perspective) and Ontology; (2) user opinion methods aiming at integrating the user’s needs (and not the user’s want) into the proposed system, as well as validating the substantive value of the approach proposed to the users; (3) observational methods and test and experimental methods aiming at assessing the capability of the designed system to fulfil the objective of the system, as well as its adoption, both from a technical and organizational perspective (overcoming resistance to change) by the users. The result of the evaluation will be used for the following purpose: • To help the design process. Indeed, Ontologging uses an iterative process (spiral of analysis of needs, specification, testing of result, adjustment) in which the system is progressively detailed (versus the top-down V design process). The feedback from the evaluation will help the process of definition and adjustment of the system. • To assess the substantive value of the system that is being generated, and to guaranty that the focus of the project is not lost in favour of other sub-goals (such as technical goals) and remain consistent with the original high level objectives. As indicated in the previous section of this document, different phase will be used for the evaluation of Ontologging: • The formative evaluation phase. The objective of this phase is to provide a first feedback that will flow into the design of the system. This phase will mainly be done via the collection of users’ and expert opinion (via questionnaire, interview), as well as the initial testing of the mock-up / early version of the prototype for validating the main ideas (versus testing the functionalities). • The summative evaluation phase. The objective of this phase is to assess the functioning of the system. This phase will start with the availability of the first version of the prototype (and not the mock-up), and will aim at assessing the different functions of the system, both according to its performance, the richness of the functionality, and their ease of use. The methods used will mainly be based on users’ opinion (related to ergonomics), as well as on the organization of specific test for evaluating the different functions of the system (such as the authoring of ontologies, the population of content, the search for content and of collaborative capabilities)
Page 1 and 2: The ONTO-LOGGING Consortium consist
Page 3 and 4: Evaluation report of the use of Ont
Page 5 and 6: Executive Summary Evaluation report
Page 19: Evaluation report of the use of Ont
Page 53 and 54: • List of connected users to the
Page 67 and 68: 5.5.1 Description of the evaluation
Page 69 and 70: 6 Discussion and Conclusions Evalua
Page 71 and 72:
Evaluation report of the use of Ont
Page 73 and 74:
Page 75 and 76:
8 Annex Evaluation report of the us
Page 77 and 78:
Page 79 and 80:
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
Page 93 and 94:
esolver consultas. C42 Existen axio
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
1 The functionalities provided by D
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
show all

pdf 820Kb - INSEAD CALT

Create successful ePaper yourself

Delete template?

Save as template?