pdf 820Kb - INSEAD CALT

More documents

Recommendations

Info

Evaluation report of the use of Onto-Logging platform in the user site Deliverable ID: D8b Page : 40 of 110 Version: 1.0 Date: 27 january 2004 Status: Final Confid.: Public The use of more quantitative and “rigorous” methods was actually considered at the beginning of the project, but they were finally discarded, because they would have distracted the attention of evaluating the new usages (the core of the innovation), and would have necessitated too much resource that would have to be taken from the qualitative evaluation. A next chapter of this document will however indicate some directions of how to conduce a more quantitative evaluation that could be envisaged in the future (as an initial stage of a productarisation effort). 4.3 The definition of the instruments and the gathering of the data The Ontologging system has been installed in the three competency centres, and has been tested by a number of employees belonging to theses centres. Questionnaires were the instruments that were the most extensively employed for capturing the data, since this method is relatively simple to set-up, and is particularly well adapted to accomplish a qualitative evaluation. But other methods were also employed to complement this capture such as: focus groups , interviews and experiments. 4.3.1 The context of the evaluation Let’s now enter more in the details of this evaluation by presenting the context in which this evaluation took place. The evaluation of how the Ontologging system is able to support knowledge processes has mainly taken place at INDRA, an important (6000 employees) Information Technology service Spanish company, and to a lesser extent at Meta 4, a smaller IT company designing enterprise software products (such as accounting, people management, knowledge management software). In the following part of this document, we will principally focus our attention on the evaluation that has been conducted at INDRA. The evaluation of the Ontologging system at INDRA has consisted in testing the systems for supporting three activities: • Tendering. This activity consists in the elaboration proposals answering to call for tenders for new IT contracts. • Development Business development activities (looking for new projects, etc). • Technology watch. This activity consists in the elaboration of reports on topics/disciplines that are considered as important for the INDRA organization.
Evaluation report of the use of Onto-Logging platform in the user site Deliverable ID: D8b Page : 41 of 110 Version: 1.0 Date: 27 january 2004 Status: Final Confid.: Public These activities are fulfilled by a horizontal structure of the IN DRA organization (the competency centres), which role is to provide more long-term services to the operational centres (the production centres and the sales lines) of the INDRA organization. Competence centres mission is to lead the innovation of Indra’s services and solutions. These centres provide support to the operational centres (the production centres), and in particular play the role of interface with the business lines (the commercial forces in contact with the clients), lead the innovation and capitalize expertise for INDRA. See the Annex 2 for a detail description of the role of competence centres. Annex 2 also presents an overview of the tendering process at INDRA. (INDRA, 2002) The profiles of the employees participating to the test are diverse (consultants, software analysts, system architects), and the employees originate from different domains (security, ERP, etc.). Besides, different roles can be distinguished such as: • The end-users (focussed on content) o The occasional users. (Main activity: browse and search the content) o The traditional users. (Main activity: browse, search & edit) o The “power” users. (Main role & activity: browse, search, edit & organize) • The Knowledge Managers (focussed on structure) o The technical knowledge manager Main role: set-up and maintain the IT/knowledge infrastructure; activity: set-up, clean, merge, restructure. o The knowledge management consultant / manager. Main role: help to structure the work processes in the organization; Activity: defines ontologies. The size of the group of the users participating in the evaluation has been decided in with the objective of: (1) collecting a reasonable amount of data that will make the result of the evaluation useful and significant; (2) making the evaluation doable (realistic) in the time frame, and with a good level of quality (the running of session can be considered as a relatively “heavy” operation). 4.3.2 The Questionnaires A series of questionnaires has been elaborated to collect the data: • An early questionnaire (given in Spanish), which aim was to make a very early assessment of the situation and of the users’ need. • A pre-questionnaire, which was to get a good understanding of the users participating to the test. • A questionnaire for evaluating the Ontologging knowledge structuring and content population process.
Page 1 and 2: The ONTO-LOGGING Consortium consist
Page 3 and 4: Evaluation report of the use of Ont
Page 5 and 6: Executive Summary Evaluation report
Page 39: Evaluation report of the use of Ont
Page 53 and 54: • List of connected users to the
Page 67 and 68: 5.5.1 Description of the evaluation
Page 69 and 70: 6 Discussion and Conclusions Evalua
Page 75 and 76: 8 Annex Evaluation report of the us
Page 91 and 92:
Evaluation report of the use of Ont
Page 93 and 94:
esolver consultas. C42 Existen axio
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
1 The functionalities provided by D
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
show all

pdf 820Kb - INSEAD CALT

Create successful ePaper yourself

Delete template?

Save as template?