27.06.2013 Views

Proceedings of the 3rd European Conference on Intellectual Capital

Proceedings of the 3rd European Conference on Intellectual Capital

Proceedings of the 3rd European Conference on Intellectual Capital

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Peter Marshall and Damian Gord<strong>on</strong><br />

reporting or as means <str<strong>on</strong>g>of</str<strong>on</strong>g> critiquing <str<strong>on</strong>g>the</str<strong>on</strong>g> performance <str<strong>on</strong>g>of</str<strong>on</strong>g> o<str<strong>on</strong>g>the</str<strong>on</strong>g>rs. An advantage <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> retrospective<br />

approach is that video can be paused or run at slow speed to allow time for <str<strong>on</strong>g>the</str<strong>on</strong>g> SME to provide full<br />

explanati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> decisi<strong>on</strong> making processes involved. This is particularly useful in dynamic domains<br />

(ibid). In <str<strong>on</strong>g>the</str<strong>on</strong>g>se experiments, <str<strong>on</strong>g>the</str<strong>on</strong>g> retrospective versi<strong>on</strong> is used. The SME will be presented with a<br />

series <str<strong>on</strong>g>of</str<strong>on</strong>g> videos <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> associated techniques being performed in a competiti<strong>on</strong>. The expert is <str<strong>on</strong>g>the</str<strong>on</strong>g>n<br />

asked to provide a commentary, critiquing <str<strong>on</strong>g>the</str<strong>on</strong>g> techniques <str<strong>on</strong>g>of</str<strong>on</strong>g> o<str<strong>on</strong>g>the</str<strong>on</strong>g>rs as <str<strong>on</strong>g>the</str<strong>on</strong>g>y perform. To minimise <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

impact <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> knowledge acquisiti<strong>on</strong> bottleneck, dem<strong>on</strong>strati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> technique will not recorded by <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

knowledge engineer but randomly selected from examples <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> techniques being successfully<br />

performed from <str<strong>on</strong>g>the</str<strong>on</strong>g> Internet.<br />

3.4.3 Triadic elicitati<strong>on</strong> using video technology<br />

Triadic elicitati<strong>on</strong> is a KE technique used to capture <str<strong>on</strong>g>the</str<strong>on</strong>g> way in which an expert views <str<strong>on</strong>g>the</str<strong>on</strong>g> c<strong>on</strong>cepts in<br />

a domain. Traditi<strong>on</strong>ally, a knowledge engineer populates an experimental set with c<strong>on</strong>cepts from <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

domain under c<strong>on</strong>siderati<strong>on</strong> during <str<strong>on</strong>g>the</str<strong>on</strong>g> KE sessi<strong>on</strong>. Next <str<strong>on</strong>g>the</str<strong>on</strong>g> knowledge engineer presents three<br />

random c<strong>on</strong>cepts within <str<strong>on</strong>g>the</str<strong>on</strong>g> set to SME. Up<strong>on</strong> presentati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g>se c<strong>on</strong>cepts, <str<strong>on</strong>g>the</str<strong>on</strong>g> SME selects two <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

<str<strong>on</strong>g>the</str<strong>on</strong>g> three that <str<strong>on</strong>g>the</str<strong>on</strong>g>y would c<strong>on</strong>sider <str<strong>on</strong>g>the</str<strong>on</strong>g> most similar and explain why. This differentiating factor will<br />

identify a characteristic <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> overall set <str<strong>on</strong>g>of</str<strong>on</strong>g> c<strong>on</strong>cepts being c<strong>on</strong>sidered. In this research, a modified<br />

versi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> this technique was presented in which <str<strong>on</strong>g>the</str<strong>on</strong>g> c<strong>on</strong>cepts from <str<strong>on</strong>g>the</str<strong>on</strong>g> field were replaced by video<br />

variati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> MMA technique being performed in competiti<strong>on</strong>. As with <str<strong>on</strong>g>the</str<strong>on</strong>g> Commentary technique<br />

detailed above, randomly selected videos found <strong>on</strong>line will be used, thus making <str<strong>on</strong>g>the</str<strong>on</strong>g> experiment<br />

repeatable as well as to minimise <str<strong>on</strong>g>the</str<strong>on</strong>g> effect <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> knowledge acquisiti<strong>on</strong> bottleneck. Although <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

traditi<strong>on</strong>al method <str<strong>on</strong>g>of</str<strong>on</strong>g> triadic elicitati<strong>on</strong> does not elicit procedural knowledge, it was <str<strong>on</strong>g>of</str<strong>on</strong>g> interest to see<br />

how <str<strong>on</strong>g>the</str<strong>on</strong>g> modified versi<strong>on</strong> exposed different types <str<strong>on</strong>g>of</str<strong>on</strong>g> knowledge during <str<strong>on</strong>g>the</str<strong>on</strong>g> KE sessi<strong>on</strong>s.<br />

3.4.4 Cognitive walk-through<br />

The Cognitive Walk-Through is a KE technique where <str<strong>on</strong>g>the</str<strong>on</strong>g> SME articulates <str<strong>on</strong>g>the</str<strong>on</strong>g>ir knowledge<br />

c<strong>on</strong>currently whilst working through a problem or a task (Wright & Ayt<strong>on</strong>, 1987). Similar to <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

Commentary technique, this method is performed c<strong>on</strong>currently and enables knowledge engineers to<br />

observe <str<strong>on</strong>g>the</str<strong>on</strong>g> thought process <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> SME during <str<strong>on</strong>g>the</str<strong>on</strong>g> performance <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> task. This is a powerful<br />

technique in <str<strong>on</strong>g>the</str<strong>on</strong>g> identificati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> knowledge elements and steps. According to Ericss<strong>on</strong> and Sim<strong>on</strong><br />

(1980), <str<strong>on</strong>g>the</str<strong>on</strong>g> c<strong>on</strong>current verbalisati<strong>on</strong> element provides a complete report <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> knowledge being<br />

dem<strong>on</strong>strated as no thought, feeling, or acti<strong>on</strong> is omitted from <str<strong>on</strong>g>the</str<strong>on</strong>g>ir account. In tasks where significant<br />

cognitive effort is required, this method may interfere with <str<strong>on</strong>g>the</str<strong>on</strong>g> SME‟s performance. As a means <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

negating this limitati<strong>on</strong>, a retrospective variant can be employed where <str<strong>on</strong>g>the</str<strong>on</strong>g> SME provides a<br />

commentary <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g>ir thought processes whilst observing <str<strong>on</strong>g>the</str<strong>on</strong>g>mselves performing <str<strong>on</strong>g>the</str<strong>on</strong>g> task. However<br />

this variant does not provide <str<strong>on</strong>g>the</str<strong>on</strong>g> knowledge engineer direct access to <str<strong>on</strong>g>the</str<strong>on</strong>g> decisi<strong>on</strong> making process as<br />

it happens. For <str<strong>on</strong>g>the</str<strong>on</strong>g> purpose <str<strong>on</strong>g>of</str<strong>on</strong>g> this research, <str<strong>on</strong>g>the</str<strong>on</strong>g> c<strong>on</strong>current versi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> technique was employed.<br />

3.5 Analysis <str<strong>on</strong>g>of</str<strong>on</strong>g> captured knowledge<br />

Once <str<strong>on</strong>g>the</str<strong>on</strong>g> KE sessi<strong>on</strong>s were completed, <str<strong>on</strong>g>the</str<strong>on</strong>g> next step was to analyse <str<strong>on</strong>g>the</str<strong>on</strong>g> produced protocol from <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

KE sessi<strong>on</strong>s. For each technique, a transcript was produced from <str<strong>on</strong>g>the</str<strong>on</strong>g> resulting protocol. The next step<br />

in will be to analyse <str<strong>on</strong>g>the</str<strong>on</strong>g> n<strong>on</strong>-verbal articulati<strong>on</strong>s, <str<strong>on</strong>g>the</str<strong>on</strong>g> movements used by SME in <str<strong>on</strong>g>the</str<strong>on</strong>g> dem<strong>on</strong>strati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

technique were articulated and <str<strong>on</strong>g>the</str<strong>on</strong>g>n merged. From this, <str<strong>on</strong>g>the</str<strong>on</strong>g> intersecti<strong>on</strong>s from this produce a model <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

<str<strong>on</strong>g>the</str<strong>on</strong>g> knowledge being dem<strong>on</strong>strated.<br />

3.6 Metrics for comparis<strong>on</strong><br />

Once <str<strong>on</strong>g>the</str<strong>on</strong>g> individual knowledge artefacts had been analysed <str<strong>on</strong>g>the</str<strong>on</strong>g> next step will be to compare <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

different techniques against o<str<strong>on</strong>g>the</str<strong>on</strong>g>r. In this we can make interesting comparis<strong>on</strong>s between <str<strong>on</strong>g>the</str<strong>on</strong>g> KE<br />

elicitati<strong>on</strong> techniques as well as <str<strong>on</strong>g>the</str<strong>on</strong>g> initial dem<strong>on</strong>strati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> technique. As described above two types<br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> knowledge were identified as being <str<strong>on</strong>g>the</str<strong>on</strong>g> aim <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> elicitati<strong>on</strong> sessi<strong>on</strong>s, procedural knowledge, in<br />

terms <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g> steps required to perform <str<strong>on</strong>g>the</str<strong>on</strong>g> techniques, and strategic knowledge, in terms <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g><br />

situati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> when <str<strong>on</strong>g>the</str<strong>on</strong>g> <str<strong>on</strong>g>the</str<strong>on</strong>g>se techniques could be performed. The following measures were extracted<br />

from <str<strong>on</strong>g>the</str<strong>on</strong>g> elicitati<strong>on</strong> sessi<strong>on</strong>s.<br />

Procedural Knowledge articulated verbally<br />

Procedural knowledge articulated n<strong>on</strong>-verbally<br />

Strategic knowledge articulated verbally<br />

226

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!