Proceedings of the 12th European Conference on Knowledge ...

Nadine Amende
The category data analysis refers to frequently used techniques e.g. structural equation modelling,
regression analysis, factor analysis, variance analysis, cluster analysis and t-test (Urbach et al. 2008).
Both categories permit to analyse reliability, internal and external validity <strong>of</strong> <strong>the</strong> empirical studies.
3.3.2 Results <strong>of</strong> literature analysis
The results (see figure 3) show that use <strong>of</strong> consolidated IS success models is weak. Only 2 studies
used cognitive fit <strong>the</strong>ory and 1 <strong>the</strong> task technology fit model as foundation. The use <strong>of</strong> <strong>the</strong>oretical
models can improve analysing utility and its influencing factors. These models permit a structured and
holistic analysis <strong>of</strong> influencing factors and causal relationships. They depict already investigated and
validated influencing factors and causal relationships. Due to <strong>the</strong>ir popularity, many studies exist
presenting measures and approaches for evaluation. Measures <strong>of</strong> <strong>the</strong>se common models can be
adapted for information visualisation research.
A more in-depth analysis <strong>of</strong> influencing factors reveals that most studies only analyse influences by
varying visualisation types (31) and additionally task complexities (12). Most used endogenous
variables are effectiveness (29) and efficiency (29) measured by task correctness and time. O<strong>the</strong>r
exogenous and endogenous variables contained in IS success models like voluntariness, subjective
norm and satisfaction or acceptance etc. also have to be investigated for deeper understanding <strong>of</strong>
utility. Thus, validated IS success models support a rigor evaluation process and have to be used to
measure geovisualisation utility.
Fur<strong>the</strong>rmore, <strong>the</strong> literature analysis depicts that only conceptual maps (20) are frequently analysed
and visualisation <strong>of</strong> search results is weakly considered. These two issues substantiate <strong>the</strong> research
objective to analyse utility <strong>of</strong> geomaps for information seeking.
Dominant research perspective is <strong>the</strong> individual (31) user (23) perspective, which results from usercentered
information visualisation design strategy. However, measuring organisational benefit is hard.
There are many factors (e. g. market situation), which can influence organisational benefit. So it is
difficult to infer visualisation systems influence exclusively. Due to that, we will also focus on <strong>the</strong>
individual user perspective.
Most common research design is laboratory experiment (32) and variance analysis (21) or simple ttest
(14). Laboratory experiments are a good way to analyse influencing factors <strong>of</strong> utility and causal
relationships. Thus, this will be used to achieve <strong>the</strong> research objective.
4. Findings <strong>of</strong> preliminary think-aloud-study
The Think aloud method is more and more used in evaluation <strong>of</strong> human computer interfaces (Denning
et al. 1990). Being traditionally used as a psychological research method, participants are observed
whilst <strong>the</strong>y are using a system to perform various predetermined tasks (Ericsson/Simon, 1984). The
participants have to verbalise <strong>the</strong>ir thoughts and comments. These comments and thoughts are <strong>the</strong>n
analysed to identify problems in system usage behaviour.
We used a preliminary think-aloud-study and post session questionnaire to explore information
seeking behaviour and requirements and to show relevance <strong>of</strong> <strong>the</strong> research objective. Findings <strong>of</strong> this
explorative study will <strong>the</strong>n be used to formulate hypo<strong>the</strong>ses for <strong>the</strong> laboratory experiment and as
basic requirements for a geo map prototype. The following research questions were:
Are end users satisfied with current search functionalities?
Are end users satisfied with expenditure <strong>of</strong> time?
Which search criteria are important to find relevant apartments?
How helpful are geo maps?
Do geo maps improve effectiveness and efficiency to find relevant apartments?
The think aloud study involved 16 experienced computer users. They indicated that <strong>the</strong>y used
computers daily. The participants were randomly split into two groups. Participants were introduced to
<strong>the</strong> think-aloud-method and <strong>the</strong> task. The task involved using a common real estate web site to
search for apartments. The search results were visualised as a list. One group had to search for
apartments in a known city. The o<strong>the</strong>r group had to search for apartments in an unknown city. The
participants worked individually and were encouraged to think aloud. The examiner used questions
1029