Link to thesis. - Concept - NTNU

21In line with Flyvbjerg (2006b), the value of the studies presented here depends on the validityclaims that can be made for them and on the status these claims attain in concert with otherrelevant validity claims. In other words, the value of a research output is based on existingknowledge and depends on the reactions to the study by other researchers. As noted above, thesupport from existing research in validating results constitutes a challenge due to the lack ofprevious relevant studies in this particular area. This leads to the conundrum of how to assess thevalidity of the research if there are no opportunities for verification beyond what is presented inthis thesis. In general, I contend that this work can by no means be described as the first and onlyinstance of an attempt to break new ground. The validity of the results obtained by the researcheffort consequently cannot be judged by previous research achievements alone. A logical startingpoint is to assess reliability, which is a necessary contributor to validity. That said, it should bepointed out that the sets of samples of projects dealt with in the studies discussed in this thesisare too small to permit the use of statistical tests of consistency and co-variation of data. 7 Thequestion is then of the degrees to which sample representativeness and careful execution of datacollection and analysis are satisfied. If the intent of this work was to seek generalizable patternsand draw distinct conclusions concerning the management of large projects, the findings wouldbe biased by the selection of public projects planned and executed in Norway. However, as statedabove, the purpose has been to explore the field of up-front assessment and quality assurance ina relatively broad manner. It is assumed that the choice of projects planned and executed underthe same regulatory and construction regime are subjected to independent examination beforethey are authorized for execution, although individual projects and their contextual settings maybe diverse.Further, an assessment of validity requires reflections on the extent to which the researchpresented in this thesis is epistemologically robust 8 and the extent to which the analysis andfindings contribute to the understanding of projects and their management.The chances that findings and interpretations will be found credible may be improved throughtriangulation, which is the hypothesis that greater confidence may be placed in a result if differentsources, methods and approaches lead to it. It is, according to Denzin (1989:237):”…varieties ofdata, investigators, and theories, as well as methodologies.” In other words, triangulation involves thecombining data from many sources, studying phenomena from various aspects using differingtheories and including several investigators and methods for data collection and analysis. This isbrought out in Figure 3 that includes the possibilities for triangulating data. The data werecollected by different method guided by different approaches, as summarized in Section 2.3.The work presented here entails several samples. Hence, reference is made to the attached papersfor detailed discussions of reliability. Such issues are highlighted where they occur. However, itmay be said that the samples included all projects for which data were considered valid andreliable. The implication for studies that involve comparison of estimates is that data wereaccessed from the written reports of quality assurance exercises, were verified by governmentdocuments, and, if deemed necessary, were verified separately through project contact by theprimary investigator.The types and number of sources from which information is extracted also may elevate thequality of research output through triangulation. Clearly, this work has benefited from access to a7 However, in some studies, the question of sample size can be said to be irrelevant, because a case study approach isemployed, meaning that looking at a small number of cases is a matter of choice of design.8 Epistemological robustness is derived from epistemology, the theory of knowledge, and an assessment of suchincludes judgment of methods validity and scope.