A standardised Systematic Critical Literature Review ... - OpenGrey

GL6 Panel One : Knowledge Management and Dissemination
Tuesday, 9:00 – 10:00 AM
Chasing the Grey Evidence; A standardised
Systematic Critical Literature Review Approach
J. Knight, G. Reid, P. Simkhada, L. Wyness and L. Mandava
Aberdeen Medical School
This paper advocates that the triangulation of evidence to give a direction for planning should
include the distillation of experience and information that abounds in unpublished reports.
Evaluating complex interventions using only high level of evidence from peer reviewed
published papers may limit the ability to assess effectiveness, however there is a lack of a
standard robust approach to reviewing the grey literature. The way forward is the development
of a ‘Systematic Critical Literature Review’ SCLR (which was originally developed for trial data),
applicable to such grey literature, which systematically collates the literature and has a
validated framework to assess the quality of the evidence.
To assess the need for developing a review methodology for grey literature, - a Grey SCLR, a
standard SCLR on published literature on childhood malnutrition in humanitarian complex
emergencies was undertaken and assessed for completion of the evidence base. A mechanism
of systematically collating the grey literature within this subject was developed and yield
assessed. This method was based on standard SCLR methodology and values, and key terms
from a previous standard SCLR on published literature carried out by our research group were
used. Secondary references and expert opinions were also sought. The theoretical quality
assurance literature was reviewed to form a basis towards developing a quality framework
applicable across the different types of un-published reports and studies.
A standard SCLR is theoretically applicable to complex situations. But in such situations an
evidence base cannot be created by even a highly sensitive standard SCLR on published
literature. The majority of information is in the grey literature and a review of such should
have the main values and the key steps equivalent to a standard SCLR for published literature.
Three stages were developed: 1. Review of peer-reviewed publications 2. Application of key
words to web based grey literature search; 3.Further refinement of search following
identification of key organisations through stage 2; 4. Search through experts within key
organisations identified. The value of the evidence found was assessed against the stages of
the methodology developed and against the key steps of a standard SCLR.
The theories of quality assurance gave key concepts, which were developed into a quality
framework for the un-published literature. This was then piloted and reliability and context
validity sought.
Grey literature is an essential part of the evidence base for practice in complex interventions,
which may have multi-stakeholders, have multi-variables, have a lack of predictability and
robust data and require a broad literature approach. An outcome from a standard SCLR in such
a complex field is not robust and so this ‘Grey SCLR’ was further developed to increase the
required effectiveness and breadth of a literature review, but based on the objectivity of a
standard SCLR. A developed Grey SCLR should be transferable to inform evaluations of other
complex interventions and can complement a review of the published studies.
64

GL6 Panel One : Knowledge Management and Dissemination
Tuesday, 9:00 – 10:00 AM
Author Information:
Dr. Padam Simkhada (B. Ed., M.Sc., PhD) is working as an International Research Fellow in
the Department of Public Health at the University of Aberdeen UK. Padam graduated from
Tribhuvan University, Nepal. He completed a M.Sc. in Health Promotion from Brunel University,
London in 1999 and PhD from Southampton University UK in 2002. Padam worked for Ministry
of Health in Nepal and Save the Children (UK) for several years. He has long experience in
reproductive and sexual health issues, particularly in the areas of HIV/AIDS.
Padam Simkhada’s main research interest is in international health, working on migration, sex
trafficking and sexual health. He has great interest in the use of grey literature to inform
evidence-based decision-making in the field of emergency nutrition. He is convener of
International Health Interest Group in Aberdeen.
Dr. Jane Knight (BSc, MB ChB, MPH, MFPHM) trained as a Consultant in Public Health
Medicine in Scotland. Her background includes National Health Service Board research. She
now holds a joint post for food borne disease and nutrition as Clinical Senior Lecturer at the
University of Aberdeen and Public Health Medical Advisor for the Food Standards Agency
Scotland. In addition she is an Honorary Consultant at the Scottish Centre for Infections and
Environmental Health.
The combination of an academic approach to service lead research, and training in public
health disaster relief has resulted in a developing public health epidemiological research
portfolio in malnutrition in complex emergencies. Jane leads a research group Partners
Research Emergency Nutrition PREN, collaborating with humanitarian Non Government
Organisations. From her research experience assessing evidence required for policy decisions
within complex situations, both within UK and in the international humanitarian field, her
research work now has a focus on methodological development required for assessing the
evidence from the grey literature.
Laura Wyness (BSc, MSc) graduated with a BSc Health Sciences degree from the University
of Aberdeen in 2000. Following this she worked as a Research Assistant on several systematic
reviews and trials within the Health Economics Research Unit (HERU) and the Health Services
Research Unit (HSRU) at the University of Aberdeen.
Laura gained an MSc in Public Health & Health Services Research (with distinction) in 2003
from the University of Aberdeen. Her MSc dissertation, carried out within the PREN group
(Partners for Research into Emergency Nutrition) was on “developing an evidence-based tool
for redefining an approach to severe malnutrition in complex emergencies”.
In 2003 she was awarded an MRC (Medical Research Council) scholarship to carry out a PhD in
the Public Health Department, University of Aberdeen. The PhD is being carried out in the area
of severe adult malnutrition in complex emergencies.
Address:
Dr. Jane Knight
Univeristy of Aberdeen
Public Health Medical Advisor Food Standards Agency Scotland
Public Health, Polwarth Building, Foresterhill
Aberdeen AB25 2ZD
United Kingdom
j.knight@abdn.ac.uk
www.abdn.ac.uk/public_health.
65