Report - Jabatan Taman Laut Malaysia - NRE

1.3. Methodology of the evaluationThe evaluation applied an independent and evidence based approach. Theprocess was:• Participatory• Constructive• Observing• A deeper investigation of recurrent issues• Verifying• AnalyticalThe two-person team (local and international consultant) undertook athorough survey of a wide range of key documents to verify information andprovide background (See Appendix 4). They also met with individuals andkey stakeholder groups.From these meetings observations were made and perceptions were tested.The initial briefing with UNDP was used to help define areas of focus andpossible issues to explore. Other recurrent issues were identified from theearly meetings and explored further in subsequent relevant meetings to testfindings and enquire more deeply. Those interviewed were key to the projectand primarily identified by UNDP and the Project Management Unit (PMU).The evaluation team added others to gain deeper insights.The typical open ended questions used as a framework to gatherinformation in the interview process were:• What do you think the project has achieved so far? Impact?• In your opinion, what challenges or difficulties has the projectencountered?• Why have these occurred?• What are your recommendations for improvement?• What do you want the project to achieve from now to itsconclusion?• Any other points/recommendations you wish to make?Interviewees were encouraged to give specific examples of the points made,as an evidential basis for evaluation. Visits to 3 states were undertaken,where the evaluators met state and local stakeholders. Weather permittedtravel to Tioman Island only.The evaluation team formulated personal independent conclusions and thenas a team discussed perspectives and agreed findings, and sometimeschose to seek further information for clarity or other perspectives.2