Public Consultation Toolkit - Civil Service College
Public Consultation Toolkit - Civil Service College
Public Consultation Toolkit - Civil Service College
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
FOR INTERNAL CIRCULATION ONLY<br />
FOR INTERNAL CIRCULATION ONLY
Copyright © Ministry of the Information, Communications and the Arts (MICA),<br />
Singapore, 2010<br />
Email: MICA_<strong>Public</strong>_Communications_Division@mica.gov.sg<br />
Supported by:<br />
<strong>Public</strong> <strong>Service</strong> Division<br />
Email: PSD_PS21@psd.gov.sg<br />
For more information, contact:<br />
<strong>Civil</strong> <strong>Service</strong> <strong>College</strong><br />
Email: cscollege_ipam@cscollege.gov.sg<br />
Printed in September 2010.<br />
Copyright © 2010. All rights reserved. No part of the publication may be reproduced, published or transmitted in any<br />
form or by any means electronic, mechanical, photocopying, recorded or otherwise without the prior permission of the<br />
copyright owner. You may use the contents and save an electronic copy, or print out a copy, of parts of this publication<br />
solely for your own information, research or study, provided you include the copyright notice on such copy. All information<br />
is correct at the time of publishing and printing, and is subject to change without prior notice.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Context<br />
One of the early roots of public consultation grew in 1985, with the formation of the Feedback<br />
Unit.<br />
The importance of public consultation has risen over the years, with the increasing political<br />
maturity of the Singapore populace and greater interest in participation in policy development.<br />
According to a <strong>Public</strong> Perception Survey conducted in 2009 by Ernst & Young Advisory (EYA), 68<br />
percent of the respondents wanted more opportunities for providing feedback to the Government.<br />
Among the government agencies, there is also an increased recognition that public consultation<br />
improves policy solutions and facilitates implementation.<br />
In order to facilitate effective public consultation, it was timely for a review of the public<br />
consultation process in Singapore, to tap on the experience and leading practices of various<br />
agencies, and share them across the public sector. It is in this context that the Ministry of<br />
Information, Communication and the Arts (MICA) and <strong>Public</strong> <strong>Service</strong> Division (PSD), in conjunction<br />
with <strong>Civil</strong> <strong>Service</strong> <strong>College</strong> (CSC) developed a toolkit for public consultation for government<br />
agencies in Singapore. CSC also commissioned EYA to conduct a public opinion survey and<br />
research on public consultation practices overseas.<br />
The <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> provides a basic set of guidance notes for public agencies in the<br />
conduct of public consultation. The <strong>Toolkit</strong> aims to serve as a user-friendly guide for specialists<br />
and generalists alike on the principles, processes and tools available for public consultation. The<br />
<strong>Toolkit</strong> is not meant to be prescriptive, and hence, agencies can customise the <strong>Toolkit</strong> so that it is<br />
contextualised to meet their needs.<br />
The <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> was developed with input from <strong>Public</strong> Sector Leaders and officers<br />
from ministries and statutory boards who shared their challenges, experiences and learning points<br />
from conducting public consultation exercises. The <strong>Toolkit</strong> also incorporates international leading<br />
practices and case studies on public consultation. This is to ensure that the <strong>Toolkit</strong> is relevant to<br />
the strategic intent, operational requirements of agencies and meets stakeholder expectations.<br />
This <strong>Toolkit</strong> is meant for circulation among ministry and statutory board officers only. It should<br />
not be extended to the public or media.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> ii iii <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Contents<br />
1. Introduction 1<br />
1.1. <strong>Public</strong> consultation in the <strong>Public</strong> <strong>Service</strong> 1<br />
1.2. How to use this <strong>Toolkit</strong> 4<br />
2. Reasons for public consultation 5<br />
3. Key guiding principles for public consultation 6<br />
4. Pre-consultation considerations 7<br />
4.1. Factors to consider 7<br />
4.2. Stages of policy development 9<br />
4.3. <strong>Public</strong> consultation process 10<br />
5. Developing the strategy for consultation 11<br />
5.1. Step 1: Identify stakeholders 11<br />
5.2. Step 2: Select tools and channels 18<br />
5.3. Step 3: Anticipate obstacles and challenges 21<br />
6. <strong>Consultation</strong> preparation and implementation 35<br />
6.1. Step 4: Develop action plan and timeline 35<br />
6.2. Step 5: Design consultation materials 38<br />
6.3. Step 6: Generate awareness and plan public communication exercises 39<br />
6.4. Step 7: Launch consultation exercise 44<br />
7. Follow-up and analysis 46<br />
7.1. Step 8: Collate feedback and close the loop 46<br />
7.2. Step 9: Assess effectiveness of the public consultation exercise 52<br />
8. Conclusion 54<br />
Acknowledgements 55<br />
Index of case examples 56<br />
References 57<br />
Appendices 60
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
1. Introduction<br />
1.1. <strong>Public</strong> consultation in the <strong>Public</strong> <strong>Service</strong><br />
<strong>Public</strong> consultation is a process by which government interacts with the public or stakeholders<br />
to seek input and discuss issues regarding a specific deliverable, which is often either a policy or<br />
initiative.<br />
<strong>Public</strong> consultation as defined here is distinct from public engagement, which refers to the<br />
government’s ongoing involvement with stakeholders or partners, and is not necessarily<br />
focused on a particular policy, initiative or issue.<br />
The key difference between public consultation and public engagement is the driving impetus<br />
behind the activity. While the objective of public consultation is to gather feedback on a specific<br />
issue, the ultimate goal of public engagement is to develop a longer term relationship with<br />
stakeholders.<br />
Case 1:<br />
Regulatory regime for the private education sector – an illustration of public<br />
consultation<br />
Agency/country:<br />
• Ministry of Education (MOE), Singapore<br />
Background:<br />
• The rapid growth of the private education (PE) sector had led to uneven standards across<br />
private educational institutions (PEIs). To address this, MOE proposed to establish a new<br />
regulatory regime to improve standards in the PE sector, to be overseen by a statutory body,<br />
the Council for Private Education.<br />
• The new regulatory regime consists of three key features: (i) an Enhanced Registration<br />
Framework that sets out mandatory standards in the key areas of corporate governance,<br />
academic rigour, and information transparency which PEIs need to adhere to in order to<br />
be allowed to operate their businesses; (ii) a voluntary certification scheme (EduTrust) with<br />
higher and more comprehensive standards to allow quality PEIs to differentiate themselves<br />
from the rest; and (iii) regulatory levers to allow for a range of graduated solutions to match<br />
the severity of breaches.<br />
• A public consultation exercise was conducted from March to May 2009 to seek feedback on<br />
the key principles and features of the new regulatory framework .<br />
<strong>Consultation</strong> Process:<br />
• MOE posted the <strong>Consultation</strong> Paper on its website, with a hyperlink on REACH’s (Reaching<br />
Everyone for Active Citizenry@Home) Portal to widen the reach to the public and<br />
stakeholders.<br />
• An industry briefing was held for PEIs to facilitate their understanding of the key features of<br />
the new regulatory regime. Over 500 PEI representatives attended the briefings.<br />
• Four focus group discussions were conducted with selected PEIs and students whose views<br />
would be representative of their communities. This helped MOE to further unpack the<br />
concerns that have been raised.<br />
Outcomes:<br />
• After the close of the public consultation exercise, MOE evaluated the feedback received and<br />
incorporated several suggestions into the regulatory framework. A summary of responses<br />
to the feedback was also published on the MOE website.<br />
• The Private Education (PE) Bill was also refined based on the feedback received. <strong>Consultation</strong><br />
on the PE Bill was conducted in July 2009 to seek final views.<br />
• The PE Bill was introduced in Parliament in August 2009 and the Second and Third Readings<br />
took place in September 2009. The Private Education Act was finally gazetted in October<br />
2009.<br />
• The Council for Private Education was formally instituted on 1 Dec 2009 as a Statutory Board<br />
under MOE, and it commenced operations of the new regulatory regime on 21 Dec 2009.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Case 2:<br />
‘Friends of LTA’ – An illustration of public engagement<br />
Agency/country:<br />
• Land Transport Authority (LTA), Singapore<br />
Background:<br />
• The third strategic thrust of LTA’s Land Transport Master Plan is to “meet the diverse needs of<br />
the people”.<br />
• In support of this strategic thrust, LTA began its Friends of LTA (FOLTA) scheme in May 2008.<br />
FOLTA invites members of the public – students, retirees, business leaders, housewives and<br />
those with diverse needs – to become informal ambassadors of land transport.<br />
Engagement Process:<br />
• LTA regularly engages FOLTA at corporate events, visits to construction sites and other<br />
activities to obtain a behind-the-scenes perspective of land transport 1 .<br />
Outcomes:<br />
• FOLTA members provide valuable feedback to LTA on the needs of the public and provide<br />
ideas on improving land transport. In 2010, FOLTA’s participation in several focus group<br />
discussions offered specific valuable input that helped to:<br />
From the cases on page 2 and 3, it can generally be seen that:<br />
<strong>Public</strong> <strong>Consultation</strong> is specific to a policy or initiative, and seeks to understand stakeholder<br />
sentiment, or to test, validate or prioritise policy options. It is also important to note that there<br />
is a key difference between public communication and public consultation. In the former, the<br />
policy decision has been made and the government is communicating the decision to the<br />
public. In the latter, the policy decision has not been made and the government is seeking input<br />
from stakeholders.<br />
<strong>Public</strong> Engagement involves active involvement of stakeholders over a longer period of time,<br />
ideally through a more substantive and deliberative dialogue/conversation that promotes<br />
mutual and shared understanding, and through ongoing partnership and collaboration.<br />
1.2. How to use this <strong>Toolkit</strong><br />
This <strong>Toolkit</strong> provides public officers with:<br />
1. A starting point to embark on effective public consultation,<br />
2. Practical guidelines and steps for the planning and implementation of public consultation,<br />
3. Compilation of channels which public officers can use to conduct public consultation; and<br />
4. Case examples from international and Singapore agencies.<br />
There is no “one size fits all” solution. This toolkit merely provides a point of reference<br />
upon which further customisation can be done.<br />
- Shape the content and tone of public messaging on Distance Fares to ensure clarity<br />
- Clarify current public perceptions of LTA<br />
Source:<br />
1 Land Transport Authority, 2009. Friends of LTA case study, .
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
2. Reasons for public consultation<br />
The reasons for public consultation in Singapore are:<br />
1. To feel the pulse<br />
• Anticipate concerns from stakeholders/public early<br />
• Understand stakeholder/public sentiment and the ground situation<br />
• Provide a channel for stakeholders to be heard and enable greater participation in the<br />
policy development process<br />
2. To test and refine ideas for better policy solutions<br />
• Gather diverse views and insights from stakeholders/public<br />
• Ascertain feasibility of intended policy change or new initiative<br />
• Seek options and check against policy alternatives<br />
3. To facilitate implementation of policies and initiatives<br />
• Generate awareness and enable stakeholders to understand the<br />
policies/initiatives better<br />
• Obtain buy-in from stakeholders by seeking their contribution to the policies/initiatives<br />
to be implemented<br />
• Mitigate or find resolutions to opposing interests to prevent conflicting views at<br />
implementation stage<br />
• Couch appropriate public communication messages, particularly for controversial or<br />
contentious issues.<br />
3. Key guiding principles for<br />
public consultation<br />
1. Policy-making should be inclusive and take into account views of stakeholders. <strong>Public</strong><br />
officers should see inherent value in stakeholder feedback.<br />
2. <strong>Public</strong> consultation should be a first thought, rather than an afterthought, in the policy<br />
development process.<br />
3. The outcome of consultation should not be pre-determined.<br />
4. <strong>Consultation</strong> should involve a fair representation of all stakeholders who are affected,<br />
interested and/or can contribute to the policy development process.<br />
5. Modes of consultation should be carefully considered and selected to reach the relevant<br />
stakeholders and gather the appropriate types of information.<br />
6. The consultation process should be conducted in a transparent, consistent, structured and<br />
timely manner. Sufficient time should be given to those being consulted to understand and<br />
respond to an issue.<br />
7. <strong>Consultation</strong> materials should provide sufficient background information that is clear and<br />
easily understandable to participants.<br />
8. The scope and parameters of the consultation should be clear to the participants to set the<br />
right expectations. Participants should be provided with a clear understanding of how their<br />
input will be sought and managed.<br />
9. Agencies should be responsive and follow through with stakeholders on how their feedback<br />
was considered and the extent of its impact on the policy in a constructive manner.<br />
10. Agencies should ensure that the consultation process is mutually respectful, nondiscriminatory<br />
and equitable, regardless of gender, race, age, educational levels or religious<br />
beliefs.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
4. Pre-consultation considerations<br />
The following table (Table 4-1) could serve as a general guide for agencies to determine the<br />
need to conduct a public consultation exercise.<br />
4.1. Factors to consider<br />
As a rule of thumb, consultation should be conducted for policies and initiatives that have a<br />
significant impact on stakeholders.<br />
Five factors to consider whether to proceed with a consultation exercise are:<br />
1. Confidentiality. Policies/initiatives that are classified and confidential (e.g., national<br />
security) may not be suitable for public consultation.<br />
2. Urgency of issue. For emergency situations (e.g., a security incident) where an immediate<br />
response by agencies is necessary, public consultation is generally not realistic or possible.<br />
3. Impact on stakeholders. For issues with significant impact (e.g., which result in changes<br />
to how individuals or organisations operate, or which touch on religious or moral values),<br />
agencies should choose to consult the stakeholders more thoroughly to understand the full<br />
implications of each decision.<br />
4. Level of public interest. The level of public interest determines the extent to which the<br />
wider populace is consulted.<br />
Policy areas that tend to attract more public interest include healthcare, education, housing<br />
and transport 2 . Policy areas of public interest also tend to be covered more widely by the<br />
media.<br />
Conversely, for policies which attract less public interest (e.g., technical or regulatory issues<br />
such as the regulation of financial institutions), agencies can choose to conduct targeted<br />
consultation with affected stakeholders such as industry players or technical experts.<br />
5. Scope of influence. This refers to the degree to which the outcomes of the policy could<br />
be influenced by stakeholder feedback. It is recommended that consultation be conducted<br />
primarily when stakeholder feedback can influence the outcome of the policy or initiative.<br />
If consultation is conducted for policies or initiatives with minimal scope for influence, it is<br />
important to manage stakeholder expectations carefully.<br />
Key considerations<br />
Confidentiality of issue<br />
Does the policy/initiative<br />
contain classified/<br />
confidential information?<br />
Urgency of Issue<br />
Is there an urgent, short<br />
timeframe for the policy/<br />
initiative to be developed?<br />
If the implementation<br />
is delayed, will there be<br />
adverse implications?<br />
Impact on stakeholders<br />
How significant is the<br />
degree of impact of<br />
the policy/initiative on<br />
stakeholders?<br />
To what extent are major<br />
stakeholders concerned<br />
about this issue?<br />
Level of public interest<br />
What is the level of public<br />
interest or attention on the<br />
policy/initiative?<br />
What is the possibility that<br />
the media will be interested<br />
in the issue?<br />
Scope of influence<br />
What is the scope for<br />
changes to be made to the<br />
policy/initiative based on<br />
stakeholder feedback?<br />
Recommendation<br />
Yes<br />
Yes<br />
Yes<br />
Low<br />
Low<br />
Low<br />
Low<br />
Please circle the appropriate response<br />
Moderate<br />
Moderate<br />
Moderate<br />
Moderate<br />
No<br />
No<br />
No<br />
High<br />
High<br />
High<br />
High<br />
Low Moderate High<br />
If most responses<br />
fall in this column,<br />
consultation may not<br />
be required.<br />
If most responses<br />
fall in this column,<br />
targeted consultation<br />
is recommended for<br />
affected stakeholder<br />
groups.<br />
If most responses fall<br />
in this column, largescale<br />
consultation of<br />
the wider populace is<br />
recommended.<br />
2 Based on Singapore <strong>Public</strong> Perception Survey conducted by Ernst and Young Advisory, 2009.<br />
Table 4-1: Pre considerations for consultation
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 10 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
4.2. Stages of policy development<br />
<strong>Consultation</strong> can provide input to the policy/initiative development at different stages<br />
of its inception. The purposes of consultation at the various stages of the policy/initiative<br />
development can vary (Figure 4-2).<br />
Development stages of policy/initiative<br />
Identify<br />
Identify and define Issue/<br />
problem to be resolved<br />
Analysis<br />
Define key opportunities and challenges<br />
associated with issue<br />
Formulate<br />
Formulate possible policy solutions<br />
to address issue<br />
Assess<br />
Assess and evalute options<br />
Decide<br />
Decide on course of action<br />
Purposes of public consultation<br />
Feel the pulse<br />
Test/refine<br />
Check against options/<br />
alternatives<br />
4.3. <strong>Public</strong> consultation process<br />
The public consultation process is an iterative one. For the purpose of this <strong>Toolkit</strong>, the<br />
consultation process has been outlined in nine critical steps (Figure 4-3). It is acknowledged that<br />
in practice, the process is usually not linear. Therefore, Figures 4-2 and 4-3 do not necessarily<br />
assume a stage-by-stage process although the diagrams are illustrated in that manner.<br />
8<br />
9<br />
Assess effectiveness<br />
of public consultation<br />
exercise<br />
Collate feedback<br />
and close the loop<br />
7<br />
Launch<br />
consultation exercise<br />
6<br />
Follow-up and analysis<br />
1<br />
Generate awareness<br />
and plan public<br />
communication exercise<br />
Identify<br />
stakeholders<br />
Conceptual planning<br />
2<br />
<strong>Consultation</strong> preparation and<br />
implementation<br />
Design<br />
consultation materials<br />
Select tools and<br />
channels<br />
Anticipate obstacles<br />
and challenges<br />
Develop action<br />
plan and timeline<br />
5<br />
3<br />
4<br />
Implement<br />
Establish policy/programme guidelines and<br />
processes to deliver public policies<br />
Evaluate<br />
Monitor outcomes to determine whether<br />
objectives are being met<br />
Communication/buy-in<br />
Refine/evaluate<br />
Figure 4-3: <strong>Public</strong> consultation process<br />
Figure 4-2: Purposes of public consultation at different stages of<br />
policy/initiative development
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 11 12 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Stakeholders as partners<br />
5. Developing the<br />
strategy for consultation<br />
The first stage of the consultation process involves the conceptual development which aims to:<br />
1. Identify the stakeholders to be consulted,<br />
2. Select the tools and channels to be used, and<br />
3. Develop strategies to mitigate potential risks in the consultation process.<br />
5.1. Step 1: Identify stakeholders<br />
Selection of appropriate stakeholders to participate in public consultation ensures that the<br />
views of relevant parties are well represented and their views heard.<br />
Officers should make sure that participants are representative of the affected groups, while<br />
ensuring that stakeholders holding different views or from diverse background are involved in<br />
the consultation exercise.<br />
Stakeholders can be categorised into the following groups:<br />
Besides engaging the stakeholders directly, ministries and statutory boards can leverage on<br />
partnership with parties outside their own agencies to reach and engage the stakeholders.<br />
The following table (Table 5-1) illustrates how different partners can assist agencies in their<br />
consultation initiatives. Agencies may consider tapping on these resources:<br />
Partners<br />
REACH (Reaching Everyone for Active<br />
Citizenry@ Home)<br />
The government unit for engaging and<br />
connecting with citizens<br />
http://www.reach.gov.sg<br />
People’s Association<br />
http://www.pa.gov.sg/<br />
Voluntary welfare organisations (VWOs)<br />
Industry and trade associations<br />
Advantages<br />
• Provides a one-stop publicly available<br />
platform for the public to state their<br />
opinions and understand different<br />
perspectives on an issue<br />
• Assists agencies to identify relevant<br />
stakeholders in the community and<br />
organise consultation activities<br />
• Leverages on network of grassroots leaders<br />
to gather community views<br />
• Provide insights on issues affecting the<br />
stakeholder groups under their charter<br />
• Assist in obtaining feedback from<br />
stakeholders they serve<br />
Table 5-1: Partners in consultation exercises<br />
• Provide industry knowledge<br />
• Represent companies and businesses within<br />
an industry<br />
• Assist in identifying and engaging relevant<br />
stakeholders in the industry<br />
1. Individuals/organisations that might benefit from the policy/initiative,<br />
2. Individuals/organisations that might be adversely affected by the policy/initiative,<br />
3. Individuals/organisations that might have the skills and resources to contribute to the<br />
policy/initiative development process; and<br />
4. Individuals/organisations that might be interested in the policy/initiative and its<br />
development process.<br />
Note: The mode and the degree to which the stakeholder groups are consulted may vary,<br />
depending on the level of knowledge, expertise and degree of impact which the policy or<br />
initiative may have on the different groups.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 13 14 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Considerations for facilitating effective partnerships<br />
Agencies can do the following to facilitate effective partnerships:<br />
1. Lead time. When tapping on partners, it is important to provide them with sufficient lead<br />
time to allow the partner agencies to mobilise the necessary resources. Agencies should<br />
provide a minimum of one month’s notice to the partners, and a period of at least three<br />
months for the partners to gather feedback on agencies’ behalf.<br />
2. Information. Agencies should provide partners with comprehensive information so that<br />
they have a good understanding of the policy and its considerations before the consultation<br />
process. This allows the partners to be more effective in addressing the questions raised by<br />
their constituents/members during the actual consultation exercise.<br />
3. Materials. Agencies should generally equip partners with communication materials for the<br />
consultation exercise. This may include briefing slides (with speakers’ notes), pamphlets and<br />
FAQs.<br />
4. Funding and technical support. Agencies can also provide technical assistance (e.g., design<br />
of survey questions) and funding support (e.g., for organising dialogue sessions).<br />
Note: The above are some suggestions but are not exhaustive.<br />
Case 3:<br />
The Living Murray River Restoration<br />
Agency/country:<br />
• Murray-Darling Basin Commission, Australia<br />
Background:<br />
• The Murray-Darling Basin (MDB) comprises a large geographical area that spreads across five<br />
states and territories: Queensland, the Australian Capital Territory, New South Wales, Victoria<br />
and South Australia.<br />
• The landscape of the MDB was under severe ecological stress, with issues such as salinity,<br />
poor water quality, stressed forests, dried wetlands, threatened native species, feral animals<br />
and noxious weeds.<br />
• The Australian government engaged different stakeholders in the restoration of the<br />
cleanliness and health of the MDB.<br />
<strong>Consultation</strong> Process:<br />
Stakeholders engaged during the consultation exercise included:<br />
• Individuals/organisations who could benefit from the restoration<br />
- Local communities (e.g., landholders, land managers)<br />
- Rural communities (e.g., indigenous people)<br />
• Individuals/organisations who could be adversely affected<br />
- Industry stakeholders, including businesses that depended on the river’s resources as a<br />
form of income (e.g., agricultural farmers)<br />
• Individuals/organisations who had the skills and resources to contribute to river restoration<br />
- Ecological and environmental experts<br />
• Individuals/organisations who were interested in the restoration<br />
- Activists (e.g., land care groups)<br />
- Interest groups and individuals who had an interest in the river’s health
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 15 16 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Learning points:<br />
• Comprehensive consultation with different stakeholders allowed the government to<br />
understand the different interests and concerns in the issues.<br />
• This helped the government roll out policies which balanced the interests and needs of<br />
different stakeholders.<br />
Case 4:<br />
Tripartite efforts to overcome the downturn<br />
Agency/country:<br />
• Ministry of Manpower (MOM), Singapore<br />
Source:<br />
• Australian Human Rights Commission, 2010, Case study 2 - The Murray-Darling Basin – An ecological<br />
and human tragedy, Australia, .<br />
• Crase, L., Dollery, B. & Wallis, J., 2005, Community consultation in public policy: The case of the<br />
Murray-Darling Basin of Australia, Australian Journal of Political Science, 40, 221 – 237, .<br />
• Macdonald, D. H., & Young, M., 2001, A case study of the Murray-Darling Basin, CSIRO Land and Water,<br />
.<br />
Background:<br />
• A tripartite taskforce comprising representatives from the Government, the National Trades<br />
Union Congress (NTUC) and the Singapore National Employers’ Federation (SNEF), was<br />
formed to gather feedback and updates on manpower-related issues during the economic<br />
downturn. The impact of the economic downturn was especially felt around October 2008,<br />
prompting the tripartite partners to come together in November 2008 to formulate the<br />
Tripartite Guidelines on Managing Excess Manpower to help companies manage their excess<br />
manpower and to use retrenchments as a last resort.<br />
• According to the Guidelines, companies could implement a shorter working week or<br />
temporary lay-offs, cut wages or take other non-wage cost-cutting measures.<br />
<strong>Consultation</strong> Process:<br />
• Within a month, the Tripartite Taskforce on Managing the Economic Downturn was set up<br />
with regular working groups.<br />
• The partners leveraged on the Singapore Tripartism Forum (STF) to broadcast the measures<br />
to a wider audience. More than 40 briefings/dialogues on the Guidelines were organised,<br />
involving some 9,500 participants. The briefings mainly targeted senior managers and HR<br />
professionals from the various sectors, as well as the various Chambers of Commerce and<br />
unions.<br />
• An STF Dialogue with the Prime Minister was also organised in February 2009 to highlight<br />
the importance of saving jobs and creating growth in a global downturn.<br />
• The tripartite partners also set up Tripartite Upturn Strategy Teams (TRUST Teams) to reach<br />
out to individual companies to help businesses manage costs, retain workers and upgrade<br />
their skills.<br />
• From April 2009, the TRUST Teams reached over 640 companies, held 12 large-scale events<br />
reaching out to some 3,100 participants, visited 20 companies employing about 12,000<br />
employees, conducted one-on-one clinic sessions for 13 companies and provided assistance<br />
to over 80 companies through tele-conversations.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 17 18 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Outcomes:<br />
• The number of workers on a shorter working week and temporary lay-offs increased from<br />
550 before the downturn to 26,500 in the first quarter of 2009.<br />
• By January 2009, the Skills Programme for Upgrading and Resilience (SPUR) and the<br />
Government’s Resilience Package, which included the Jobs Credit Scheme, were announced.<br />
SPUR was introduced to subsidise training and absentee payroll, allowing companies to<br />
make better use of their excess capacity. The number of courses under SPUR increased from<br />
150 to more than 1,000. In addition, the Professional Skills Programme was introduced to<br />
help the workers to gain new skills or upgrade their skills. About 244,000 workers signed up.<br />
• As a result of the interventions, Singapore was able to avoid the high retrenchment numbers<br />
it had experienced during the 1998 financial crisis.<br />
• Trust among the tripartite partners had been strengthened. The long tradition of tripartism<br />
in Singapore enabled prompt joint action to address the crisis swiftly and effectively.<br />
• The effectiveness of our downturn efforts won MOM recognition by the International Labour<br />
Organisation (ILO), and was also shared with the G20 countries at the G20 Labour and<br />
Employment Ministers Meeting 3 .<br />
Learning points:<br />
• The collaboration with partners made it possible to gather feedback quickly from various<br />
stakeholder groups.<br />
• The collaboration helped avoid the high retrenchment numbers experienced during the<br />
1998 financial crisis.<br />
• Trust among the tripartite partners was strengthened<br />
Source:<br />
3 Citation made in “Employment and social protection policies from crisis to recovery and beyond: A review<br />
of experience”, an ILO report to the G20 Labour and Employment Ministers Meeting held in Washington<br />
D.C. from 20 to 21 April 2010. The Report is available at the ILO website - http://www.ilo.org/public/<br />
libdoc/jobcrisis/download/g20_report_employment_and_social_protection_policies.pdf.<br />
5.2. Step 2: Select tools and channels<br />
Appropriate selection and usage of public consultation tools and channels are important for<br />
gathering appropriate types of feedback from the relevant stakeholders.<br />
Different types of tools and channels can be used based on the following factors:<br />
1. Purpose of exercise,<br />
2. Target audience; and<br />
3. Available resources (e.g., time, funding, competency and technical expertise).<br />
A mix of tools can be used to create the necessary level of contact with stakeholders and<br />
achieve the consultation objectives. The table below (Table 5-2) provides suggestions for tools<br />
to be used for different scenarios.<br />
(More details on the tools are provided in Appendix A.)<br />
Tools<br />
Feel the<br />
pulse<br />
Test/<br />
refine<br />
Obtain<br />
buy-in<br />
Page<br />
reference<br />
1. Community meetings 3 3 3 64<br />
2. Exhibitions/road-shows 3 3 65<br />
3. <strong>Public</strong> forums 3 3 3 67<br />
4. Surveys 3 3 68<br />
5. Blogs 3 3 3 70<br />
6. Social media 3 3 3 72<br />
7. Website 3 74<br />
8. Focus group discussions 3 3 76<br />
9. Workshops 3 78<br />
10. Charrettes 3 3 80<br />
11. Citizen juries 3 3 81<br />
12. Delphi process 3 3 82<br />
13. Expert panels 3 3 3 83<br />
14. Interviews 3 3 84<br />
15. Working groups 3 85<br />
Target audience<br />
General public /large<br />
stakeholder population<br />
General public<br />
(IT-savvy population)<br />
Targeted to subject<br />
matter experts,<br />
stakeholder population<br />
Table 5-2: Sample tools for different purposes and target audiences
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 19 20 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Case 5:<br />
Improving public health care<br />
Agency/country:<br />
• Commission on the Future of Health Care in Canada, Canada<br />
Background:<br />
• The Canadian healthcare system is financed by both the provincial and federal governments,<br />
with each paying 50% of costs.<br />
• During the 1990s, growing concerns emerged about rising costs and the quality of service.<br />
<strong>Consultation</strong> Process:<br />
• The Commission on the Future of Health Care in Canada was established in April 2001 as a<br />
federal public inquiry to review and make recommendations on Canada’s public health care<br />
system. It was created to improve health care and make it more financially sustainable.<br />
• The public consultation process took place over the course of 18 months, commencing in<br />
April 2001, and was divided into two phases – fact finding and dialogue with the Canadians.<br />
• The Commission engaged both the public and experts extensively through 12 dialogue<br />
sessions, six televised debates, 21 days of open public hearings, nine expert workshops, three<br />
regional forums, 12 partnered dialogue sessions with universities, nine issue survey papers,<br />
two consultation workbooks, 97 site visits and meetings with national organisations and<br />
national caucuses, and 45 speeches and presentations to stakeholders across the country.<br />
• An interim report and final report were released by the Commission in February 2002 and<br />
November 2002 respectively, which summarised the findings of Canada’s health care system<br />
and offered 47 recommendations to enhance Canada’s health care.<br />
• The final report was seen as objective and credible, and the public felt that the Commission<br />
had listened intently to the public’s view on Canada’s health care.<br />
Learning points:<br />
• Appropriate selection of consultation tools was important for reaching the targeted<br />
stakeholders.<br />
• Extensive public engagement enabled better understanding of the issues/problems on the<br />
ground so that practical recommendations could be proposed.<br />
Source:<br />
• Mapleleafweb.com: Canada’s Premier Political Education Website, Romanow Commission on the Future<br />
of Health Care: Findings and Recommendations, <br />
• Dawn Ontario: DisAbled Women’s Network Ontario, 1998-2007, Responses to the final report by the<br />
Romanow Commission on the Future of Health Care in Canada, <br />
• 35 full-time staff were employed during the Commission’s peak periods. Other consultants<br />
were employed on an “as-needed” basis for a range of duties, including research, logistics and<br />
communications.<br />
Outcomes:<br />
• A considerable amount of public and media debate was generated from the public<br />
consultation process.<br />
• The Commission received 40 discussion papers, three major independent Research<br />
Consortium reports, 640 formal submissions, 591 formal presentations, 1,418 abstracts, and<br />
14,000 online health issue surveys.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 21 22 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Case 6:<br />
Master plan for Sungei Buloh Wetland Reserve<br />
Agency/country:<br />
5.3. Step 3: Anticipate obstacles and challenges<br />
Before launching the public consultation exercise, public officers need to think through the<br />
potential challenges and pitfalls that may arise during and after the exercise. Mitigating<br />
strategies and contingency plans need to be developed to handle these situations.<br />
The following are some commonly faced challenges and examples of mitigating strategies:<br />
1. Voluminous and diverse views<br />
Policies/initiatives which affect the society at large (e.g., primary education curriculum policies)<br />
or are controversial in nature (e.g., amendment to the Penal Code) tend to attract voluminous<br />
feedback which may be differing and diverse, and therefore, sometimes hard to manage.<br />
Officers should adopt a systematic approach to identify and deal with the most pressing and<br />
most common concerns among the stakeholders. Table 5-3 suggests a simple way for officers to<br />
categorise the feedback received.<br />
• National Parks Board (NParks), Singapore<br />
Background:<br />
• The objective of the consultation exercise was to seek feedback on the masterplan for the<br />
development of the Sungei Buloh Wetland Reserve.<br />
• With lessons learnt from Chek Jawa, which attracted voluminous public feedback, NParks<br />
decided to engage interest groups early in the consultation process.<br />
<strong>Consultation</strong> Process:<br />
• NParks involved the key stakeholders and interest groups at the early stages of the<br />
development plan.<br />
• Working groups were formed and meetings were held quarterly to discuss issues and<br />
concerns.<br />
• Stakeholders had open discussions with NParks and their input were directly included in the<br />
master plan for development.<br />
Demands by stakeholders<br />
directly affected<br />
Prioritisation of feedback<br />
1.<br />
2.<br />
3.<br />
Common areas of concern 1.<br />
2.<br />
3.<br />
Minority requirements 1.<br />
2.<br />
3.<br />
Table 5-3: Categorising feedback received<br />
If voluminous feedback is expected on an issue, one possible<br />
mitigating strategy is to start with targeted engagement of key<br />
stakeholders before consulting the wider populace. This will<br />
allow agencies to identify key area of concerns and controversy<br />
and develop strategies or responses before a large-scale<br />
consultation is launched.<br />
Tips for effectiveness<br />
For a situation where the<br />
feedback is voluminous,<br />
agencies can group<br />
feedback into broader<br />
categories based on<br />
common areas of concern.<br />
This allows the agencies<br />
to have a comprehensive<br />
assessment of the situation<br />
without being bogged<br />
down by the volume.<br />
This also helps the<br />
agencies to close the loop<br />
effectively (Step 8) as it<br />
will ensure that all key<br />
areas of concern had been<br />
considered.<br />
Outcomes:<br />
• Since the working group played a part in the planning process, they could assist NParks to<br />
address the concerns of the public during the wider consultation.<br />
• The public showed greater acceptance towards the government’s initiative when the nongovernmental<br />
groups showed buy-in towards the policy as well.<br />
Learning points:<br />
• For issues which could attract voluminous feedback, involving targeted stakeholders early<br />
helps to facilitate the consultation process with the wider populace.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 23 24 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
2. Sensitive/controversial issues<br />
For topics/issues which are controversial, emotive or which may provoke strong, opposing<br />
viewpoints, the engagement needs to be managed carefully.<br />
Agencies need to show sensitivity towards the stakeholders’ concerns, while at the same time<br />
gain trust from stakeholders through open and honest consultation.<br />
Case 7:<br />
Proposed amendments to the Human Organ Transplant Act (HOTA)<br />
Agency/country:<br />
• Ministry of Health (MOH), Singapore<br />
Background:<br />
• The public, local and international medical community had strong and quite emotional views<br />
on organ donation-related issues. When MOH proposed the amendments to the HOTA, an<br />
extensive public consultation was conducted.<br />
• In MOH’s case, the <strong>Public</strong> <strong>Consultation</strong> Document and the proposed Draft Bill were put up for<br />
public consultation so that the public and stakeholders could see the text amendments for<br />
themselves.<br />
<strong>Consultation</strong> Process:<br />
• MOH took a transparent view and shared the various possible solutions to the problem<br />
openly at the various forums and through the media.<br />
• MOH engaged the stakeholders early to clarify policy areas to the public (in this case, the<br />
definition and limit of compensation for organ donation).<br />
• The fronting by Minister for Health demonstrated the commitment and seriousness of MOH<br />
in listening to the stakeholders:<br />
- MOH opened the public dialogue sessions for media coverage so that issues were aired<br />
and discussed in the open.<br />
- Wide range of people such as the medical and professional bodies (e.g. Academy<br />
of Medicine, <strong>College</strong> of Family Physicians, Singapore Medical Association, Society of<br />
Transplantation, Singapore Diabetic Society of Singapore, Law Society and National<br />
Kidney Foundation) were consulted.<br />
• In MOH’s case, the <strong>Public</strong> <strong>Consultation</strong> Document and the proposed Bill were put up for<br />
public consultation so that the public and stakeholders could see the text amendments for<br />
themselves.<br />
Follow up:<br />
• LiveOn, an organ donation campaign, was launched as a follow-up after the amendments<br />
were made to sustain awareness and acceptance of organ donation.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 25 26 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Outcomes:<br />
• <strong>Consultation</strong> results showed that Singaporeans understood the need and were generally<br />
supportive of the proposed amendments to HOTA. This was largely because there were<br />
extensive discussion and transparency in the consultation process.<br />
Learning points:<br />
• <strong>Consultation</strong> on emotive issues need to be managed carefully through<br />
- Early consultation,<br />
- Well-managed public education on the key considerations and options available; and<br />
- Displaying sensitivity to stakeholders’ concerns<br />
The concept of ‘socialising’<br />
For topics/issues which are emotive in nature, it can be useful to ‘socialise’ policy ideas early. This<br />
is when possible policy ideas are disseminated to the ground to generate discussion amongst<br />
social groups as a means of seeding ideas for policy options.<br />
For example, the idea of Means Testing by MOH was raised several years prior to formal public<br />
consultation in 2008 and its eventual implementation in 2009. As Means Testing was a rather<br />
unpopular policy, particularly among the middle-income group who felt deprived of affordable<br />
healthcare, MOH adopted this approach to socialise the concept, to generate ideas, feedback<br />
and discussions on means-testing criteria. The extensive dialogues gradually helped to address<br />
ground concerns and facilitate smoother implementation.<br />
3. Feedback on specific issues and with targeted groups<br />
Some consultation exercises may yield lower response from the public due to the nature of<br />
the issue or policy at hand. The possible causes can be lack of public interest, lack of public<br />
awareness and inaccessible feedback mechanisms. Agencies should consider the following to<br />
enhance the level of participation and feedback:<br />
• Establishing checkpoints during the course of the consultation period to monitor the<br />
response rate,<br />
• Extending the duration of the consultation period,<br />
• Increasing awareness through different tools and channels; and<br />
• Soliciting feedback from specific stakeholders by collaborating with partners.<br />
Policies which are highly complex or technical in nature generally tend to attract lower volume<br />
of feedback, particularly if the stakeholders do not understand the issue at hand (e.g., financial<br />
regulations).<br />
For such policies, agencies should choose to target industry players and experts with the<br />
relevant knowledge and interest in the issues.<br />
If the wider population is consulted, agencies need to ensure that the information provided for<br />
the consultation is accessible and easy to understand.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 27 28 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Case 8:<br />
Regulation of investment products<br />
Agency/country:<br />
• Monetary Authority of Singapore (MAS), Singapore<br />
Background:<br />
• In 2009, MAS developed proposals to safeguard consumers’ interests and promote higher<br />
industry standards for the sale and marketing of unlisted investment products.<br />
• The proposed amendments to regulations typically did not attract much interest from the<br />
wider populace due to their complexity. Nevertheless, MAS felt that it was important to<br />
consult the wider populace because this particular set of regulations would have direct<br />
impact on the way consumers purchased investment products.<br />
<strong>Consultation</strong> Process:<br />
Subsequent steps:<br />
• MAS published its response to the feedback received in the consultation paper in September<br />
2009 and January 2010. MAS also issued a new consultation paper on some additional<br />
proposals later in January 2010.<br />
Learning points:<br />
• For issues which may attract low volume of public feedback, input from the public can be<br />
obtained through:<br />
- Partnership with community leaders,<br />
- Educating stakeholders on how the policies impact them; and<br />
- Ensuring that materials and terminology used are jargon-free and accessible.<br />
• MAS engaged experts and industry players during policy development to provide technical<br />
inputs to the policy.<br />
• To consult the wider populace, MAS leveraged on consumer groups such as CASE and the<br />
Securities Investors’ Association Singapore (SIAS) to reach out to their members.<br />
• MAS also put its consultation paper on the REACH portal to solicit feedback from REACH<br />
members.<br />
• In addition, MAS briefed the local media on the significance of the proposed amendments<br />
for consumers and encouraged feedback from the public through the media.<br />
• It was ensured that the information used to brief the public was free of jargon and easy to<br />
understand.<br />
Outcomes:<br />
• MAS received a wide range of useful feedback from investors, market practitioners, and<br />
industry associations. The consultation paper attracted significantly more feedback from the<br />
general public than previous ones.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 29 30 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Case 9:<br />
Contract period and early termination charges<br />
for telecommunication services offered to consumers<br />
Agency/country:<br />
• Infocomm Development Authority (IDA), Singapore<br />
Background:<br />
• In December 2008, IDA proposed to issue Guidelines on the maximum contract period<br />
and early termination charges (ETC) that providers of residential fixed-line, mobile and<br />
broadband services could impose on consumers. The Guidelines specified that:<br />
- The maximum contract periods should not exceed 24 months; and<br />
- Consumers who signed contracts that were longer than three months and who<br />
terminated their contracts before the end of their contract period should not have to pay<br />
a fixed ETC. Rather, ETCs should decrease over time.<br />
• In proposing the Guidelines, IDA considered that long contract periods and excessive ETCs<br />
may unfairly penalise consumers and hinder them from legitimately terminating services<br />
and switching operators.<br />
• IDA issued the final Guidelines in December 2009 and issued a press release to explain the<br />
Guidelines. IDA worked closely with the media to ensure that the public was made aware of<br />
the changes that would be put in place.<br />
• The final Guidelines were accompanied by an explanatory memorandum setting out IDA’s<br />
views and responses to the key comments received from the earlier consultation, and the<br />
considerations behind IDA’s decision.<br />
• IDA provided the operators with a three and a half month lead time to implement the<br />
Guidelines. Over the next few months, IDA continued to provide guidance to both operators<br />
as well as consumers on the implementation of the Guidelines.<br />
Learning points:<br />
• For issues in which public feedback and support is important, it is necessary to proactively<br />
engage the mass media to ensure that any consultation is widely publicised.<br />
• It is also important to ensure that technical policies are clearly explained and the materials<br />
made available are easily understood by the wider populace.<br />
• As part of the overall stakeholder management strategy, for decisions which may adversely<br />
affect any stakeholders, it is important to engage the stakeholders and provide some form of<br />
advance notification prior to announcing the final decision.<br />
<strong>Consultation</strong> process:<br />
• IDA conducted a public consultation on the proposed Guidelines on 23 December 2009,<br />
which lasted four weeks.<br />
• To ensure the issues were understood by the wider public, IDA avoided using industry jargon<br />
in the consultation paper, but tried to explain the issues and the proposed solutions in<br />
simple clear language.<br />
• IDA worked closely with the media to explain the issues in the consultation.<br />
Outcomes:<br />
• IDA received 13 sets of comments – three from telecommunication operators and 10<br />
from individual consumers. Consumers were overwhelmingly in favour of the proposed<br />
Guidelines, while responses from the telecommunication operators were mixed but<br />
generally negative. The media published two articles and an editorial on the proposed<br />
Guidelines.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 31 32 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
4. Unpopular decisions<br />
In the event that agencies have to decide on an outcome that is unpopular (i.e., where majority<br />
support is lacking) with stakeholders, steps have to be taken to manage the ground sentiment<br />
and mitigate the negative implications of the policy/initiative. Agencies are advised to:<br />
• Provide a detailed explanation of the rationale behind the decision,<br />
• Manage expectations by being clear about the scope of consultation and what measures can<br />
be changed and cannot be changed; and<br />
• Actively address the negative externalities, such as introducing measures to mitigate the<br />
adverse effects on the stakeholders.<br />
Case 10:<br />
Maintaining anti-euthanasia regulation<br />
Country:<br />
• Canada<br />
Background:<br />
• Euthanasia is officially illegal in Canada. Between 2005 and 2010, three private bills were<br />
tabled by a Member of Parliament to legalise euthanasia.<br />
<strong>Consultation</strong> Process:<br />
• Extensive debate was generated on the issue by provincial governments, non-governmental<br />
organisations, the media and individuals. For example, the Quebec provincial government<br />
conducted national assembly hearings which sought feedback from public and medical<br />
specialists. Non-government organisations (NGO) were also proactive in engaging the public<br />
on what euthanasia entailed.<br />
• The Angus Reid <strong>Public</strong> Opinion survey in 2010 showed that 67 per cent of respondents in<br />
Canada supported legalising euthanasia.<br />
Outcomes:<br />
• Despite public support for euthanasia, it was not legalised as there were insufficient votes in<br />
the House of Commons to advance the bill.<br />
• Many legislators recognised this was a sensitive issue requiring extensive debate which<br />
should continue to take place.<br />
• Guidelines and exceptions had been introduced to deal with special cases and legislation<br />
on euthanasia distinguished between passive and active euthanasia. The debate also<br />
emphasised the need to improve palliative and elder care.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 33 34 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Learning points:<br />
• While the legislation was not passed despite popular support, the extensive debate<br />
highlighted the polarity of views and key concerns of different stakeholder groups.<br />
• The debate highlighted areas of need of different stakeholder groups which needed to be<br />
addressed. Legislators were mindful that these requirements should be addressed quickly<br />
while the larger debate on the controversial topic would continue.<br />
Source:<br />
• Vision Critical, 2010, Angus Reid <strong>Public</strong> Opinion, Two-thirds of Canadians Express Support for Legalizing<br />
Euthanasia, .<br />
• International Task Force.org, Euthanasia and Assisted Suicide in Canada. <br />
• The Montreal Gazette, 16 Feb 2010, Doctors back ‘right to die’, <br />
• Toronto Sun, 21 Apr 2010, MPs band together to study palliative care, <br />
5. Controversial feedback<br />
With the introduction of new media, there are more public settings/forums where individuals<br />
can post extreme opinions or baseless claims. While participants are entitled to their opinions,<br />
there are cases where certain participants may post or bring up issues which are unreasonable<br />
or are not based on evidence.<br />
Due to the provocative nature of such comments, agencies need to handle the situation<br />
sensitively and moderate the discussion. Agencies should consider:<br />
• Removing controversial comments/postings from the public settings/forums. The agency<br />
should put a disclaimer statement in the public consultation process (e.g., in the new media<br />
platform used and information posted) that allows the agency the right to retain or remove<br />
any insensitive or controversial comments/postings received; and<br />
• Addressing the individuals or groups that raised the issue/concern through closed-door<br />
meetings.<br />
This allows the agencies to clarify their position on the issue and allows officers to resolve the<br />
concerns within a contained setting.<br />
6. Noise from minority groups<br />
Certain policies or initiatives may affect minority groups in a larger and disproportionate way<br />
compared to the majority stakeholders. Officers must balance the need to manage minority<br />
group requirements while at the same time not compromising the considerations for the<br />
majority. Minority group feedback, if not managed well, can lead to “noise” which will overcrowd<br />
and narrowly define the public consultation exercise for it to be effective.<br />
Agencies can consider:<br />
• Profiling affected stakeholders to anticipate concerns likely to be raised during the exercise;<br />
and<br />
• Assessing the need to conduct separate consultation exercises with minority groups to<br />
enable a more targeted resolution towards minority requirements.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 35 36 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Timeframe allocated to consultation period<br />
6. <strong>Consultation</strong> preparation<br />
and implementation<br />
With the establishment of the consultation strategy in the pre-consultation phase and<br />
conceptual development phase, the next phase would be to plan and implement the<br />
consultation exercise. This entails:<br />
The actual timeframe allocated to the consultation would vary with the nature, scope and extent<br />
of the policy/initiative undergoing development and the impact it has on the stakeholders.<br />
For a full-scale consultation, it is suggested that agencies allocate at least three months for the<br />
consultation process, with provisions for a longer duration if required.<br />
Logistical arrangements<br />
<strong>Public</strong> consultation is one of the customer touch points where agencies interact directly with<br />
the public. Feedback can also be collated in face-to-face sessions and not just via email. Hence,<br />
during the implementation of the consultation exercise, event management matters such as<br />
logistics and attitude of officers will affect the public’s opinion of the agencies. Some of the areas<br />
officers need to manage are captured in the checklist in Table 6-1 on page 37.<br />
• Developing the action plan and timeline of consultation;<br />
• Designing the consultation materials; and<br />
• Generating awareness amongst stakeholders to be consulted.<br />
6.1. Step 4: Develop action plan and timeline<br />
Officers need to set out an action plan and detailed timeline to implement the consultation<br />
strategy.<br />
Action plan<br />
The action plan provides a tool for the planning of the operational procedures required in a<br />
consultation exercise. Key components which need to be considered are:<br />
• Activities, such as:<br />
- Obtaining approval for the consultation strategy<br />
- Developing consultation materials<br />
- Making logistical preparation and planning<br />
- Determining the consultation period<br />
- Preparing the consultation report<br />
- Evaluating consultation effectiveness<br />
• Time required for each activity<br />
• Responsible parties involved<br />
The action plan should be continuously monitored to ensure that the activities are on track. A<br />
template of an action plan can be found in Appendix B.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 37 38 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Table 6-1: Checklist on Logistical Arrangements for <strong>Public</strong> <strong>Consultation</strong><br />
Invitation letters<br />
• Does the timeframe stated in the invitation letters provide sufficient notice to stakeholders?<br />
• Do the invitation letters contain all the relevant consultation materials and accurate information<br />
of the consultation exercise?<br />
• Do the invitation letters to the stakeholders clearly state the scope/parameter and objectives of<br />
the consultation?<br />
Event management<br />
• Is there sufficient space in the venue to cater for the expected number of participants?<br />
• Does the venue have the necessary equipment, such as sound system, audio visual equipment,<br />
projection screens, reception area?<br />
• Is the location chosen for the consultation wheel-chair accessible?<br />
• Is the venue accessible to all parties invited (e.g., for physically handicapped)?<br />
• Has sufficient food and/or refreshments been catered for?<br />
Accessibility of exercise<br />
• Is the mode of consultation accessible to all stakeholders invited to participate (including the<br />
illiterate, those who are not IT savvy, or the physically handicapped)?<br />
Materials<br />
• Will majority of the participants understand the materials prepared?<br />
• Do the materials provide sufficient background on the policy or initiative for the participants to<br />
provide meaningful feedback?<br />
Speakers/facilitators/moderators<br />
• Have the speakers/facilitators been sufficiently briefed about the background and objectives of<br />
the consultation exercise?<br />
• Have the speakers/facilitators been provided with sufficient additional materials to respond to<br />
anticipated questions or comments from the participants?<br />
• Have the speakers/facilitators been briefed on the participants’ profile and their general<br />
concerns?<br />
• Has a moderator been carefully selected to ensure the exercise stays on track and does not go<br />
out of focus?<br />
Additional information<br />
• Can the public obtain additional information on the specific policy/initiative during consultation<br />
exercise?<br />
Monitoring feedback<br />
• Are there mechanisms/resources to track the level of feedback and response rate during the<br />
consultation exercise?<br />
• Are there mechanisms to gather feedback on the effectiveness of the consultation exercise (e.g.,<br />
feedback forms for event)?<br />
• Is there a loop-back communication process to the stakeholders/public who provided key<br />
feedback at the exercise?<br />
6.2. Step 5: Design consultation materials<br />
Participants of public consultation need to be clear about the background of the issue/topic<br />
before they can be consulted. Effective design of consultation materials can ensure proper<br />
understanding, help shape direction of the discussion and increase the quality of feedback<br />
received.<br />
The consultation materials should contain sufficient information on a particular policy/initiative,<br />
giving stakeholders a proper grasp of the issue. The language used should be concise, jargonfree,<br />
and easy-to-understand for a layperson. In general, the consultation materials should<br />
contain information on the following:<br />
1. Background of policy<br />
• Impetus for new policy or change to existing policy<br />
• Key considerations and constraints<br />
2. Scope of consultation<br />
• Specific areas which stakeholders are consulted on, and where there is scope of influence<br />
3. <strong>Consultation</strong> process<br />
• Timeframe of consultation<br />
• How participants can provide feedback<br />
• Sources for more information (e.g., agency websites or hotlines)<br />
• How and when agencies will provide an update on the outcome of the consultation
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 39 40 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
In Singapore, the government may wish to also consider a four-phase communication strategy<br />
process 4 to consult on policies/initiatives<br />
6.3. Step 6: Generate awareness and plan<br />
public communication exercises<br />
Generating stakeholder awareness and planning a public communications exercise is a critical<br />
aspect of public consultation. There are generally two approaches for any agency to take as they<br />
prepare for a public communication and awareness exercise:<br />
1. Open consultation – this involves communicating to key stakeholders including the general<br />
public that a consultation exercise is going on. The agency should keep both the broadcast<br />
and print media aware of the issues and the actual consultation process. At the same time,<br />
the agency should try to think ahead and prepare their positions in anticipation of any<br />
difficult issues or responses raised.<br />
2. Closed door consultation – this involves only communicating to a selected or targeted<br />
group and inviting them to participate in the exercise. The consultation is conducted away<br />
from the public eye and the media.<br />
1. Listening phase – an early fact finding stage, where there is no need for any major public<br />
communications campaign. The messages during this phase could be to assure the public<br />
that no decision has been made and that a decision would be made only after rigorous<br />
evaluation of the issues involved.<br />
2. Holding phase – At this stage, press statements can be released to explain rationale for<br />
policy/initiative.<br />
3. <strong>Consultation</strong> phase – At this stage, state explicitly when and how public consultation would<br />
be conducted to ensure the public does not feel that the government has already made up<br />
its mind.<br />
4. Buy-in phase – With the assumption that a decision had been made on the policy/initiative,<br />
the government should explain why it decided on that policy and its plans.<br />
A public communications plan should be developed to provide a structured and well-planned<br />
approach to engage the stakeholders. A suggested communications plan checklist, outlining the<br />
key components of a communications plan, is outlined in Table 6-2.<br />
There are two key objectives in generating awareness:<br />
1. Educating stakeholders on the policy or initiative.<br />
This will increase the likelihood that the feedback<br />
provided will be meaningful.<br />
2. Increasing awareness about the consultation<br />
exercise, to ensure adequate participation from<br />
targeted stakeholders.<br />
Possible channels/platforms for<br />
raising awareness<br />
• Exhibitions and road shows<br />
• Government websites<br />
• Mailers<br />
• New media, e.g., blogs<br />
• Partnerships (with nongovernment<br />
organisations,<br />
business and trade associations,<br />
grassroot leaders<br />
• Media events<br />
• Press releases<br />
• <strong>Public</strong> notices<br />
• Information kits<br />
• Site visits<br />
4 Source: <strong>Public</strong> <strong>Consultation</strong>: Re-inventing Dialogue, Singapore: Centre of Governance and Leadership, <strong>Civil</strong> <strong>Service</strong><br />
<strong>College</strong>, 2004.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 41 42 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Table 6-2: <strong>Public</strong> Communication Plan Checklist<br />
Objectives of public communication exercise<br />
• Goals of this communications exercise (e.g., to generate awareness and increase participation<br />
level for public consultation)<br />
Key messages<br />
• Rationale for public consultation (why consult?)<br />
• Proposed changes to policy/initiative (what are the desired outcomes?)<br />
• What agency hopes to achieve from the consultation (what can we achieve?)<br />
• Potential benefits of proposed changes (what is the rationale for the proposed policy initiative?)<br />
• Specific messages for each of these groups<br />
Target Audience<br />
• Direct stakeholders<br />
- Who might benefit from policy changes?<br />
- Who might be affected by policy changes?<br />
- What are the specific implications on them?<br />
• Interest groups<br />
- Who might be interested in the issue?<br />
Strategies<br />
• For technical issues/policies/initiatives which are targeted at selected groups – determine if there<br />
is a need to engage in a publicity campaign or if engaging selected target groups in a closeddoor<br />
session would suffice<br />
• For general issues/policies/initiatives – wider publicity efforts may be needed as they impact the<br />
masses<br />
Tactics/channels<br />
• Select appropriate tools/media/platform according to the policy/initiative<br />
• Based on the target audience, select the most effective channel(s) of communication (e.g., web,<br />
portals, blogs)<br />
Timeline<br />
• When does the communication start?<br />
• When does the communication have to be completed by?<br />
• What are the key milestones in the exercise?<br />
Roles and responsibilities<br />
• Who are responsible for crafting, delivering and tracking the messages?<br />
• Have both the policy department and corporate communications department within the agency<br />
worked closely together to craft and launch the public communications exercise?<br />
Status<br />
• Track the completion status of activities (e.g., on track, completed, delayed)<br />
Evaluation<br />
• Determine/track whether the communications exercise was effective in generating<br />
awareness and increasing participation level<br />
Table 6-2: Suggested checklist for public communication exercises<br />
Source: Ministry of Information, Communications and the Arts (MICA)<br />
Case 11:<br />
URA Master Plan 2008<br />
Agency/country:<br />
• Urban Redevelopment Authority (URA), Singapore<br />
Background:<br />
• URA Master Plan 2008 guides Singapore’s physical development over the next 10 to 15 years.<br />
It incorporates the future development plans for key land uses such as housing, recreation,<br />
community, business, land transport and infrastructure needs.<br />
• <strong>Public</strong> consultation and stakeholder engagement was an integral part of the Master Plan<br />
process by URA.<br />
<strong>Consultation</strong> Process:<br />
• During the development of the Master Plan 2008, URA conducted stakeholder dialogues for<br />
the key growth areas of Jurong Lake District, Kallang Riverside, Paya Lebar Central and the<br />
new Islandwide Leisure Plan. The dialogues involved key stakeholders such as architects,<br />
developers, business organisations, NGOs, academics and the community. The dialogues<br />
allowed the plans to be detailed to the stakeholders and for them to give URA feedback<br />
on the proposals. Based on the input received, URA refined the proposals for the public<br />
exhibition.<br />
• The draft version of the Plan was exhibited to obtain public feedback<br />
- Virtual plans and videos were uploaded on the URA web portal; and<br />
- Physical plans, scaled models and videos were exhibited at the URA Centre.<br />
• Over 185,000 people viewed the draft Plan at the URA Centre and the website and 300<br />
written feedback was received on the Plan.<br />
• Based on the public input and feedback, the Master Plan 2008 was refined further before<br />
being gazetted on 10 Dec 2008.<br />
• In addition, URA developed a roving exhibition which brought the Master Plan 2008<br />
proposals to eight heartland malls. This raised public awareness of the Master Plan and<br />
key proposals and informed the wider populace of changes that would take place in their<br />
neighbourhoods.<br />
• More than 200,000 heartlanders visited the roving exhibition at the eight different venues.<br />
More than 1,300 written feedback was received. The online website garnered a visitorship of<br />
47,200 hits over the four-month period.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 43 44 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Outcomes:<br />
• The exhibitions served to educate and raise the awareness of Master Plan 2008 and<br />
its proposals, allowing the public to be aware of the existing attractions around their<br />
neighbourhood and the key changes that would be taking place at the national scale as<br />
well as in their local areas. It also allowed the public to provide meaningful feedback to the<br />
upcoming developments.<br />
Learning points:<br />
• The appropriate selection of channels and effective design of communications materials are<br />
important to be effective in generating awareness:<br />
- The use of visual exhibitions helped stakeholders to better understand the Master Plan<br />
2008, allowing them to provide meaningful feedback; and<br />
- Using different channels (e.g., physical exhibition, website, road shows) allowed URA to<br />
reach a wide audience.<br />
6.4. Step 7: Launch consultation exercise<br />
During the period of public consultation, it is important that stakeholder sentiment and<br />
expectations are well managed. The following highlights some key considerations:<br />
1. Be explicit about the scope of influence. <strong>Public</strong> officers need to be unambiguous about the<br />
parameters that are open for feedback in the consultation exercise. This will avoid creating<br />
false expectations that might result in stakeholder displeasure.<br />
2. Background knowledge. <strong>Public</strong> officers need to ensure that participants have relevant<br />
background materials and understand the policy/initiative under consultation. Please refer<br />
to Step 5 – designing consultation materials.<br />
3. Identify all feedback channels. Agencies need to make known to stakeholders all available<br />
feedback channels. The feedback channels should be intuitive and tailored to the targeted<br />
stakeholders.<br />
4. Be clear about the consultation timeline. Agencies need to state upfront the period of<br />
consultation and processing of feedback. Stakeholders should have a clear idea on when the<br />
agencies will close the loop with them and report the findings.<br />
5. Monitor the feedback received. Agencies should regularly monitor the level and type of<br />
feedback received. Agencies can then calibrate actions to be taken during the consultation<br />
exercise, such as extending the timeline, providing more background materials, or managing<br />
stakeholder sentiment.<br />
A case in point is illustrated on page 45.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 45 46 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Case 12:<br />
Penal Code (Amendment) Bill<br />
Agency/country:<br />
• Ministry of Home Affairs (MHA), Singapore<br />
Background:<br />
• MHA reviewed and proposed amendments to the Penal Code in 2007. As the Penal Code had<br />
a wide ranging impact on society, extensive public consultation was conducted to gather<br />
feedback and assess public sentiment.<br />
<strong>Consultation</strong> Process:<br />
• MHA posted the Amendment Bill on REACH’s Portal for the public to give their feedback and<br />
views.<br />
• MHA was explicit about the scope of influence; members of the public were invited to<br />
provide feedback for either one or all the amendments to the Penal Code.<br />
• To ensure participants had a clear context and background of the information a summary<br />
of the amendments to the Penal Code was provided in the e-portal of REACH to provide an<br />
explanation on the amendments. Presentations on the amendments were also delivered<br />
during the focus groups to prepare participants for the discussion.<br />
• MHA partnered REACH to post the Amendment Bill on REACH’s Portal for the public to give<br />
their feedback and views. A news release was also issued to inform members of the public on<br />
the consultation exercise.<br />
• MHA also worked with REACH to identify facilitators to conduct focus groups, and<br />
stakeholders to participate in them.<br />
• Feedback was sought from people from different walks of life, e.g., religious groups, voluntary<br />
welfare organisations (VWOs), students, grassroots members, social workers.<br />
• A women-only focus group was also set up to discuss the proposals, particularly those which<br />
concerned marital immunity which impacted them directly.<br />
• MHA also sought feedback from the Law Society on the proposed amendments.<br />
• MHA was upfront that the consultation would be over a period of five months.<br />
• REACH assisted MHA in monitoring feedback received over the e-portal and collated the<br />
feedback for MHA’s attention. MHA also actively monitored and collated feedback received<br />
from other channels such as feedback posted in the media, Law Society and focus groups for<br />
evaluation.<br />
Outcomes:<br />
• MHA evaluated the feedback received and incorporated some of the suggestions into the<br />
Bill.<br />
• The feedback was acknowledged in the Second Reading Speech in Parliament.<br />
7. Follow-up and analysis<br />
Closing the loop is a vital step in the public consultation process. After being consulted, the<br />
public will expect to know the outcome. Hence, after the consultation period ends, agencies are<br />
encouraged to follow up on:<br />
• Collating the feedback and closing the loop with stakeholders; and<br />
• Assessing the effectiveness of the consultation exercise and identifying areas for<br />
improvement.<br />
7.1. Step 8: Collate feedback and close the loop<br />
After the feedback is received from the participants, agencies need to collate the feedback to<br />
identify the common themes and important issues. Agencies should consolidate and categorise<br />
the feedback and data received and document the findings in a report.<br />
The report should contain the following information:<br />
• Number of participants;<br />
• Timeframe of the consultation exercise;<br />
• <strong>Consultation</strong> process (channels, feedback mechanisms);<br />
• Feedback received (categorised);<br />
• Explanation for accepting or rejecting each category<br />
of feedback; and<br />
• Limits of the consultation approach.<br />
In addition, agencies need to demonstrate that they recognise<br />
and acknowledge the contributions of participants and assure<br />
participants that their feedback has been taken into<br />
consideration. This will also serve to encourage further<br />
involvement in public consultation exercises in the future.<br />
“... a common grouse<br />
of the public who are<br />
unhappy with the<br />
government’s public<br />
consultation process is<br />
the oft quoted officious<br />
and non-committal<br />
replies they receive. Whilst<br />
they do not expect the<br />
government to agree to<br />
or accept every feedback<br />
and suggestion, they do<br />
expect the government<br />
to adequately address<br />
their concerns and explain<br />
the rationale for the<br />
decisions.”<br />
– Dr Amy Khor,<br />
Chairman REACH
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 47 48 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
The three stages of closing the loop and a suggested timeline are shown in the table below<br />
(Table 7-1):<br />
There are three stages in closing the loop which should be followed:-<br />
Stage What to incorporate Purpose Timeline<br />
3. <strong>Public</strong>ation<br />
Announce published report to other interested<br />
stakeholders or the general public.<br />
Acknowledgement • Recognition for<br />
feedback provided<br />
• Expected timeline<br />
for processing<br />
feedback<br />
• To demonstrate<br />
that the agency<br />
recognises and<br />
appreciates the<br />
contributions<br />
Within one working<br />
day<br />
2. Explanation<br />
Develop a report of participants’ feedback and<br />
the respective response by the agency. Share<br />
the report with the participants.<br />
Explanation • Details of<br />
consultation (date,<br />
duration, purpose)<br />
• Feedback provided<br />
by participants/<br />
stakeholders<br />
• Approach for<br />
considering<br />
feedback<br />
• Reasons for<br />
incorporating/<br />
not incorporating<br />
feedback<br />
• Outcome of<br />
consultation<br />
Note: Reports can<br />
be customised for<br />
different stakeholder<br />
groups, depending on<br />
the extent and nature<br />
of involvement<br />
• To close the loop<br />
with stakeholders<br />
who took effort<br />
and time to<br />
provide feedback<br />
• To explain to<br />
these participants<br />
how the feedback<br />
was processed,<br />
and reasons for<br />
incorporating/not<br />
incorporating the<br />
feedback<br />
• To provide<br />
assurance that<br />
the policy or<br />
initiative was<br />
developed with<br />
input from these<br />
stakeholders<br />
Varies depending<br />
on complexity of<br />
issue and agency’s<br />
decision making<br />
timeline<br />
1. Acknowledgement<br />
Generic, automated response to acknowledge<br />
individual feedback received.<br />
<strong>Public</strong>ation • Details of<br />
consultation<br />
• Summary of<br />
feedback provided<br />
• Outcome of<br />
consultation<br />
• To increase<br />
the public’s<br />
awareness of the<br />
initiative, and<br />
inform them<br />
about the issues<br />
and concerns<br />
raised, and<br />
how they were<br />
addressed<br />
Varies depending<br />
on complexity of<br />
issue and agency’s<br />
implementation<br />
timeline<br />
Table 7-1: Three stages of closing the loop
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 49 50 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Case 13:<br />
Registration framework for public accountants<br />
Agency/country:<br />
• Accounting and Corporate Regulatory Authority (ACRA), Singapore<br />
Background:<br />
• ACRA launched a consultation exercise in July 2007 to seek views on whether the registration<br />
framework for public accountants was sufficiently relevant and robust.<br />
<strong>Consultation</strong> Process:<br />
• ACRA engaged the profession and the business community by publishing the consultation<br />
report 2007 and the final report 2008 at ACRA’s annual <strong>Public</strong> Accountants Conference (PAC).<br />
The PAC was well attended by public accountants and representatives from the business<br />
community, with an average attendance of 500-700 persons. The PAC was therefore an<br />
effective channel for the consultation exercise.<br />
• ACRA pro-actively consulted the various stakeholders through focus group discussions,<br />
“consultation clinics”, written submissions and print media. The focus group sessions were<br />
useful, particularly for a number of the audit firms whose “peak season” occurred during the<br />
ACRA consultation period. Feedback was received from a number of firms that would not<br />
otherwise have provided their feedback during the consultation, as they were not able to<br />
devote their staff to prepare the written feedback (in one example, it was felt that having 10<br />
partners (senior management in audit firms) spend 2 hours to provide feedback to the ACRA<br />
team was more cost effective to the firm, compared to a few man days writing and vetting<br />
the feedback.<br />
• The stakeholders included public accounting entities (the big four firms), professional bodies<br />
(e.g., ACCA, CPA Australia), academics and general public.<br />
• The public consultation exercise took place over two months.<br />
• Closing the loop via ACRA’s annual <strong>Public</strong> Accountants Conference.<br />
• In 2008, ACRA closed the loop via a presentation to round up its consultation exercises.<br />
Outcomes:<br />
• The final report of the consultation outcomes were also posted on the ACRA website at<br />
http://www.acra.gov.sg/News_and_Events/<strong>Public</strong>+Accountants+Conference+2008.htm<br />
• Quality feedback and validation of ACRA’s Statements of policy intent and regulatory<br />
strategy: Stakeholders provided valuable feedback which supported and validated many<br />
of ACRA’s observations and proposals. At the ACRA conference which was well attended by<br />
the majority of the public accounting firms registered with ACRA, the ACRA representative<br />
also addressed feedback which did not translate into eventual policy decisions, or where<br />
the original proposal put forth for consultation was modified after due consideration of<br />
feedback.<br />
• Timely action resulting in good reputation of ACRA as a responsive government agency: The<br />
participants were pleased to note that ACRA did a prompt follow-through on the issue of the<br />
then “talent crunch” faced by the accounting profession, by committing to a review of the list<br />
of recognised qualifications for registering public accountants.<br />
Learning points:<br />
• Given the segmented nature of the public accountancy profession, the consultation enabled<br />
ACRA to better understand the diverse concerns of different stakeholder groups. The strategy<br />
to extensively reach out and engage different stakeholder groups ensured comprehensive<br />
coverage of the profession’s interest.<br />
• ACRA closed the loop effectively with participants and stakeholders through:<br />
(a) A well-documented report of the consultation exercise. The consultation<br />
report is available on the ACRA website at: http://www.acra.gov.<br />
sg/NR/rdonlyres/4C5D29D8-A7BC-4216-B951-18D47EAF0789/9845/<br />
TheRegistrationFrameworkfor<strong>Public</strong>AccountantsPathto.pdf<br />
(b) Arranging for the final report (post consultation) to be presented to the consulted<br />
parties, at an annual ACRA conference. In so doing, the consulted parties received<br />
the benefit of a face-to-face presentation, as well as the opportunities to clarify any<br />
remaining questions which they had on the policies being consulted.<br />
(c) Posting the presentation slides (outlining the outcome of the consultation exercise) on<br />
ACRA’s website. In so doing, the information contained in the “closing the loop” phase of<br />
the consultation process is “preserved” for future reference. It also helped ACRA maintain<br />
its reputation for being a transparent and responsive regulator.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 51 52 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Case 14:<br />
Identity Verification System (IVS)<br />
Country:<br />
• Department of Internal Affairs, New Zealand<br />
Background:<br />
• The New Zealand Department of Internal Affairs conducted public consultation to identify<br />
stakeholder expectations of the design and functions of the online secure government<br />
services.<br />
<strong>Consultation</strong> process:<br />
• The public provided clear and vocal feedback about the service design that they valued and<br />
expected.<br />
• After the public consultation exercise, the New Zealand government collated and analysed<br />
the feedback.<br />
• The results were published and reported in a document “What People Said”, which was<br />
released online on their government website and through other media forms.<br />
• “What People Said” report covered the details of the public consultation process, including:<br />
- The number of participants;<br />
- Timeframe of the consultation exercise;<br />
- Channels and tools for communication and their respective responses;<br />
- Evaluation and explanation of the analytical process for the feedback, and<br />
- Limits of the consultation approach.<br />
Outcomes:<br />
• Substantial support for the service led to its development. The service was partially available<br />
in 2009 and will be fully launched in 2011.<br />
7.2. Step 9: Assess effectiveness of the<br />
public consultation exercise<br />
The effectiveness of the public consultation exercise should be evaluated to:<br />
1. Assess whether involving the stakeholders contributed to improved services,<br />
actions or decision making,<br />
2. Find out what worked, what did not and why,<br />
3. Enhance learning and improve future practice; and<br />
4. Identify areas for improvement for future exercises.<br />
There are three suggestions for assessing effectiveness:<br />
1. Decision analysis, which assesses whether the strategic objectives of the consultation<br />
exercise were met.<br />
2. Process review, which assesses the effectiveness of the consultation process, e.g., whether the<br />
timeline was adhered to and whether the response rate was met.<br />
3. Participant satisfaction, which evaluates the general sentiment/satisfaction of participants<br />
who took part in the consultation process.<br />
The checklist on the following page (Table 7-2) can be used to assist officers in assessing the<br />
effectiveness of consultation exercises.<br />
Learning points:<br />
• The New Zealand government engaged an independent consultant to assist them in<br />
documenting the findings of consultation exercise. The release of the comprehensive report<br />
acknowledged the participants’ contribution to the issue, provided clarity to the participants<br />
on how their feedback was considered, and the outcome of the consultation exercise.<br />
Source:<br />
• The Department of Internal Affairs New Zealand, 2008. <strong>Public</strong> consultation about the igovt service<br />
– What people said, .
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 53 54 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Decision audit analysis<br />
Key considerations<br />
1. Were the strategic objectives of the consultation exercise met?<br />
2. Did the consultation result in an informed decision, shape a policy or an action?<br />
3. Has the consultation helped to improve the effectiveness of a service by making it match users’<br />
needs more closely?<br />
4. Did it lead to a change of policy or service?<br />
5. Has the consultation improved the relationship with the stakeholders?<br />
Process review<br />
Assessment<br />
Yes No NA<br />
1. 7.2. Was there Step sufficient 9: Assess awareness effectiveness generated about the consultation of the public exercise for consultation the targeted exercise<br />
stakeholders?<br />
2. Did all parties (e.g., staff, participants and partners) understand the objectives?<br />
3. Was the timeframe and process adhered to?<br />
4. Were the level of resources and support right?<br />
5. Were the right stakeholders involved?<br />
6. Was the consultation accessible (e.g., were materials available in other languages and formats,<br />
where necessary? Were interpreters provided or necessary? Were venues accessible?)<br />
The effectiveness of the public consultation exercise should be evaluated to:<br />
7.<br />
•<br />
Were<br />
Assess<br />
the<br />
whether<br />
methods used<br />
involving<br />
appropriate<br />
the stakeholders<br />
for the objectives?<br />
contributed to improved services, actions or<br />
8. Were decision the numbers making; that took part expected – was the initial target reached?<br />
9. • Did Find officers out what get the worked, information what needed did not in sufficient and why; time, depth and quality?<br />
10. • Were Increase results learning made known and to improve participants, future the wider practice; public and and relevant partner organisations?<br />
• Identify areas of improvement for future exercises.<br />
Participant satisfaction<br />
1. Did participants understand why they were asked to be involved in this consultation?<br />
There are three suggestions for assessing effectiveness:<br />
2. Did participants know their scope of influence (i.e., what this consultation could and could not<br />
influence)?<br />
1. Decision analysis, which assesses whether the strategic objectives of the consultation<br />
3. Was exercise the information were met; easy to understand, and did it provide them with sufficient background to<br />
provide meaningful feedback?<br />
4. 2. Was Process it easy review, for participants which to assesses give their views? the effectiveness of the consultation process, e.g., whether<br />
5. Were the timeline participants was given adhered the opportunity to, response to say everything rate was met; they wanted and to say?<br />
6. Were the practical arrangements for this consultation (e.g., meeting venues, refreshments,<br />
3. interpreters, Participant facilitators) satisfaction, satisfactory which to the evaluates participants? the general sentiment/satisfaction of participants<br />
7. Did who participants took part feel in that the their consultation contribution process. was listened to and respected?<br />
8. Are participants satisfied with the reported findings of the consultation exercise?<br />
The checklist on the following page (see Table 7 2) can be used to assist officers in assessing the<br />
9. Are participants aware of the outcome and key considerations behind the agency’s decision or<br />
course effectiveness of action? of consultation exercises.<br />
10. Do participants think the consultation made a difference to the decision?<br />
11. Did it generate a considerable volume of feedback?<br />
Assessment: Number of “Yes”<br />
Decision audit analysis = /5<br />
Process review = /10<br />
Participant satisfaction = /11<br />
Total = /26<br />
8. Conclusion<br />
This <strong>Toolkit</strong> serves to provide public officers with an overview of the process and tools for public<br />
consultation exercises. Given the diversity of stakeholders and issues/policies faced by different<br />
agencies at differing levels, the <strong>Toolkit</strong> is not meant to be prescriptive. Rather, agencies are<br />
encouraged to customise or modify the content to suit their own context and requirements.<br />
The <strong>Toolkit</strong> is an evolving document. New challenges may be encountered or new avenues/<br />
ideas generated. Agencies are encouraged to document their experiences in each consultation<br />
exercise for future reference and further improvements to the public consultation process.<br />
Table 7-2: Checklist for assessment of effectiveness
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 55 56 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Acknowledgements<br />
Index of case examples<br />
This document has resulted from the enthusiasm and knowledge of many public officers within<br />
the Singapore public sector. We would like to take this opportunity to specially thank all who<br />
have dedicated time and effort to participate in CSC’s focus groups and interviews. We would<br />
also like to thank the agencies who contributed case studies and other valuable suggestions<br />
which helped to enhance the content of this <strong>Toolkit</strong>.<br />
Participants of focus groups and interviews:<br />
Ministries<br />
• Ministry of Community Development, Youth and Sports (MCYS)<br />
• Ministry of Education (MOE)<br />
• Ministry of Finance (MOF)<br />
• Ministry of Foreign Affairs (MFA)<br />
• Ministry of Health (MOH)<br />
• Ministry of Home Affairs (MHA)<br />
• Ministry of Information, Communications and the Arts (MICA)<br />
• Ministry of Law (MinLaw)<br />
• Ministry of Manpower (MOM)<br />
• Ministry of Trade and Industry (MTI)<br />
• Ministry of Transport (MOT)<br />
• Prime Minister’s Office, <strong>Public</strong> <strong>Service</strong> Division (PMO-PSD)<br />
Statutory Boards<br />
• Accounting and Corporate Regulatory Authority (ACRA)<br />
• Central Provident Fund Board (CPFB)<br />
• Energy Market Authority (EMA)<br />
• Housing and Development Board (HDB)<br />
• Infocomm Development Authority of Singapore (IDA)<br />
• Internal Revenue Authority of Singapore (IRAS)<br />
• Land Transport Authority (LTA)<br />
• Monetary Authority of Singapore (MAS)<br />
• Media Development Authority (MDA)<br />
• National Arts Council (NAC)<br />
• National Environment Agency (NEA)<br />
• National Parks Board (NParks)<br />
• National Population Secretariat (NPS)<br />
• National Water Agency (PUB)<br />
• People’s Association (PA)<br />
• Singapore Customs<br />
• Spring Singapore (SPRING)<br />
• Urban Redevelopment Authority (URA)<br />
Non-Government Organisations<br />
• Council for Third Age (C3A)<br />
• Singapore Business Federation (SBF)<br />
• Singapore Council of Women’s Organisation (SCWO)<br />
• Singapore Children’s Society<br />
• Singapore Medical Association (SMA)<br />
• Tsao Foundation, Singapore<br />
Agency, country Case example Learning point Page<br />
1 Ministry of Education (MOE),<br />
Singapore<br />
2 Land Transport Authority<br />
(LTA), Singapore<br />
3 Murray-Darling Basin<br />
Commission, Australia<br />
4 Ministry of Manpower<br />
(MOM), Singapore<br />
5 Commission on the Future<br />
of Health Care, Canada<br />
6 National Parks Board<br />
(NParks), Singapore<br />
7 Ministry of Health (MOH),<br />
Singapore<br />
8 Monetary Authority of<br />
Singapore (MAS), Singapore<br />
9 Infocomm Development<br />
Authority (IDA), Singapore<br />
Regulatory regime for<br />
the private education<br />
sector<br />
‘Friends of LTA’<br />
The Living Murray River<br />
Restoration<br />
Tripartite efforts to<br />
overcome the downturn<br />
Improving public<br />
healthcare<br />
Sungei Buloh Wetland<br />
Reserve<br />
Proposed amendments<br />
to Human Organ<br />
Transplant (HOTA) Act<br />
Regulation of investment<br />
products<br />
Contract period and<br />
early termination<br />
charges for<br />
telecommunication<br />
services offered to<br />
consumers<br />
10 Canada Maintaining antieuthanasia<br />
regulation<br />
11 Urban Redevelopment<br />
Authority (URA), Singapore<br />
12 Ministry of Home Affairs<br />
(MHA), Singapore<br />
13 Accounting and Corporate<br />
Regulatory Authority (ACRA),<br />
Singapore<br />
14 Department of Internal<br />
Affairs, New Zealand<br />
An illustration of public<br />
consultation<br />
An illustration of public<br />
engagement<br />
Ensuring representativeness in<br />
stakeholder populations<br />
Forming partnerships with<br />
stakeholders<br />
Using appropriate tools to target<br />
stakeholders to be consulted<br />
Consulting on issue with high<br />
public interest<br />
2<br />
3<br />
14<br />
16<br />
19<br />
22<br />
Consulting on emotive issue 24<br />
Consulting on specific issue<br />
which focuses on targeted<br />
groups of participants<br />
27<br />
Consultating on technical issues 29<br />
Implementing policy against<br />
public opinion<br />
URA Master Plan 2008 URA Master Plan 2008 42<br />
Penal Code (Amendment<br />
Bill)<br />
Registration framework<br />
for public accountants<br />
Identity Verification<br />
System (IVS)<br />
32<br />
Launch of consultation exercise 45<br />
Closing the loop: Publishing the<br />
consultation report<br />
Closing the loop: Publishing the<br />
consultation report<br />
49<br />
51
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 57 58 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
References<br />
Guidelines<br />
• Corporate <strong>Consultation</strong> Secretariat 2000, Health Canada Policy <strong>Toolkit</strong> for <strong>Public</strong> Involvement<br />
in Decision Making, Canada, viewed 1 February, 2010,<br />
.<br />
• Gramberger, M., 2001. Citizens as Partners: OECD Handbook on Information, <strong>Consultation</strong> and<br />
<strong>Public</strong> Participation in Policy-making, Paris: OECD <strong>Public</strong>ations, France, viewed 29 January,<br />
2010, .<br />
• International Association for <strong>Public</strong> Participation (IAP2), 2010, IAP2 Core Values, viewed 25<br />
January, 2010, < http://www.iap2.org/displaycommon.cfm?an=4>.<br />
• International Association for <strong>Public</strong> Particiation (IAP2), 2010, IAP2 Spectrum of <strong>Public</strong><br />
Participation, viewed 22 January, 2010, .<br />
• International Association for <strong>Public</strong> Participation (IAP2), 2010, IAP2’s <strong>Public</strong> Participantion<br />
Toolbox, viewed 22 January, 2010, .<br />
• Nottinghamshire County Council, 2010, Assessment for effectiveness,United Kingdom,<br />
viewed 4 February, 2010 ,.<br />
• Organisation for Economic Co-operation and Development (OECD) <strong>Public</strong> Management<br />
Policy Brief, 2001, Engaging Citizens in Policy-making: Information, <strong>Consultation</strong> and <strong>Public</strong><br />
Participation, Viewed 25 January, 2010, .<br />
• Organisation for Economic Co-operation and Development (OECD), Reference Checklist<br />
for Regulatory Decision-Making,viewed 25 January, 2010, .<br />
• Organisation for Economic Co-operation and Development (OECD), OECD Background<br />
Document on <strong>Public</strong> <strong>Consultation</strong>, viewed 22 January, 2010, .<br />
• REACH Singapore, 2010, viewed 1 February, 2010, .<br />
• South Lanarkshire Council, 2010, South Lanarkshire Council’s Wheel of Participation, viewed<br />
29 January, 2010, <br />
• United Nations, 2008, World <strong>Public</strong> Sector Report 2008, People Matter – Civic Engagement<br />
in <strong>Public</strong> Governance, New York: United Nations <strong>Public</strong>ations, viewed 20 November, 2009,<br />
.<br />
Case examples<br />
Australia<br />
• Australian Human Rights Commission, 2010, Case study 2 - The Murray-Darling Basin – An<br />
ecological and human tragedy, Australia, viewed 26 January, 2010, .<br />
• Crase, L., Dollery, B. & Wallis, J., 2005, Community consultation in public policy: The case of the<br />
Murray-Darling Basin of Australia, Australian Journal of Political Science, 40, 221 – 237, viewed<br />
26 January, 2010, .<br />
• Macdonald, D. H., & Young, M., 2001, A case study of the Murray-Darling Basin, CSIRO Land and<br />
Water, viewed 26 January, 2010, .<br />
Canada<br />
• Dawn Ontario: DisAbled Women’s Network Ontario, 1998-2007, Responses to the final report<br />
by the Romanow Commission on the Future of Health Care in Canada, viewed 1 June, 2010,<br />
.<br />
• International Task Force, 2009. Euthanasia and Assisted Suicide in Canada, viewed 8 March,<br />
2010. .<br />
• Mapleleafweb.com: Canada’s Premier Political Education Website, Romanow Commission<br />
on the Future of Health Care: Findings and Recommendations, viewed 1 June, 2010, .<br />
• The Montreal Gazette, 16 Feb 2010, Doctors back ‘right to die’, viewed 8 March, 2010, .<br />
• Toronto Sun, 21 Apr 2010, MPs band together to study palliative care, viewed 11 May, 2010,<br />
<br />
• Vision Critical, 2010, Angus Reid <strong>Public</strong> Opinion, Two-thirds of Canadians Express Support<br />
for Legalizing Euthanasia, viewed 8 March, 2010, .
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 59 60 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
New Zealand<br />
• The Department of Internal Affairs New Zealand, 2008. <strong>Public</strong> consultation about the igovt<br />
service – What people said, viewed 26 January, 2010, .<br />
Singapore<br />
• Case compilations drafted by <strong>Civil</strong> <strong>Service</strong> <strong>College</strong>, Singapore.<br />
• Gwee, J.2004, <strong>Public</strong> <strong>Consultation</strong>: Re-inventing Dialogue, Singapore: Centre of Governance<br />
and Leadership, <strong>Civil</strong> <strong>Service</strong> <strong>College</strong><br />
• Land Transport Authority, 2009. Friends of LTA case study, viewed 1 February, 2010,<br />
.<br />
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Appendices
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 61 62 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Appendices Content<br />
Appendix A : <strong>Consultation</strong> tools<br />
<br />
1. Community meetings <br />
2. Exhibitions/road shows 5<br />
3. <strong>Public</strong> forums 7<br />
4. Surveys 6 8<br />
5. Blogs 70<br />
6. Social media 72<br />
7. Websites 74<br />
8. Focus group discussions 76<br />
9. Workshops 78<br />
10. Charrettes 80<br />
11. Citizen juries 81<br />
12. Delphi process 82<br />
13. Expert panels 83<br />
14. Interviews 84<br />
15. Working groups 85<br />
Appendix B : Planning Aid for <strong>Public</strong> <strong>Consultation</strong> 86
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 63 64 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Appendix A:<br />
<strong>Consultation</strong> tools<br />
1. Community meetings<br />
Community meetings are dialogue sessions organised with<br />
stakeholders from localised or targeted communities.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
Tools<br />
Feel the<br />
pulse<br />
Test/<br />
refine<br />
Obtain<br />
buy-in<br />
Page<br />
reference<br />
1. Community meetings 3 3 3 64<br />
2. Exhibitions/road shows 3 3 65<br />
3. <strong>Public</strong> forums 3 3 3 67<br />
4. Surveys 3 3 68<br />
5. Blogs 3 3 3 70<br />
6. Social media 3 3 3 72<br />
7. Websites 3 74<br />
8. Focus group discussion 3 3 76<br />
9. Workshops 3 78<br />
10. Charrettes 3 3 80<br />
Target audience<br />
General public/large<br />
stakeholder population<br />
General public<br />
(IT-savvy population)<br />
The target audience of such meetings include individuals in<br />
specific housing districts or local community organisations.<br />
Before conducting community meetings, agencies<br />
should determine:<br />
• Date and Time – consider who the target audience is and<br />
the other obligations they may have. Bear in mind other<br />
events that could clash with the meeting.<br />
• Venue – choose a venue that is familiar to your target<br />
audience and the special needs they may have e.g., elderly<br />
or disabled individuals.<br />
• Speakers – ensure that the speaker(s) or facilitator(s)<br />
are thoroughly briefed about the purpose and details of<br />
the community meeting. Provide them with background<br />
materials and a list of frequently asked questions to help<br />
address queries from the community.<br />
When is it most useful?<br />
Community meetings are useful for:<br />
• Consulting with targeted group of stakeholders most<br />
affected by policies. For example, changes which affect<br />
their neighbourhood or living environment.<br />
• Leverage on partners<br />
(e.g. People’s Association,<br />
grassroot leaders, NGOs)<br />
who can help to identify<br />
participants, publicise<br />
the event and facilitate<br />
discussion.<br />
• Prepare information on<br />
related topics to address<br />
any questions participants<br />
may ask, even if the topics<br />
are under the purview of<br />
other agencies.<br />
• Consider conducting the<br />
sessions in more than<br />
one language to allow<br />
greater representation in<br />
stakeholder groups.<br />
11. Citizen juries 3 3 81<br />
12. Delphi process 3 3 82<br />
Targeted to subject<br />
matter experts,<br />
stakeholder population<br />
• Gathering feedback from the general public to reach<br />
individuals from all walks of life.<br />
Considerations<br />
13. Expert panels 3 3 3 83<br />
14. Interviews 3 3 84<br />
15. Working groups 3 85<br />
Participants may be varied in their understanding or<br />
background knowledge of the topic. It is therefore important<br />
for the meeting to provide sufficient background information<br />
on the policy or initiative being consulted so that the<br />
feedback is meaningful.<br />
Its is equally important to appoint an effective facilitator to<br />
moderate the meetings and keep it from going off track.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 65 66 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
2. Exhibitions/road shows<br />
Exhibitions or roadshows allow agencies to utilise numerous<br />
formats to engage and share information with the public<br />
and obtain public feedback. During these events, agencies<br />
can provide a visual representation of the issues at hand<br />
(e.g. housing projects, nature parks). It also provides an<br />
opportunity for greater interaction between staff and the<br />
public.<br />
Agencies should determine the types of media available at<br />
the event, and prepare the necessary items such as flyers,<br />
information guide and presentations.<br />
The target audience for such exhibits/road shows are the<br />
general public.<br />
Before conducting exhibitions/road shows, agencies<br />
should determine:<br />
• Location – ensure that the location chosen for the event<br />
is easily accessible to the target audience. It should be<br />
conveniently located, welcoming and comfortable.<br />
• Atmosphere – an exhibition/road show provides agencies<br />
the opportunity to be creative in the way information is<br />
presented. Ensure that the variety of media planned for<br />
display is interesting without being overwhelming.<br />
• Content – information should be tailored to the target<br />
audience. If a sensitive topic is being addressed, ensure<br />
that personnel are well-equipped to handle potentially<br />
difficult members of the public.<br />
• Staff – ensure that officers selected for the event are well<br />
equipped with the knowledge and information to explain<br />
concepts and answer questions or gain feedback from the<br />
public. Officers should be trained to be polite, courteous<br />
and helpful. It would also be beneficial to have multilingual<br />
officers available to attend to members of the<br />
public who are non-English speakers.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Ensure that the variety of<br />
media planned for display<br />
is interesting without<br />
being overwhelming.<br />
• If feedback is obtained<br />
from comment cards or<br />
short questionnaires,<br />
ensure that they are<br />
prominently displayed.<br />
Always supply writing<br />
materials.<br />
• Consider documenting the<br />
verbal feedback received<br />
at roadshows.<br />
When is it most useful?<br />
Exhibitions/road shows are most useful when a substantial amount of visual representations<br />
are required to adequately explain the subject (e.g. architectural concepts). They allow for the<br />
use of interactive technology, and provide a comfortable avenue for confrontational issues to<br />
be discussed. Exhibitions/road shows are also beneficial in reaching an audience that may not<br />
otherwise be involved in consultation. They allow members of the public who may not speak<br />
English to engage with the issues through staff who are trained in another language or dialect.<br />
Considerations<br />
Exhibitions/road shows can be very staff intensive, and a large amount of preparation is required<br />
to ensure that the event is smooth-running.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 67 68 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
3. <strong>Public</strong> forums<br />
4. Surveys<br />
<strong>Public</strong> forums/dialogues are large-scale gatherings which can<br />
be used to obtain general feedback.<br />
The target audience of public forums include general public or<br />
large stakeholder groups who are impacted or interested in a<br />
particular issue.<br />
Before conducting public forums, agencies should<br />
determine:<br />
• Date and time – consider who the target audience is<br />
and the other obligations they may have, to determine<br />
the most convenient date/time to hold the forum. Bear in<br />
mind other events that could clash with the meeting.<br />
• Venue – choose a venue that is familiar to your target<br />
audience and the special needs they may have (e.g. elderly<br />
or disabled individuals).<br />
• Speaker(s) – choose a speaker or panel of speakers<br />
with sufficient seniority and experience to engage<br />
the audience effectively. Ensure that the speakers are<br />
thoroughly briefed about the purpose and details of the<br />
forum.<br />
When is it most useful?<br />
<strong>Public</strong> forums are useful for policy issues that affect a large<br />
proportion of the public. The forums can be used to educate<br />
stakeholders about the policy and obtain general feedback.<br />
<strong>Public</strong> forums are typically less useful for gathering in-depth<br />
feedback from specific stakeholders.<br />
Considerations<br />
<strong>Public</strong> forums carry the risk that the agenda may be<br />
dominated by interest groups or vocal individuals. This is<br />
particularly the case if the policy or initiative being consulted<br />
is sensitive or emotive.<br />
Its is equally important to appoint an effective facilitator to<br />
moderate the meetings and keep it from going off track.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• <strong>Public</strong>ise the meetings<br />
through engaging the<br />
media (e.g., broadcast or<br />
print), and if appropriate,<br />
make the material<br />
available online.<br />
A survey or questionnaire is essentially a series of questions<br />
used to solicit information from individuals. The questions<br />
can be open-ended (i.e., where participants can provide<br />
qualitative feedback), closed (i.e., where questions have<br />
pre-defined answers that respondents can select from), or a<br />
combination of both.<br />
It can be conducted through various modes, including inperson,<br />
telephone postal and internet. The resources required<br />
to conduct the surveys will depend on the modes of survey<br />
selected.<br />
The target audience of surveys are typically randomly selected<br />
individuals who represent the larger target population for a<br />
policy/initiative.<br />
Before using surveys, agencies must determine:<br />
• Content – agencies must have clear objectives and<br />
understand why they are surveying the general public.<br />
The survey should ideally contain no more than 10 to 15<br />
questions. Questions should be direct, brief and simple.<br />
Long, multipart questions should be avoided.<br />
• Type – all surveys should be tested with a pilot audience<br />
prior to mass use in order to procure feedback about how<br />
the survey can be improved. Agencies need to decide the<br />
amount of time and resources they have available before<br />
choosing a survey method.<br />
Different modes of survey<br />
a) In-person survey: This can be conducted through door-todoor<br />
interviews, or street-intercept interviews.<br />
• When is it useful?<br />
Surveys conducted in person are useful for obtaining<br />
immediate feedback and information from respondents.<br />
Questions can be asked and clarified as they arise. This<br />
mode of survey typically has a higher rate of response.<br />
• Considerations<br />
This method requires an on-site officer at all times and<br />
can be labour-intensive. Officers need to be aware of the<br />
issues of privacy and space for participants. The presence<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Be as specific as possible.<br />
Instead of subjective<br />
questions like ‘do you use<br />
this facility often’, change<br />
this to specify conditions,<br />
such as ‘never, once a week,<br />
more than three times a<br />
week’.<br />
• Break a topic down into<br />
distinct elements with a<br />
question on each.<br />
• Ask relevant questions –<br />
do not waste respondents’<br />
time by asking questions<br />
unrelated to the topic.<br />
• Keep the survey brief, it<br />
should ideally take 5-10<br />
minutes to complete.<br />
• Provide incentives (e.g.<br />
cash vouchers, discount<br />
coupons) to increase the<br />
response rate.<br />
• Try not to appear<br />
judgmental or impose<br />
personal views when<br />
conducting surveys,<br />
so as not to influence<br />
participants.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 69 70 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
of the surveyor and the public setting may compel the participants to respond in a certain<br />
manner and bias the survey results.<br />
b) Telephone survey<br />
• When is it useful?<br />
Telephone surveys are useful for general attitudinal surveys. Agencies can explore options<br />
with participants and assist them with unfamiliar words or questions. This method yields fast<br />
results, and has a higher response rate than mailed-in surveys.<br />
• Considerations<br />
Although to a lesser extent than in-person survey, the tele-surveyor may still compel the<br />
participants to respond in a certain manner and bias the survey results. For this method to<br />
work successfully, officers must be trained to handle questions and different personalities<br />
over the phone sensitively and objectively. Depending on the profile of the target audience,<br />
surveyors may need to be proficient in different languages.<br />
c) Mailed survey: Surveys can be mailed to the home or organisation addresses of the target<br />
audience.<br />
• When is it useful?<br />
Mailed surveys can reach a large geographical location and are less labour-intensive than<br />
in-person or telephone surveys conducted. Participants can complete the surveys at their<br />
convenience and in private; hence it is suitable for sensitive issues.<br />
• Considerations<br />
It is harder for participants to seek clarification for mailed surveys. This method is limited<br />
to literate members of the public and requires an up-to-date address list. There also tends<br />
to be a lower response rate for mailed survey because it requires participants to take the<br />
additional step of returning the surveys to the agencies.<br />
d) Internet survey: E-mail and online surveys (distributed through a website link) are the key<br />
forms of internet surveys. Links explaining different terms or concepts can also be provided<br />
online to provide more comprehensive information. Data is automatically entered into a<br />
database and can be automatically analysed or exported to other software programmes.<br />
When is it most useful?<br />
<strong>Public</strong> forums are useful for policy issues that affect a large proportion of the public. The forums<br />
can be used to educate stakeholders about the policy and obtain general feedback. <strong>Public</strong><br />
forums are typically less useful for gathering in-depth feedback from specific stakeholders.<br />
Considerations<br />
<strong>Public</strong> forums carry the risk that the agenda may be dominated by interest groups or vocal<br />
individuals. This is particularly the case if the policy or initiative being consulted is sensitive or<br />
emotive.<br />
5. Blogs<br />
A blog (a contraction of the term ‘web log’) is a website<br />
that usually contains informal commentaries or personal<br />
opinions about a subject. Feedback functions in the blogs<br />
allow the public to provide comments and responses to<br />
the information posted. Agencies also have the option of<br />
embedding their blog on the agency’s website. The blog page<br />
can then be easily updated either through the website or<br />
through applications on mobile devices.<br />
Through this medium, agencies or public figures such as<br />
Ministers can ask the opinions of blog readers on a specific<br />
subject or test the reaction of blog readers towards a certain<br />
topic. This can allow the government to conduct informal<br />
or “soft” consultation with the public. In addition, the<br />
contributor(s) can also provide an insider’s perspective on<br />
various policies (e.g. tax) and events (e.g. National Day). Such<br />
posts allow the public to relate to the government on a more<br />
personal and informal level.<br />
The main distinction between the government’s website<br />
and blog posts is that the website provides comprehensive<br />
information, while blog posts provide snippets of information<br />
– summaries, opinions, circumstances and reasons<br />
surrounding various policies and principles. Typically, blogs<br />
present the contributors’ personal perspectives.<br />
The target audience of blogs are technologically-savvy<br />
individuals.<br />
How it works<br />
A typical blog combines text, images, video and links to other<br />
blogs or websites. An account is first created at a blog website<br />
(e.g. blogspot.com). The blog page can be personalised, or<br />
selected from a template, and finally, the contributor can<br />
begin sharing content online.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Keep blog posts<br />
interesting – readers are<br />
keen to explore issues on a<br />
personal level.<br />
• Short posts are fine if timeconstraints<br />
are present.<br />
The key is to be consistent<br />
between time spans of<br />
blog posts.<br />
• ‘Tag’ entries according to<br />
different categories, so that<br />
readers may be able to<br />
search for similar topics on<br />
the blog.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 71 72 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
Before using blogs, agencies should determine:<br />
• Content – the level of information that they wish to disseminate. Agencies should always<br />
keep in mind that they would be contributing to a ‘public blog’ and as such, should be<br />
sensitive to the readers they may have.<br />
• Privacy and safety – never distribute private information that the public does not need to<br />
know about, e.g. personal schedules, numbers or addresses.<br />
When is it most useful?<br />
Blogs are useful for sounding out ideas and testing the reaction of readers towards a certain<br />
topic, to conduct informal or ‘soft’ consultation with the public. It also provides agencies with an<br />
informal setting to connect with the public and creates an opportunity to ‘humanise’ abstract<br />
issues.<br />
Considerations<br />
Contributors should consider the implications of their words to the general public, and should<br />
always bear in mind that their posts are available on the public domain.<br />
Agencies should also note that the blog discussion takes place on a public domain. Agencies<br />
therefore need to be prepared for negative comments and responses in a public domain which<br />
may potentially influence the views of other readers.<br />
6. Social media<br />
Social media (e.g. Facebook, twitter, LinkedIn) is a new form of<br />
technologically-enabled consultation tool, where government<br />
policy information can be instantaneously disseminated to a<br />
multitude of people. It has the additional benefit of being a<br />
‘two-way’ channel of communication where participants can<br />
comment or reply almost immediately.<br />
Social media are useful for agencies to informally consult and<br />
engage with the population. Similar to blogs, public officers<br />
or government agencies can post comments/ideas/issues on<br />
the websites and the general public can respond to them.<br />
The target audience for such social media are younger, more<br />
technologically-savvy individuals. In the advent of mobile<br />
broadband technology, these participants are able to access<br />
information in transit and are no longer confined to a<br />
particular geographical location, time of day, or availability of<br />
information outlets (e.g. news stands, television or radio).<br />
How it works<br />
Social platforms often merge features such as email, instant<br />
messaging, image and video sharing, applications and ‘status<br />
updates’. It allows for the creation of ‘groups’ that participants<br />
can join where they receive relevant information pertaining<br />
to that particular ‘group’. Users are often allowed to log in to<br />
one interface with numerous features, rather than needing to<br />
filter through a myriad of social interaction applications (e.g.<br />
instant messaging programmes, YouTube).<br />
An account is first set up by the agency before the various<br />
tabs/applications can be populated accordingly. The typical<br />
sections available are as follows:<br />
• Summary page (e.g. ‘wall function in Facebook’) – the<br />
summary page displays status updates, and links or videos<br />
with summaries to relevant sites from the agency. It<br />
provides an informal avenue for government agencies to<br />
keep the public informed about current events.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Responding to comments<br />
within a short period of<br />
time gives participants a<br />
sense that the government<br />
is managing the channel<br />
and is actively taking an<br />
interest in their feedback.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 73 74 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
• Profile – this describes the agency and what its purpose and objectives are (it is essentially<br />
the agency’s biography). This tab can also be linked to the agency’s main website, Twitter<br />
account and other relevant sites associated with the agency.<br />
• Events – this updates participating fans and followers regarding events that the agency may<br />
be organising (e.g. meet and greets, gathering for focus groups or discussions). Participants<br />
may accept or decline invites to such events, or simply pass the message along to ‘friends’ on<br />
their accounts.<br />
• Pictures and videos – this gives the agency an opportunity to humanise the government.<br />
Photos and videos of events and people provide the public with a more casual and<br />
approachable means of accessing the agency, and the processes culminating in the<br />
construction of respective policies.<br />
• Discussion – this function gives participants the opportunity to set up their own ‘forums’. It<br />
should be carefully moderated by the agencies to ensure appropriate content is posted.<br />
When is it most useful?<br />
The design and informal nature of social media encourages the public to be more open and<br />
honest in their feedback. The advantage of this is that the government can gauge the actual<br />
ground sentiments on a particular issue.<br />
Considerations<br />
The drawback of new media is that some users might publish insensitive, untrue or<br />
discriminatory remarks on the forum. This may tarnish the reputation of the agency and even<br />
the country. Hence, usage of new media needs to be properly planned and actively managed to<br />
mitigate the risk factors.<br />
New media respondents tend to be of a certain demographic profile and agencies should be<br />
mindful of that and balance with feedback from other sources, if necessary, for a consultation<br />
exercise.<br />
7. Websites<br />
A government website is an information platform hosted on<br />
the internet that can contain details on government policies,<br />
key issues, press releases, and events.<br />
Agencies can conduct public consultation through websites<br />
by publishing an electronic consultation paper/document<br />
on the website. The general public can view the document<br />
and provide feedback to the agencies either via a feedback<br />
channel on the website itself, or through emails.<br />
Another website platform for agencies to conduct public<br />
consultation is REACH (reaching everyone for active<br />
citizenry@ home – http://www.reach.gov.sg/). REACH was<br />
launched in October 2006 when the Feedback Unit was<br />
restructured to move beyond gathering public feedback,<br />
to become the lead agency for engaging and connecting<br />
with citizens. REACH was created to encourage and promote<br />
an active citizenry through citizen participation and<br />
involvement.<br />
Agencies can leverage on the REACH website to host<br />
electronic consultation document, conduct an opinion poll<br />
on a specific issue and as a source of general feedback from<br />
the public through the various forums available on the REACH<br />
website.<br />
The target audience of websites is the general public that are<br />
literate and have access to the Internet.<br />
Before using websites for public consultation,<br />
agencies should consider:<br />
• Content – <strong>Consultation</strong> papers posted on websites should<br />
be accessible, concise and easy-to-understand for a<br />
layperson without background technical information.<br />
• Layout – having a layout that is clean, simple, and easyto-navigate<br />
is critical. Users should be able to find the<br />
material they are looking for with ease.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Websites can be<br />
complemented by social<br />
media such as Facebook<br />
and Twitter to inform<br />
the public of changes on<br />
the site, such as content<br />
updates.<br />
• Consider offering the<br />
website in more than one<br />
language to extend its<br />
outreach.<br />
• Ensure that there is<br />
sufficient bandwidth to<br />
support the volume of<br />
visitor ‘traffic’.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 75 76 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
• Awareness – websites are passive channels. Therefore, to solicit feedback on consultation,<br />
sufficient awareness should be generated about the consultation exercise. Allow users the<br />
option to subscribe to ‘email’ updates or RSS feeds as and when there is new information on<br />
the website.<br />
When is it most useful?<br />
Websites are useful for conducting consultation with members of the public who are literate,<br />
IT savvy, and have a good command of the English language. It allows detailed information to<br />
be made available to the public in the form of a consultation document. It can also be used for<br />
surveys to obtain quick polls, as well as allow active discussion of a topic (e.g. forum).<br />
Considerations<br />
Websites may not be able to reach out to members of the public who are illiterate, do not have<br />
access to computers, are not IT-savvy and do not have good command of the English language.<br />
Information posted on websites also tend to be less interactive (with the exception of blogs and<br />
forums). It is therefore recommended that when websites are used in public consultation, they<br />
should be used in conjunction with other tools which allow greater interactivity and are able to<br />
reach a more diverse audience.<br />
8. Focus group discussions<br />
A focus group discussion (FGD) is a platform where a<br />
facilitator discusses and gathers feedback from a group<br />
of individuals. Groups typically consist of six to 10 people<br />
specifically selected to meet specific criteria in order<br />
to broadly represent a particular segment of society,<br />
or communities of interest (e.g., age group, affiliated<br />
associations, ethnicity and educational level). FGDs typically<br />
last for one to two hours.<br />
The target audience for FGDs is generally the direct<br />
stakeholders and individuals with specific knowledge,<br />
experience and/or interest in the policy/initiative that the<br />
agency is consulting on.<br />
Before conducting FGDs, agencies should determine:<br />
• Purpose – agencies must be clear about the purpose<br />
of the discussions so as not to be distracted during the<br />
allotted time. They should determine a set of questions<br />
that will be asked, and be prepared to steer the discussion<br />
back on track if participants go off course.<br />
• Facilitator – given the time constraints of FGDs, the<br />
facilitator chosen should be skilled and tactful in<br />
encouraging participants to provide useful feedback<br />
without frequently going off-topic. The discussion should<br />
be guided in a structured manner.<br />
• Recruitment – FGD participants can be selected through<br />
random sampling. Agencies can also work with relevant<br />
partners (e.g. associations, grassroot leaders, NGOs)<br />
to identify participants from the targeted stakeholder<br />
groups.<br />
• Venue – discussions should be held in a quiet room,<br />
free from noise or interruptions. It should also be easily<br />
accessible to FGD participants.<br />
• Resources – ensure sufficient writing materials are<br />
available during discussions so that participants can<br />
actively make notes or provide visual representation for<br />
their ideas.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Ensure that to the<br />
participants are clear<br />
about the purpose of<br />
the FGD, and how their<br />
feedback will be handled.<br />
• Acknowledge<br />
contributions made by<br />
participants so they will be<br />
encouraged to continue<br />
providing feedback.<br />
• Agencies can consider<br />
conducting focus groups<br />
for non-English speakers<br />
to ensure stakeholder<br />
populations are well<br />
represented.<br />
• Grouping similar types of<br />
participants together help<br />
to reduce inhibition and<br />
promote discussion.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 77 78 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
• Recording – the FGDs should be recorded (taped, transcribed or documented) to ensure<br />
accuracy. These notes can be used for analysis at a later date. Always inform participants if<br />
they are being recorded during the session.<br />
When is it most useful?<br />
• FGDs are most useful when issues need to be explored in-depth, and when there is a need<br />
to understand reasons for attitudes, behaviours or generating new ideas. Agencies are able<br />
to obtain a snapshot of public opinion when time constraints do not allow a full review or<br />
survey.<br />
• FGDs can also be used in conjunction with surveys to identify issues that need to be<br />
quantified, as well as after a survey is conducted to investigate results in greater depth.<br />
Considerations<br />
FGDs may be too small or biased to provide reliable results. Additionally, this method may<br />
involve payment to participants – an appropriate method of payment and amount should be<br />
decided beforehand, and participants should be informed of this.<br />
9. Workshops<br />
A workshop is an informal meeting that includes plenary and<br />
breakout discussion sessions between participants.<br />
A workshop is facilitated by an officer skilled in groupwork,<br />
who can encourage quieter members of the group<br />
to speak up while creating a constructive, problem-solving<br />
atmosphere.<br />
The discussion is focused, but not overly formal, the aim of<br />
which is for everyone to participate comfortably. Workshops<br />
allow individuals to network and exchange ideas and to<br />
develop an action plan recommendations or proposals.<br />
The target audience for this tool is selected individuals with<br />
knowledge and/or experience in the relevant area.<br />
Before conducting workshops, agencies should<br />
determine:<br />
• Topic – agencies need to ensure that the topic is<br />
sufficiently precise and meaningful to participants.<br />
Background information may be sent out to participants<br />
prior to the workshop so that participants are prepared.<br />
• Group sizes – group sizes should be large enough to<br />
encourage lively deliberation, but not so large that most<br />
participants are unable to be involved effectively. The ideal<br />
size would be 15 to 20 participants.<br />
• Venue – ensure the room chosen is of an appropriate size<br />
that will comfortably accommodate the workshop. Ensure<br />
participants with disabilities or special needs have full<br />
access.<br />
• Facilitator – an experienced facilitator will enhance<br />
the quality of the workshop by creating a conducive<br />
environment that encourages discussion, while remaining<br />
neutral. Facilitators must work to keep participants<br />
realistic in the solutions they suggest.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Give busy participants<br />
ample notice to allow<br />
them to fit the workshops<br />
into their schedule.<br />
• Ensure that logistical<br />
considerations such as<br />
room availability and food<br />
services are planned well<br />
in advance.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 79 80 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
• Activities – ensure that the session enables participants to:<br />
- Understand the policy or initiative at hand (e.g. through presentations, background<br />
reading),<br />
- Brainstorm, discuss and develop strategies or options (e.g. breakout groups, debates,<br />
voting),<br />
- Present the key resolutions of their discussion; and<br />
- At the end of the workshop, gather all participants for closing remarks informing them of<br />
how the proceedings of the workshop will be shared.<br />
When is it most useful?<br />
Workshops are most useful when bringing representatives from diverse groups who have a<br />
common interest in an issue, but bring different perspectives as to how the issue should be<br />
addressed. This process works best when it is limited to participants who are actively involved,<br />
interested and directly impacted by the issue, who will be motivated to find practical, feasible<br />
solutions to the proposed issue.<br />
Considerations<br />
Proper facilitation and grouping of participants are key to the success of workshops. Otherwise,<br />
a small number of participants may dominate the discussion. The selection of the participants is<br />
also important. In a small, self-selected group, viewpoints from other unrepresented members of<br />
the stakeholder groups will be absent.<br />
10. Charrettes<br />
A charrette typically involves intense and possibly multi-day<br />
sessions involving different stakeholders. The session is akin<br />
to a visual brainstorming meeting which serves as a way of<br />
quickly generating ideas within a specified time limit, tapping<br />
on the aptitudes and interests of a diverse group of people.<br />
The target audience for this tool is selected individuals with a<br />
stake in the issue, or experts who can contribute to the design<br />
of the solution. For example, in the context of urban planning,<br />
this could include government officials, developers, residents<br />
and architects.<br />
Before using charrettes, the agency should<br />
determine:<br />
• Issues – agencies need to be clear and focussed about the<br />
purpose of the activity, and the scope of feedback desired.<br />
• Setting – as charrettes are typically used for<br />
brainstorming, the setting should encourage openness<br />
and creativity.<br />
• Facilitator – an experienced facilitator is important to<br />
ensure that a variety of views are heard and the discussion<br />
is kept on track<br />
When is it most useful?<br />
A charrette is a problem-oriented tool – it encourages full<br />
participation and discussion about interrelationships and<br />
impacts of policies. It is most effective early in the projectplanning<br />
phase where brainstorming is required. Charrettes<br />
are usually deployed for design-related matters, such as the<br />
design of a new town centre, urban planning, etc.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• If there are multiple<br />
stakeholder groups with<br />
diverse views involved,<br />
agencies can also consider<br />
conducting separate<br />
charrettes for each group.<br />
Considerations<br />
Charrettes are relatively exclusive because only the experts<br />
are usually invited to participate. Thus participants may not<br />
be viewed as being representative of the wider populace.<br />
Preparatory work leading to a charrette is typically also timeand<br />
resource-intensive.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 81 82 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
11. Citizen juries<br />
Citizen jury is a randomly selected and demographically<br />
representative panel comprising members of the public used<br />
for examining and deliberating on a policy issue.<br />
The target audience of this technique is a group of ordinary<br />
citizens who are selected based on the requirements of the<br />
issue at hand.<br />
Before using citizen juries, agencies should<br />
determine:<br />
• Selection – members of the jury should be carefully<br />
selected to reflect the wider public in terms of<br />
demographics and opinions.<br />
• Agenda – care and thought must be placed in<br />
considering what is to be presented. Participating jurors<br />
must be informed enough to understand the issue and<br />
the information should have several points of view, so that<br />
jurors may construct effective questions to ask during the<br />
session.<br />
• Logistics – due to the time and effort commitment<br />
required of the participants, agencies also should consider<br />
hosting the meeting at a convenient location or provide<br />
transport arrangements for the participants to incentivise<br />
the public to participate in the deliberation process.<br />
When is it most useful?<br />
Citizen juries are useful for involving the public to develop a<br />
deep understanding of an issue. The extensive deliberation<br />
process by the public can provide the agencies with<br />
additional viewpoints on the issues/concerns of a particular<br />
policy. Since the jurors are ‘non-experts’, the general public are<br />
more likely to identify and agree with their conclusions and<br />
recommendations.<br />
Considerations<br />
The entire process requires a high level of patience and<br />
requires commitment from participants. Participants need<br />
to be screened to ensure they possess the capacity to ask<br />
constructive questions so as to maintain time efficiency of the<br />
entire process.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• In order to maintain<br />
‘neutrality’ of the jurors,<br />
they should not mix<br />
informally (e.g., over lunch)<br />
with agency officers or<br />
the experts before the<br />
completion of the process.<br />
12. Delphi process<br />
The Delphi process involves several iterations of participant responses to a questionnaire with<br />
results tabulated and disseminated until following iterations no longer result in significant<br />
changes. It is similar to an expert panel, except that agreement can be reached without the need<br />
for a face-to-face group process.<br />
How it works<br />
A group of experts are first selected and presented with a number of questions regarding the<br />
subject topic. Participants contribute anonymously, which allows a free flow of ideas. The Delphi<br />
process provides an opportunity for discussion without the need for meeting. It continues until<br />
there is no longer a need for modification of opinions, and when the final iteration resembles<br />
the most ‘optimal solution’.<br />
Usually all participants maintain anonymity even after the final report is completed. This ensures<br />
that participants are not influenced by anyone based on authority, personality or biases. It<br />
allows them to express their opinions and critiques without constraint, and modify errors or<br />
revise earlier opinions without fear of judgment. The process is stopped after a pre-defined stop<br />
criterion is reached (e.g. consensus achieved, stability of results and number of rounds).<br />
The target audience of this process is a select group of people with expertise on the policy issue.<br />
Before using the Delphi process, agencies should determine:<br />
• Participants – ensuring the select panel have sufficient knowledge about the subject matter<br />
is critical to gaining useful and relevant information.<br />
• Facilitating the information collation – responses need to be collected and analysed after<br />
each round to identify common or conflicting viewpoints.<br />
When is it most useful?<br />
The Delphi process is useful for forecasting potential impact of policy implementation. Experts<br />
may be asked to give their estimated probabilities regarding the long-term trend of a certain<br />
area like healthcare or economic trends and education. It provides relatively quicker forecasts if<br />
experts are readily available.<br />
Considerations<br />
The Delphi process requires significant investment of time and effort from experts who may<br />
have busy schedules. Agencies need to convince the experts on the value of the consultation<br />
process and keep the experts engaged and active in each round in order to obtain optimal<br />
effectiveness.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 83 84 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
13. Expert panels<br />
14. Interviews<br />
An expert panel is a specially constructed group of individuals<br />
who are considered technical specialists in their field. The<br />
panel can be used as a credible evaluative and deliberative<br />
tool, representing various points of view regarding policies or<br />
projects in a balanced and impartial way.<br />
Generally, six to 12 experts are selected to form members<br />
of the panel. The panel can then meet at intervals either in<br />
a public meeting with members of the media asking them<br />
questions, or be conducted with a neutral moderator posing<br />
questions to the panel members.<br />
The target audience of this method are experts that are<br />
recognised as independent specialists in their respective<br />
spheres.<br />
Before using expert panels, agencies should<br />
determine:<br />
• Participants – the experts chosen should have extensive<br />
experience in the field and preferably be independent<br />
with regards to the proposed policy.<br />
• Moderator – it is important to appoint an experienced<br />
moderator who is able to keep the discussion on track,<br />
raise discussion points or questions to solicit relevant<br />
insights, and ensure that the consultation objectives are<br />
met.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Establishing guidelines or<br />
ground rules for expert<br />
panel discussions may<br />
encourage panel members<br />
to be focussed on the topic<br />
at hand.<br />
• In addition to expertise in<br />
their field, try increasing<br />
the diversity of the<br />
members. This may build<br />
credibility and help<br />
address public concerns<br />
about equity.<br />
Interviews are one-to-one discussions with experts,<br />
stakeholders, or prominent public figures where agencies can<br />
gain insight on a particular issue/policy.<br />
An interview usually lasts around an hour and is framed<br />
around a particular subject. During an interview, it is possible<br />
to gain in-depth and detailed information without peer<br />
pressure. Personal, face-to-face contact allows for a more<br />
detailed understanding of the reasons and rationale behind<br />
people’s attitudes and opinions.<br />
The target audience for this tool is selected individuals with<br />
knowledge and/or experience in the relevant area.<br />
Before conducting interviews, agencies should<br />
determine:<br />
• Topic – ensure appropriate questions are crafted prior<br />
to the interview, and be clear about the reason for<br />
conducting the interview.<br />
• Questions – use open-ended questions as opposed<br />
to questions resulting in ‘yes/no’ answers. Ensure that<br />
questions are relevant to the subject area so as to fully<br />
utilise the available time.<br />
When is it most useful?<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Be sensitive to the needs<br />
of the person you are<br />
interviewing.<br />
• Ensure an appropriate<br />
venue is selected with<br />
refreshments provided<br />
depending on the<br />
anticipated length of the<br />
interview.<br />
• Provide the interviewer<br />
with the questions or areas<br />
of discussion prior to the<br />
interview to prepare the<br />
interviewer for the session.<br />
When is it most useful?<br />
This method presents an opportunity for a balanced<br />
discussion of issues. Expert panels are suitable for presenting<br />
different considerations and viewpoints, particularly for<br />
subject areas which are controversial or uncertain. Expert<br />
panels are also useful in estimating future impacts of an<br />
implemented policy.<br />
Considerations<br />
Agencies need to be cognisant that although experts<br />
are more knowledgeable than the general public, their<br />
statements and opinions still need to be properly clarified<br />
and verified to ensure accuracy. When used properly, the<br />
synthesised ideas developed during these sessions form<br />
credible sources of information.<br />
Interviews are most useful when obtaining feedback from<br />
stakeholders, experts and excluded or minority groups.<br />
Interviews offer participants a degree of privacy in a nonthreatening<br />
environment to express views, and identify new<br />
issues that might not otherwise have been thought of.<br />
Considerations<br />
Scheduling multiple interviews, collating data and analysing<br />
data can be time consuming and labour intensive. Agencies<br />
should therefore be selective in conducting one-to-one<br />
interview with individuals who can contribute the most to the<br />
policy development.
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 85 86 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />
15. Working groups<br />
A working group consists of a number of selected<br />
stakeholders who meet periodically to provide their views.<br />
It provides an opportunity for in-depth analysis of policy or<br />
initiative being consulted.<br />
The target audience of this method is stakeholder-centric, and<br />
focuses on stakeholders with a direct/indirect interest in the<br />
proposed government project or policy. This may comprise<br />
experts, industry players, interest groups or selected members<br />
of public.<br />
Before organising regular working groups, agencies<br />
should determine:<br />
• Size – the typical size of a working group is eight to 15<br />
members.<br />
• Roles – ensure roles and responsibilities of participants<br />
are defined upfront so that they are aware of their duties.<br />
The required time commitment should also be clear.<br />
• Participants – consider the group dynamics of the<br />
individuals selected for the working group. Participants<br />
can be identified through:<br />
- Agencies’ past experience;<br />
- Recommendations from external organisations<br />
(e.g. other government agencies, trade/business<br />
associations, unions); or<br />
- Prominent individuals who are known to be experts or<br />
leading players in their field.<br />
When is it most useful?<br />
Working groups are useful during the early stage of policy<br />
formulation, where there is scope for developing, influencing<br />
and assessing the strategic options available<br />
Considerations<br />
Agencies need to be aware that working groups involve<br />
selected individuals and may not necessarily represent<br />
the views of the larger stakeholder population. In addition,<br />
the effectiveness of a working group is dependent on the<br />
commitment of its members.<br />
TIPS FOR<br />
EFFECTIVENESS<br />
• Get workgroups to<br />
champion the cause by<br />
allowing them to gain<br />
a sense of ownership<br />
of the policy that they<br />
assisted the government in<br />
creating.<br />
Appendix B:<br />
Planning aid for public consultation<br />
The following can be customised by agencies to suit their own needs.<br />
Agency<br />
Policy initiative for<br />
consultation<br />
Responsible party(s)<br />
Start of consultation<br />
process<br />
DD / MM / YYYY<br />
A. Objective(s) of consultation exercise<br />
1<br />
2<br />
B. Strategy for consultation<br />
Stakeholders who<br />
will benefit<br />
Stakeholders who<br />
are adversely<br />
affected<br />
Stakeholders<br />
who may have<br />
skills/resources to<br />
contribute<br />
Other stakeholders<br />
who may be<br />
interested<br />
Identify<br />
stakeholders to be<br />
consulted<br />
1. E.g. the elderly<br />
2.<br />
1.<br />
2.<br />
1.<br />
2.<br />
1.<br />
2.<br />
What tools/<br />
channels are most<br />
suitable to engage<br />
the identified<br />
stakeholder group<br />
E.g. community<br />
meetings, public<br />
forums<br />
Targeted completion<br />
date<br />
What are some<br />
potential issues/<br />
risks<br />
E.g. participation<br />
rate may be low<br />
DD / MM / YYYY<br />
What are<br />
mitigating<br />
strategies<br />
E.g. partner<br />
with NGOs (e.g.<br />
Third Age, Tsao<br />
foundation)
<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 87<br />
C. Develop action plan and timeline<br />
Categories<br />
Key activities<br />
Estimated<br />
time<br />
required<br />
Person(s)<br />
responsible<br />
Planned<br />
start date<br />
Planned<br />
completion<br />
date<br />
Status<br />
<strong>Consultation</strong><br />
strategy<br />
Develop consultation<br />
strategy<br />
Obtain approval for<br />
consultation strategy<br />
Draft consultation<br />
materials<br />
<strong>Consultation</strong><br />
materials<br />
Obtain approval for<br />
consultation materials<br />
Develop and print<br />
consultation materials<br />
Generate<br />
awareness for<br />
consultation<br />
exercise<br />
Development of<br />
communications plan<br />
Obtain approval for<br />
communications plan<br />
Implement<br />
communications activities<br />
to generate awareness<br />
Plan consultation launch<br />
date(s)<br />
Make<br />
logistical<br />
arrangements<br />
Make facility<br />
arrangements (e.g. venue,<br />
refreshments)<br />
Identify and invite<br />
speakers/facilitators/<br />
partners/vendors<br />
Send invitations/<br />
notifications to<br />
participants<br />
Track participation rate<br />
During<br />
consultation<br />
period<br />
Track type of feedback<br />
provided<br />
Assess need to extend<br />
consultation or provide<br />
more information<br />
Collate feedback and<br />
develop report on<br />
consultation<br />
Close the loop<br />
Obtain approval for<br />
consultation report<br />
Publish report to<br />
participants