27.03.2015 Views

Public Consultation Toolkit - Civil Service College

Public Consultation Toolkit - Civil Service College

Public Consultation Toolkit - Civil Service College

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

FOR INTERNAL CIRCULATION ONLY<br />

FOR INTERNAL CIRCULATION ONLY


Copyright © Ministry of the Information, Communications and the Arts (MICA),<br />

Singapore, 2010<br />

Email: MICA_<strong>Public</strong>_Communications_Division@mica.gov.sg<br />

Supported by:<br />

<strong>Public</strong> <strong>Service</strong> Division<br />

Email: PSD_PS21@psd.gov.sg<br />

For more information, contact:<br />

<strong>Civil</strong> <strong>Service</strong> <strong>College</strong><br />

Email: cscollege_ipam@cscollege.gov.sg<br />

Printed in September 2010.<br />

Copyright © 2010. All rights reserved. No part of the publication may be reproduced, published or transmitted in any<br />

form or by any means electronic, mechanical, photocopying, recorded or otherwise without the prior permission of the<br />

copyright owner. You may use the contents and save an electronic copy, or print out a copy, of parts of this publication<br />

solely for your own information, research or study, provided you include the copyright notice on such copy. All information<br />

is correct at the time of publishing and printing, and is subject to change without prior notice.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Context<br />

One of the early roots of public consultation grew in 1985, with the formation of the Feedback<br />

Unit.<br />

The importance of public consultation has risen over the years, with the increasing political<br />

maturity of the Singapore populace and greater interest in participation in policy development.<br />

According to a <strong>Public</strong> Perception Survey conducted in 2009 by Ernst & Young Advisory (EYA), 68<br />

percent of the respondents wanted more opportunities for providing feedback to the Government.<br />

Among the government agencies, there is also an increased recognition that public consultation<br />

improves policy solutions and facilitates implementation.<br />

In order to facilitate effective public consultation, it was timely for a review of the public<br />

consultation process in Singapore, to tap on the experience and leading practices of various<br />

agencies, and share them across the public sector. It is in this context that the Ministry of<br />

Information, Communication and the Arts (MICA) and <strong>Public</strong> <strong>Service</strong> Division (PSD), in conjunction<br />

with <strong>Civil</strong> <strong>Service</strong> <strong>College</strong> (CSC) developed a toolkit for public consultation for government<br />

agencies in Singapore. CSC also commissioned EYA to conduct a public opinion survey and<br />

research on public consultation practices overseas.<br />

The <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> provides a basic set of guidance notes for public agencies in the<br />

conduct of public consultation. The <strong>Toolkit</strong> aims to serve as a user-friendly guide for specialists<br />

and generalists alike on the principles, processes and tools available for public consultation. The<br />

<strong>Toolkit</strong> is not meant to be prescriptive, and hence, agencies can customise the <strong>Toolkit</strong> so that it is<br />

contextualised to meet their needs.<br />

The <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> was developed with input from <strong>Public</strong> Sector Leaders and officers<br />

from ministries and statutory boards who shared their challenges, experiences and learning points<br />

from conducting public consultation exercises. The <strong>Toolkit</strong> also incorporates international leading<br />

practices and case studies on public consultation. This is to ensure that the <strong>Toolkit</strong> is relevant to<br />

the strategic intent, operational requirements of agencies and meets stakeholder expectations.<br />

This <strong>Toolkit</strong> is meant for circulation among ministry and statutory board officers only. It should<br />

not be extended to the public or media.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> ii iii <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Contents<br />

1. Introduction 1<br />

1.1. <strong>Public</strong> consultation in the <strong>Public</strong> <strong>Service</strong> 1<br />

1.2. How to use this <strong>Toolkit</strong> 4<br />

2. Reasons for public consultation 5<br />

3. Key guiding principles for public consultation 6<br />

4. Pre-consultation considerations 7<br />

4.1. Factors to consider 7<br />

4.2. Stages of policy development 9<br />

4.3. <strong>Public</strong> consultation process 10<br />

5. Developing the strategy for consultation 11<br />

5.1. Step 1: Identify stakeholders 11<br />

5.2. Step 2: Select tools and channels 18<br />

5.3. Step 3: Anticipate obstacles and challenges 21<br />

6. <strong>Consultation</strong> preparation and implementation 35<br />

6.1. Step 4: Develop action plan and timeline 35<br />

6.2. Step 5: Design consultation materials 38<br />

6.3. Step 6: Generate awareness and plan public communication exercises 39<br />

6.4. Step 7: Launch consultation exercise 44<br />

7. Follow-up and analysis 46<br />

7.1. Step 8: Collate feedback and close the loop 46<br />

7.2. Step 9: Assess effectiveness of the public consultation exercise 52<br />

8. Conclusion 54<br />

Acknowledgements 55<br />

Index of case examples 56<br />

References 57<br />

Appendices 60


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

1. Introduction<br />

1.1. <strong>Public</strong> consultation in the <strong>Public</strong> <strong>Service</strong><br />

<strong>Public</strong> consultation is a process by which government interacts with the public or stakeholders<br />

to seek input and discuss issues regarding a specific deliverable, which is often either a policy or<br />

initiative.<br />

<strong>Public</strong> consultation as defined here is distinct from public engagement, which refers to the<br />

government’s ongoing involvement with stakeholders or partners, and is not necessarily<br />

focused on a particular policy, initiative or issue.<br />

The key difference between public consultation and public engagement is the driving impetus<br />

behind the activity. While the objective of public consultation is to gather feedback on a specific<br />

issue, the ultimate goal of public engagement is to develop a longer term relationship with<br />

stakeholders.<br />

Case 1:<br />

Regulatory regime for the private education sector – an illustration of public<br />

consultation<br />

Agency/country:<br />

• Ministry of Education (MOE), Singapore<br />

Background:<br />

• The rapid growth of the private education (PE) sector had led to uneven standards across<br />

private educational institutions (PEIs). To address this, MOE proposed to establish a new<br />

regulatory regime to improve standards in the PE sector, to be overseen by a statutory body,<br />

the Council for Private Education.<br />

• The new regulatory regime consists of three key features: (i) an Enhanced Registration<br />

Framework that sets out mandatory standards in the key areas of corporate governance,<br />

academic rigour, and information transparency which PEIs need to adhere to in order to<br />

be allowed to operate their businesses; (ii) a voluntary certification scheme (EduTrust) with<br />

higher and more comprehensive standards to allow quality PEIs to differentiate themselves<br />

from the rest; and (iii) regulatory levers to allow for a range of graduated solutions to match<br />

the severity of breaches.<br />

• A public consultation exercise was conducted from March to May 2009 to seek feedback on<br />

the key principles and features of the new regulatory framework .<br />

<strong>Consultation</strong> Process:<br />

• MOE posted the <strong>Consultation</strong> Paper on its website, with a hyperlink on REACH’s (Reaching<br />

Everyone for Active Citizenry@Home) Portal to widen the reach to the public and<br />

stakeholders.<br />

• An industry briefing was held for PEIs to facilitate their understanding of the key features of<br />

the new regulatory regime. Over 500 PEI representatives attended the briefings.<br />

• Four focus group discussions were conducted with selected PEIs and students whose views<br />

would be representative of their communities. This helped MOE to further unpack the<br />

concerns that have been raised.<br />

Outcomes:<br />

• After the close of the public consultation exercise, MOE evaluated the feedback received and<br />

incorporated several suggestions into the regulatory framework. A summary of responses<br />

to the feedback was also published on the MOE website.<br />

• The Private Education (PE) Bill was also refined based on the feedback received. <strong>Consultation</strong><br />

on the PE Bill was conducted in July 2009 to seek final views.<br />

• The PE Bill was introduced in Parliament in August 2009 and the Second and Third Readings<br />

took place in September 2009. The Private Education Act was finally gazetted in October<br />

2009.<br />

• The Council for Private Education was formally instituted on 1 Dec 2009 as a Statutory Board<br />

under MOE, and it commenced operations of the new regulatory regime on 21 Dec 2009.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Case 2:<br />

‘Friends of LTA’ – An illustration of public engagement<br />

Agency/country:<br />

• Land Transport Authority (LTA), Singapore<br />

Background:<br />

• The third strategic thrust of LTA’s Land Transport Master Plan is to “meet the diverse needs of<br />

the people”.<br />

• In support of this strategic thrust, LTA began its Friends of LTA (FOLTA) scheme in May 2008.<br />

FOLTA invites members of the public – students, retirees, business leaders, housewives and<br />

those with diverse needs – to become informal ambassadors of land transport.<br />

Engagement Process:<br />

• LTA regularly engages FOLTA at corporate events, visits to construction sites and other<br />

activities to obtain a behind-the-scenes perspective of land transport 1 .<br />

Outcomes:<br />

• FOLTA members provide valuable feedback to LTA on the needs of the public and provide<br />

ideas on improving land transport. In 2010, FOLTA’s participation in several focus group<br />

discussions offered specific valuable input that helped to:<br />

From the cases on page 2 and 3, it can generally be seen that:<br />

<strong>Public</strong> <strong>Consultation</strong> is specific to a policy or initiative, and seeks to understand stakeholder<br />

sentiment, or to test, validate or prioritise policy options. It is also important to note that there<br />

is a key difference between public communication and public consultation. In the former, the<br />

policy decision has been made and the government is communicating the decision to the<br />

public. In the latter, the policy decision has not been made and the government is seeking input<br />

from stakeholders.<br />

<strong>Public</strong> Engagement involves active involvement of stakeholders over a longer period of time,<br />

ideally through a more substantive and deliberative dialogue/conversation that promotes<br />

mutual and shared understanding, and through ongoing partnership and collaboration.<br />

1.2. How to use this <strong>Toolkit</strong><br />

This <strong>Toolkit</strong> provides public officers with:<br />

1. A starting point to embark on effective public consultation,<br />

2. Practical guidelines and steps for the planning and implementation of public consultation,<br />

3. Compilation of channels which public officers can use to conduct public consultation; and<br />

4. Case examples from international and Singapore agencies.<br />

There is no “one size fits all” solution. This toolkit merely provides a point of reference<br />

upon which further customisation can be done.<br />

- Shape the content and tone of public messaging on Distance Fares to ensure clarity<br />

- Clarify current public perceptions of LTA<br />

Source:<br />

1 Land Transport Authority, 2009. Friends of LTA case study, .


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

2. Reasons for public consultation<br />

The reasons for public consultation in Singapore are:<br />

1. To feel the pulse<br />

• Anticipate concerns from stakeholders/public early<br />

• Understand stakeholder/public sentiment and the ground situation<br />

• Provide a channel for stakeholders to be heard and enable greater participation in the<br />

policy development process<br />

2. To test and refine ideas for better policy solutions<br />

• Gather diverse views and insights from stakeholders/public<br />

• Ascertain feasibility of intended policy change or new initiative<br />

• Seek options and check against policy alternatives<br />

3. To facilitate implementation of policies and initiatives<br />

• Generate awareness and enable stakeholders to understand the<br />

policies/initiatives better<br />

• Obtain buy-in from stakeholders by seeking their contribution to the policies/initiatives<br />

to be implemented<br />

• Mitigate or find resolutions to opposing interests to prevent conflicting views at<br />

implementation stage<br />

• Couch appropriate public communication messages, particularly for controversial or<br />

contentious issues.<br />

3. Key guiding principles for<br />

public consultation<br />

1. Policy-making should be inclusive and take into account views of stakeholders. <strong>Public</strong><br />

officers should see inherent value in stakeholder feedback.<br />

2. <strong>Public</strong> consultation should be a first thought, rather than an afterthought, in the policy<br />

development process.<br />

3. The outcome of consultation should not be pre-determined.<br />

4. <strong>Consultation</strong> should involve a fair representation of all stakeholders who are affected,<br />

interested and/or can contribute to the policy development process.<br />

5. Modes of consultation should be carefully considered and selected to reach the relevant<br />

stakeholders and gather the appropriate types of information.<br />

6. The consultation process should be conducted in a transparent, consistent, structured and<br />

timely manner. Sufficient time should be given to those being consulted to understand and<br />

respond to an issue.<br />

7. <strong>Consultation</strong> materials should provide sufficient background information that is clear and<br />

easily understandable to participants.<br />

8. The scope and parameters of the consultation should be clear to the participants to set the<br />

right expectations. Participants should be provided with a clear understanding of how their<br />

input will be sought and managed.<br />

9. Agencies should be responsive and follow through with stakeholders on how their feedback<br />

was considered and the extent of its impact on the policy in a constructive manner.<br />

10. Agencies should ensure that the consultation process is mutually respectful, nondiscriminatory<br />

and equitable, regardless of gender, race, age, educational levels or religious<br />

beliefs.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

4. Pre-consultation considerations<br />

The following table (Table 4-1) could serve as a general guide for agencies to determine the<br />

need to conduct a public consultation exercise.<br />

4.1. Factors to consider<br />

As a rule of thumb, consultation should be conducted for policies and initiatives that have a<br />

significant impact on stakeholders.<br />

Five factors to consider whether to proceed with a consultation exercise are:<br />

1. Confidentiality. Policies/initiatives that are classified and confidential (e.g., national<br />

security) may not be suitable for public consultation.<br />

2. Urgency of issue. For emergency situations (e.g., a security incident) where an immediate<br />

response by agencies is necessary, public consultation is generally not realistic or possible.<br />

3. Impact on stakeholders. For issues with significant impact (e.g., which result in changes<br />

to how individuals or organisations operate, or which touch on religious or moral values),<br />

agencies should choose to consult the stakeholders more thoroughly to understand the full<br />

implications of each decision.<br />

4. Level of public interest. The level of public interest determines the extent to which the<br />

wider populace is consulted.<br />

Policy areas that tend to attract more public interest include healthcare, education, housing<br />

and transport 2 . Policy areas of public interest also tend to be covered more widely by the<br />

media.<br />

Conversely, for policies which attract less public interest (e.g., technical or regulatory issues<br />

such as the regulation of financial institutions), agencies can choose to conduct targeted<br />

consultation with affected stakeholders such as industry players or technical experts.<br />

5. Scope of influence. This refers to the degree to which the outcomes of the policy could<br />

be influenced by stakeholder feedback. It is recommended that consultation be conducted<br />

primarily when stakeholder feedback can influence the outcome of the policy or initiative.<br />

If consultation is conducted for policies or initiatives with minimal scope for influence, it is<br />

important to manage stakeholder expectations carefully.<br />

Key considerations<br />

Confidentiality of issue<br />

Does the policy/initiative<br />

contain classified/<br />

confidential information?<br />

Urgency of Issue<br />

Is there an urgent, short<br />

timeframe for the policy/<br />

initiative to be developed?<br />

If the implementation<br />

is delayed, will there be<br />

adverse implications?<br />

Impact on stakeholders<br />

How significant is the<br />

degree of impact of<br />

the policy/initiative on<br />

stakeholders?<br />

To what extent are major<br />

stakeholders concerned<br />

about this issue?<br />

Level of public interest<br />

What is the level of public<br />

interest or attention on the<br />

policy/initiative?<br />

What is the possibility that<br />

the media will be interested<br />

in the issue?<br />

Scope of influence<br />

What is the scope for<br />

changes to be made to the<br />

policy/initiative based on<br />

stakeholder feedback?<br />

Recommendation<br />

Yes<br />

Yes<br />

Yes<br />

Low<br />

Low<br />

Low<br />

Low<br />

Please circle the appropriate response<br />

Moderate<br />

Moderate<br />

Moderate<br />

Moderate<br />

No<br />

No<br />

No<br />

High<br />

High<br />

High<br />

High<br />

Low Moderate High<br />

If most responses<br />

fall in this column,<br />

consultation may not<br />

be required.<br />

If most responses<br />

fall in this column,<br />

targeted consultation<br />

is recommended for<br />

affected stakeholder<br />

groups.<br />

If most responses fall<br />

in this column, largescale<br />

consultation of<br />

the wider populace is<br />

recommended.<br />

2 Based on Singapore <strong>Public</strong> Perception Survey conducted by Ernst and Young Advisory, 2009.<br />

Table 4-1: Pre considerations for consultation


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 10 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

4.2. Stages of policy development<br />

<strong>Consultation</strong> can provide input to the policy/initiative development at different stages<br />

of its inception. The purposes of consultation at the various stages of the policy/initiative<br />

development can vary (Figure 4-2).<br />

Development stages of policy/initiative<br />

Identify<br />

Identify and define Issue/<br />

problem to be resolved<br />

Analysis<br />

Define key opportunities and challenges<br />

associated with issue<br />

Formulate<br />

Formulate possible policy solutions<br />

to address issue<br />

Assess<br />

Assess and evalute options<br />

Decide<br />

Decide on course of action<br />

Purposes of public consultation<br />

Feel the pulse<br />

Test/refine<br />

Check against options/<br />

alternatives<br />

4.3. <strong>Public</strong> consultation process<br />

The public consultation process is an iterative one. For the purpose of this <strong>Toolkit</strong>, the<br />

consultation process has been outlined in nine critical steps (Figure 4-3). It is acknowledged that<br />

in practice, the process is usually not linear. Therefore, Figures 4-2 and 4-3 do not necessarily<br />

assume a stage-by-stage process although the diagrams are illustrated in that manner.<br />

8<br />

9<br />

Assess effectiveness<br />

of public consultation<br />

exercise<br />

Collate feedback<br />

and close the loop<br />

7<br />

Launch<br />

consultation exercise<br />

6<br />

Follow-up and analysis<br />

1<br />

Generate awareness<br />

and plan public<br />

communication exercise<br />

Identify<br />

stakeholders<br />

Conceptual planning<br />

2<br />

<strong>Consultation</strong> preparation and<br />

implementation<br />

Design<br />

consultation materials<br />

Select tools and<br />

channels<br />

Anticipate obstacles<br />

and challenges<br />

Develop action<br />

plan and timeline<br />

5<br />

3<br />

4<br />

Implement<br />

Establish policy/programme guidelines and<br />

processes to deliver public policies<br />

Evaluate<br />

Monitor outcomes to determine whether<br />

objectives are being met<br />

Communication/buy-in<br />

Refine/evaluate<br />

Figure 4-3: <strong>Public</strong> consultation process<br />

Figure 4-2: Purposes of public consultation at different stages of<br />

policy/initiative development


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 11 12 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Stakeholders as partners<br />

5. Developing the<br />

strategy for consultation<br />

The first stage of the consultation process involves the conceptual development which aims to:<br />

1. Identify the stakeholders to be consulted,<br />

2. Select the tools and channels to be used, and<br />

3. Develop strategies to mitigate potential risks in the consultation process.<br />

5.1. Step 1: Identify stakeholders<br />

Selection of appropriate stakeholders to participate in public consultation ensures that the<br />

views of relevant parties are well represented and their views heard.<br />

Officers should make sure that participants are representative of the affected groups, while<br />

ensuring that stakeholders holding different views or from diverse background are involved in<br />

the consultation exercise.<br />

Stakeholders can be categorised into the following groups:<br />

Besides engaging the stakeholders directly, ministries and statutory boards can leverage on<br />

partnership with parties outside their own agencies to reach and engage the stakeholders.<br />

The following table (Table 5-1) illustrates how different partners can assist agencies in their<br />

consultation initiatives. Agencies may consider tapping on these resources:<br />

Partners<br />

REACH (Reaching Everyone for Active<br />

Citizenry@ Home)<br />

The government unit for engaging and<br />

connecting with citizens<br />

http://www.reach.gov.sg<br />

People’s Association<br />

http://www.pa.gov.sg/<br />

Voluntary welfare organisations (VWOs)<br />

Industry and trade associations<br />

Advantages<br />

• Provides a one-stop publicly available<br />

platform for the public to state their<br />

opinions and understand different<br />

perspectives on an issue<br />

• Assists agencies to identify relevant<br />

stakeholders in the community and<br />

organise consultation activities<br />

• Leverages on network of grassroots leaders<br />

to gather community views<br />

• Provide insights on issues affecting the<br />

stakeholder groups under their charter<br />

• Assist in obtaining feedback from<br />

stakeholders they serve<br />

Table 5-1: Partners in consultation exercises<br />

• Provide industry knowledge<br />

• Represent companies and businesses within<br />

an industry<br />

• Assist in identifying and engaging relevant<br />

stakeholders in the industry<br />

1. Individuals/organisations that might benefit from the policy/initiative,<br />

2. Individuals/organisations that might be adversely affected by the policy/initiative,<br />

3. Individuals/organisations that might have the skills and resources to contribute to the<br />

policy/initiative development process; and<br />

4. Individuals/organisations that might be interested in the policy/initiative and its<br />

development process.<br />

Note: The mode and the degree to which the stakeholder groups are consulted may vary,<br />

depending on the level of knowledge, expertise and degree of impact which the policy or<br />

initiative may have on the different groups.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 13 14 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Considerations for facilitating effective partnerships<br />

Agencies can do the following to facilitate effective partnerships:<br />

1. Lead time. When tapping on partners, it is important to provide them with sufficient lead<br />

time to allow the partner agencies to mobilise the necessary resources. Agencies should<br />

provide a minimum of one month’s notice to the partners, and a period of at least three<br />

months for the partners to gather feedback on agencies’ behalf.<br />

2. Information. Agencies should provide partners with comprehensive information so that<br />

they have a good understanding of the policy and its considerations before the consultation<br />

process. This allows the partners to be more effective in addressing the questions raised by<br />

their constituents/members during the actual consultation exercise.<br />

3. Materials. Agencies should generally equip partners with communication materials for the<br />

consultation exercise. This may include briefing slides (with speakers’ notes), pamphlets and<br />

FAQs.<br />

4. Funding and technical support. Agencies can also provide technical assistance (e.g., design<br />

of survey questions) and funding support (e.g., for organising dialogue sessions).<br />

Note: The above are some suggestions but are not exhaustive.<br />

Case 3:<br />

The Living Murray River Restoration<br />

Agency/country:<br />

• Murray-Darling Basin Commission, Australia<br />

Background:<br />

• The Murray-Darling Basin (MDB) comprises a large geographical area that spreads across five<br />

states and territories: Queensland, the Australian Capital Territory, New South Wales, Victoria<br />

and South Australia.<br />

• The landscape of the MDB was under severe ecological stress, with issues such as salinity,<br />

poor water quality, stressed forests, dried wetlands, threatened native species, feral animals<br />

and noxious weeds.<br />

• The Australian government engaged different stakeholders in the restoration of the<br />

cleanliness and health of the MDB.<br />

<strong>Consultation</strong> Process:<br />

Stakeholders engaged during the consultation exercise included:<br />

• Individuals/organisations who could benefit from the restoration<br />

- Local communities (e.g., landholders, land managers)<br />

- Rural communities (e.g., indigenous people)<br />

• Individuals/organisations who could be adversely affected<br />

- Industry stakeholders, including businesses that depended on the river’s resources as a<br />

form of income (e.g., agricultural farmers)<br />

• Individuals/organisations who had the skills and resources to contribute to river restoration<br />

- Ecological and environmental experts<br />

• Individuals/organisations who were interested in the restoration<br />

- Activists (e.g., land care groups)<br />

- Interest groups and individuals who had an interest in the river’s health


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 15 16 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Learning points:<br />

• Comprehensive consultation with different stakeholders allowed the government to<br />

understand the different interests and concerns in the issues.<br />

• This helped the government roll out policies which balanced the interests and needs of<br />

different stakeholders.<br />

Case 4:<br />

Tripartite efforts to overcome the downturn<br />

Agency/country:<br />

• Ministry of Manpower (MOM), Singapore<br />

Source:<br />

• Australian Human Rights Commission, 2010, Case study 2 - The Murray-Darling Basin – An ecological<br />

and human tragedy, Australia, .<br />

• Crase, L., Dollery, B. & Wallis, J., 2005, Community consultation in public policy: The case of the<br />

Murray-Darling Basin of Australia, Australian Journal of Political Science, 40, 221 – 237, .<br />

• Macdonald, D. H., & Young, M., 2001, A case study of the Murray-Darling Basin, CSIRO Land and Water,<br />

.<br />

Background:<br />

• A tripartite taskforce comprising representatives from the Government, the National Trades<br />

Union Congress (NTUC) and the Singapore National Employers’ Federation (SNEF), was<br />

formed to gather feedback and updates on manpower-related issues during the economic<br />

downturn. The impact of the economic downturn was especially felt around October 2008,<br />

prompting the tripartite partners to come together in November 2008 to formulate the<br />

Tripartite Guidelines on Managing Excess Manpower to help companies manage their excess<br />

manpower and to use retrenchments as a last resort.<br />

• According to the Guidelines, companies could implement a shorter working week or<br />

temporary lay-offs, cut wages or take other non-wage cost-cutting measures.<br />

<strong>Consultation</strong> Process:<br />

• Within a month, the Tripartite Taskforce on Managing the Economic Downturn was set up<br />

with regular working groups.<br />

• The partners leveraged on the Singapore Tripartism Forum (STF) to broadcast the measures<br />

to a wider audience. More than 40 briefings/dialogues on the Guidelines were organised,<br />

involving some 9,500 participants. The briefings mainly targeted senior managers and HR<br />

professionals from the various sectors, as well as the various Chambers of Commerce and<br />

unions.<br />

• An STF Dialogue with the Prime Minister was also organised in February 2009 to highlight<br />

the importance of saving jobs and creating growth in a global downturn.<br />

• The tripartite partners also set up Tripartite Upturn Strategy Teams (TRUST Teams) to reach<br />

out to individual companies to help businesses manage costs, retain workers and upgrade<br />

their skills.<br />

• From April 2009, the TRUST Teams reached over 640 companies, held 12 large-scale events<br />

reaching out to some 3,100 participants, visited 20 companies employing about 12,000<br />

employees, conducted one-on-one clinic sessions for 13 companies and provided assistance<br />

to over 80 companies through tele-conversations.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 17 18 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Outcomes:<br />

• The number of workers on a shorter working week and temporary lay-offs increased from<br />

550 before the downturn to 26,500 in the first quarter of 2009.<br />

• By January 2009, the Skills Programme for Upgrading and Resilience (SPUR) and the<br />

Government’s Resilience Package, which included the Jobs Credit Scheme, were announced.<br />

SPUR was introduced to subsidise training and absentee payroll, allowing companies to<br />

make better use of their excess capacity. The number of courses under SPUR increased from<br />

150 to more than 1,000. In addition, the Professional Skills Programme was introduced to<br />

help the workers to gain new skills or upgrade their skills. About 244,000 workers signed up.<br />

• As a result of the interventions, Singapore was able to avoid the high retrenchment numbers<br />

it had experienced during the 1998 financial crisis.<br />

• Trust among the tripartite partners had been strengthened. The long tradition of tripartism<br />

in Singapore enabled prompt joint action to address the crisis swiftly and effectively.<br />

• The effectiveness of our downturn efforts won MOM recognition by the International Labour<br />

Organisation (ILO), and was also shared with the G20 countries at the G20 Labour and<br />

Employment Ministers Meeting 3 .<br />

Learning points:<br />

• The collaboration with partners made it possible to gather feedback quickly from various<br />

stakeholder groups.<br />

• The collaboration helped avoid the high retrenchment numbers experienced during the<br />

1998 financial crisis.<br />

• Trust among the tripartite partners was strengthened<br />

Source:<br />

3 Citation made in “Employment and social protection policies from crisis to recovery and beyond: A review<br />

of experience”, an ILO report to the G20 Labour and Employment Ministers Meeting held in Washington<br />

D.C. from 20 to 21 April 2010. The Report is available at the ILO website - http://www.ilo.org/public/<br />

libdoc/jobcrisis/download/g20_report_employment_and_social_protection_policies.pdf.<br />

5.2. Step 2: Select tools and channels<br />

Appropriate selection and usage of public consultation tools and channels are important for<br />

gathering appropriate types of feedback from the relevant stakeholders.<br />

Different types of tools and channels can be used based on the following factors:<br />

1. Purpose of exercise,<br />

2. Target audience; and<br />

3. Available resources (e.g., time, funding, competency and technical expertise).<br />

A mix of tools can be used to create the necessary level of contact with stakeholders and<br />

achieve the consultation objectives. The table below (Table 5-2) provides suggestions for tools<br />

to be used for different scenarios.<br />

(More details on the tools are provided in Appendix A.)<br />

Tools<br />

Feel the<br />

pulse<br />

Test/<br />

refine<br />

Obtain<br />

buy-in<br />

Page<br />

reference<br />

1. Community meetings 3 3 3 64<br />

2. Exhibitions/road-shows 3 3 65<br />

3. <strong>Public</strong> forums 3 3 3 67<br />

4. Surveys 3 3 68<br />

5. Blogs 3 3 3 70<br />

6. Social media 3 3 3 72<br />

7. Website 3 74<br />

8. Focus group discussions 3 3 76<br />

9. Workshops 3 78<br />

10. Charrettes 3 3 80<br />

11. Citizen juries 3 3 81<br />

12. Delphi process 3 3 82<br />

13. Expert panels 3 3 3 83<br />

14. Interviews 3 3 84<br />

15. Working groups 3 85<br />

Target audience<br />

General public /large<br />

stakeholder population<br />

General public<br />

(IT-savvy population)<br />

Targeted to subject<br />

matter experts,<br />

stakeholder population<br />

Table 5-2: Sample tools for different purposes and target audiences


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 19 20 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Case 5:<br />

Improving public health care<br />

Agency/country:<br />

• Commission on the Future of Health Care in Canada, Canada<br />

Background:<br />

• The Canadian healthcare system is financed by both the provincial and federal governments,<br />

with each paying 50% of costs.<br />

• During the 1990s, growing concerns emerged about rising costs and the quality of service.<br />

<strong>Consultation</strong> Process:<br />

• The Commission on the Future of Health Care in Canada was established in April 2001 as a<br />

federal public inquiry to review and make recommendations on Canada’s public health care<br />

system. It was created to improve health care and make it more financially sustainable.<br />

• The public consultation process took place over the course of 18 months, commencing in<br />

April 2001, and was divided into two phases – fact finding and dialogue with the Canadians.<br />

• The Commission engaged both the public and experts extensively through 12 dialogue<br />

sessions, six televised debates, 21 days of open public hearings, nine expert workshops, three<br />

regional forums, 12 partnered dialogue sessions with universities, nine issue survey papers,<br />

two consultation workbooks, 97 site visits and meetings with national organisations and<br />

national caucuses, and 45 speeches and presentations to stakeholders across the country.<br />

• An interim report and final report were released by the Commission in February 2002 and<br />

November 2002 respectively, which summarised the findings of Canada’s health care system<br />

and offered 47 recommendations to enhance Canada’s health care.<br />

• The final report was seen as objective and credible, and the public felt that the Commission<br />

had listened intently to the public’s view on Canada’s health care.<br />

Learning points:<br />

• Appropriate selection of consultation tools was important for reaching the targeted<br />

stakeholders.<br />

• Extensive public engagement enabled better understanding of the issues/problems on the<br />

ground so that practical recommendations could be proposed.<br />

Source:<br />

• Mapleleafweb.com: Canada’s Premier Political Education Website, Romanow Commission on the Future<br />

of Health Care: Findings and Recommendations, <br />

• Dawn Ontario: DisAbled Women’s Network Ontario, 1998-2007, Responses to the final report by the<br />

Romanow Commission on the Future of Health Care in Canada, <br />

• 35 full-time staff were employed during the Commission’s peak periods. Other consultants<br />

were employed on an “as-needed” basis for a range of duties, including research, logistics and<br />

communications.<br />

Outcomes:<br />

• A considerable amount of public and media debate was generated from the public<br />

consultation process.<br />

• The Commission received 40 discussion papers, three major independent Research<br />

Consortium reports, 640 formal submissions, 591 formal presentations, 1,418 abstracts, and<br />

14,000 online health issue surveys.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 21 22 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Case 6:<br />

Master plan for Sungei Buloh Wetland Reserve<br />

Agency/country:<br />

5.3. Step 3: Anticipate obstacles and challenges<br />

Before launching the public consultation exercise, public officers need to think through the<br />

potential challenges and pitfalls that may arise during and after the exercise. Mitigating<br />

strategies and contingency plans need to be developed to handle these situations.<br />

The following are some commonly faced challenges and examples of mitigating strategies:<br />

1. Voluminous and diverse views<br />

Policies/initiatives which affect the society at large (e.g., primary education curriculum policies)<br />

or are controversial in nature (e.g., amendment to the Penal Code) tend to attract voluminous<br />

feedback which may be differing and diverse, and therefore, sometimes hard to manage.<br />

Officers should adopt a systematic approach to identify and deal with the most pressing and<br />

most common concerns among the stakeholders. Table 5-3 suggests a simple way for officers to<br />

categorise the feedback received.<br />

• National Parks Board (NParks), Singapore<br />

Background:<br />

• The objective of the consultation exercise was to seek feedback on the masterplan for the<br />

development of the Sungei Buloh Wetland Reserve.<br />

• With lessons learnt from Chek Jawa, which attracted voluminous public feedback, NParks<br />

decided to engage interest groups early in the consultation process.<br />

<strong>Consultation</strong> Process:<br />

• NParks involved the key stakeholders and interest groups at the early stages of the<br />

development plan.<br />

• Working groups were formed and meetings were held quarterly to discuss issues and<br />

concerns.<br />

• Stakeholders had open discussions with NParks and their input were directly included in the<br />

master plan for development.<br />

Demands by stakeholders<br />

directly affected<br />

Prioritisation of feedback<br />

1.<br />

2.<br />

3.<br />

Common areas of concern 1.<br />

2.<br />

3.<br />

Minority requirements 1.<br />

2.<br />

3.<br />

Table 5-3: Categorising feedback received<br />

If voluminous feedback is expected on an issue, one possible<br />

mitigating strategy is to start with targeted engagement of key<br />

stakeholders before consulting the wider populace. This will<br />

allow agencies to identify key area of concerns and controversy<br />

and develop strategies or responses before a large-scale<br />

consultation is launched.<br />

Tips for effectiveness<br />

For a situation where the<br />

feedback is voluminous,<br />

agencies can group<br />

feedback into broader<br />

categories based on<br />

common areas of concern.<br />

This allows the agencies<br />

to have a comprehensive<br />

assessment of the situation<br />

without being bogged<br />

down by the volume.<br />

This also helps the<br />

agencies to close the loop<br />

effectively (Step 8) as it<br />

will ensure that all key<br />

areas of concern had been<br />

considered.<br />

Outcomes:<br />

• Since the working group played a part in the planning process, they could assist NParks to<br />

address the concerns of the public during the wider consultation.<br />

• The public showed greater acceptance towards the government’s initiative when the nongovernmental<br />

groups showed buy-in towards the policy as well.<br />

Learning points:<br />

• For issues which could attract voluminous feedback, involving targeted stakeholders early<br />

helps to facilitate the consultation process with the wider populace.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 23 24 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

2. Sensitive/controversial issues<br />

For topics/issues which are controversial, emotive or which may provoke strong, opposing<br />

viewpoints, the engagement needs to be managed carefully.<br />

Agencies need to show sensitivity towards the stakeholders’ concerns, while at the same time<br />

gain trust from stakeholders through open and honest consultation.<br />

Case 7:<br />

Proposed amendments to the Human Organ Transplant Act (HOTA)<br />

Agency/country:<br />

• Ministry of Health (MOH), Singapore<br />

Background:<br />

• The public, local and international medical community had strong and quite emotional views<br />

on organ donation-related issues. When MOH proposed the amendments to the HOTA, an<br />

extensive public consultation was conducted.<br />

• In MOH’s case, the <strong>Public</strong> <strong>Consultation</strong> Document and the proposed Draft Bill were put up for<br />

public consultation so that the public and stakeholders could see the text amendments for<br />

themselves.<br />

<strong>Consultation</strong> Process:<br />

• MOH took a transparent view and shared the various possible solutions to the problem<br />

openly at the various forums and through the media.<br />

• MOH engaged the stakeholders early to clarify policy areas to the public (in this case, the<br />

definition and limit of compensation for organ donation).<br />

• The fronting by Minister for Health demonstrated the commitment and seriousness of MOH<br />

in listening to the stakeholders:<br />

- MOH opened the public dialogue sessions for media coverage so that issues were aired<br />

and discussed in the open.<br />

- Wide range of people such as the medical and professional bodies (e.g. Academy<br />

of Medicine, <strong>College</strong> of Family Physicians, Singapore Medical Association, Society of<br />

Transplantation, Singapore Diabetic Society of Singapore, Law Society and National<br />

Kidney Foundation) were consulted.<br />

• In MOH’s case, the <strong>Public</strong> <strong>Consultation</strong> Document and the proposed Bill were put up for<br />

public consultation so that the public and stakeholders could see the text amendments for<br />

themselves.<br />

Follow up:<br />

• LiveOn, an organ donation campaign, was launched as a follow-up after the amendments<br />

were made to sustain awareness and acceptance of organ donation.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 25 26 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Outcomes:<br />

• <strong>Consultation</strong> results showed that Singaporeans understood the need and were generally<br />

supportive of the proposed amendments to HOTA. This was largely because there were<br />

extensive discussion and transparency in the consultation process.<br />

Learning points:<br />

• <strong>Consultation</strong> on emotive issues need to be managed carefully through<br />

- Early consultation,<br />

- Well-managed public education on the key considerations and options available; and<br />

- Displaying sensitivity to stakeholders’ concerns<br />

The concept of ‘socialising’<br />

For topics/issues which are emotive in nature, it can be useful to ‘socialise’ policy ideas early. This<br />

is when possible policy ideas are disseminated to the ground to generate discussion amongst<br />

social groups as a means of seeding ideas for policy options.<br />

For example, the idea of Means Testing by MOH was raised several years prior to formal public<br />

consultation in 2008 and its eventual implementation in 2009. As Means Testing was a rather<br />

unpopular policy, particularly among the middle-income group who felt deprived of affordable<br />

healthcare, MOH adopted this approach to socialise the concept, to generate ideas, feedback<br />

and discussions on means-testing criteria. The extensive dialogues gradually helped to address<br />

ground concerns and facilitate smoother implementation.<br />

3. Feedback on specific issues and with targeted groups<br />

Some consultation exercises may yield lower response from the public due to the nature of<br />

the issue or policy at hand. The possible causes can be lack of public interest, lack of public<br />

awareness and inaccessible feedback mechanisms. Agencies should consider the following to<br />

enhance the level of participation and feedback:<br />

• Establishing checkpoints during the course of the consultation period to monitor the<br />

response rate,<br />

• Extending the duration of the consultation period,<br />

• Increasing awareness through different tools and channels; and<br />

• Soliciting feedback from specific stakeholders by collaborating with partners.<br />

Policies which are highly complex or technical in nature generally tend to attract lower volume<br />

of feedback, particularly if the stakeholders do not understand the issue at hand (e.g., financial<br />

regulations).<br />

For such policies, agencies should choose to target industry players and experts with the<br />

relevant knowledge and interest in the issues.<br />

If the wider population is consulted, agencies need to ensure that the information provided for<br />

the consultation is accessible and easy to understand.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 27 28 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Case 8:<br />

Regulation of investment products<br />

Agency/country:<br />

• Monetary Authority of Singapore (MAS), Singapore<br />

Background:<br />

• In 2009, MAS developed proposals to safeguard consumers’ interests and promote higher<br />

industry standards for the sale and marketing of unlisted investment products.<br />

• The proposed amendments to regulations typically did not attract much interest from the<br />

wider populace due to their complexity. Nevertheless, MAS felt that it was important to<br />

consult the wider populace because this particular set of regulations would have direct<br />

impact on the way consumers purchased investment products.<br />

<strong>Consultation</strong> Process:<br />

Subsequent steps:<br />

• MAS published its response to the feedback received in the consultation paper in September<br />

2009 and January 2010. MAS also issued a new consultation paper on some additional<br />

proposals later in January 2010.<br />

Learning points:<br />

• For issues which may attract low volume of public feedback, input from the public can be<br />

obtained through:<br />

- Partnership with community leaders,<br />

- Educating stakeholders on how the policies impact them; and<br />

- Ensuring that materials and terminology used are jargon-free and accessible.<br />

• MAS engaged experts and industry players during policy development to provide technical<br />

inputs to the policy.<br />

• To consult the wider populace, MAS leveraged on consumer groups such as CASE and the<br />

Securities Investors’ Association Singapore (SIAS) to reach out to their members.<br />

• MAS also put its consultation paper on the REACH portal to solicit feedback from REACH<br />

members.<br />

• In addition, MAS briefed the local media on the significance of the proposed amendments<br />

for consumers and encouraged feedback from the public through the media.<br />

• It was ensured that the information used to brief the public was free of jargon and easy to<br />

understand.<br />

Outcomes:<br />

• MAS received a wide range of useful feedback from investors, market practitioners, and<br />

industry associations. The consultation paper attracted significantly more feedback from the<br />

general public than previous ones.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 29 30 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Case 9:<br />

Contract period and early termination charges<br />

for telecommunication services offered to consumers<br />

Agency/country:<br />

• Infocomm Development Authority (IDA), Singapore<br />

Background:<br />

• In December 2008, IDA proposed to issue Guidelines on the maximum contract period<br />

and early termination charges (ETC) that providers of residential fixed-line, mobile and<br />

broadband services could impose on consumers. The Guidelines specified that:<br />

- The maximum contract periods should not exceed 24 months; and<br />

- Consumers who signed contracts that were longer than three months and who<br />

terminated their contracts before the end of their contract period should not have to pay<br />

a fixed ETC. Rather, ETCs should decrease over time.<br />

• In proposing the Guidelines, IDA considered that long contract periods and excessive ETCs<br />

may unfairly penalise consumers and hinder them from legitimately terminating services<br />

and switching operators.<br />

• IDA issued the final Guidelines in December 2009 and issued a press release to explain the<br />

Guidelines. IDA worked closely with the media to ensure that the public was made aware of<br />

the changes that would be put in place.<br />

• The final Guidelines were accompanied by an explanatory memorandum setting out IDA’s<br />

views and responses to the key comments received from the earlier consultation, and the<br />

considerations behind IDA’s decision.<br />

• IDA provided the operators with a three and a half month lead time to implement the<br />

Guidelines. Over the next few months, IDA continued to provide guidance to both operators<br />

as well as consumers on the implementation of the Guidelines.<br />

Learning points:<br />

• For issues in which public feedback and support is important, it is necessary to proactively<br />

engage the mass media to ensure that any consultation is widely publicised.<br />

• It is also important to ensure that technical policies are clearly explained and the materials<br />

made available are easily understood by the wider populace.<br />

• As part of the overall stakeholder management strategy, for decisions which may adversely<br />

affect any stakeholders, it is important to engage the stakeholders and provide some form of<br />

advance notification prior to announcing the final decision.<br />

<strong>Consultation</strong> process:<br />

• IDA conducted a public consultation on the proposed Guidelines on 23 December 2009,<br />

which lasted four weeks.<br />

• To ensure the issues were understood by the wider public, IDA avoided using industry jargon<br />

in the consultation paper, but tried to explain the issues and the proposed solutions in<br />

simple clear language.<br />

• IDA worked closely with the media to explain the issues in the consultation.<br />

Outcomes:<br />

• IDA received 13 sets of comments – three from telecommunication operators and 10<br />

from individual consumers. Consumers were overwhelmingly in favour of the proposed<br />

Guidelines, while responses from the telecommunication operators were mixed but<br />

generally negative. The media published two articles and an editorial on the proposed<br />

Guidelines.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 31 32 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

4. Unpopular decisions<br />

In the event that agencies have to decide on an outcome that is unpopular (i.e., where majority<br />

support is lacking) with stakeholders, steps have to be taken to manage the ground sentiment<br />

and mitigate the negative implications of the policy/initiative. Agencies are advised to:<br />

• Provide a detailed explanation of the rationale behind the decision,<br />

• Manage expectations by being clear about the scope of consultation and what measures can<br />

be changed and cannot be changed; and<br />

• Actively address the negative externalities, such as introducing measures to mitigate the<br />

adverse effects on the stakeholders.<br />

Case 10:<br />

Maintaining anti-euthanasia regulation<br />

Country:<br />

• Canada<br />

Background:<br />

• Euthanasia is officially illegal in Canada. Between 2005 and 2010, three private bills were<br />

tabled by a Member of Parliament to legalise euthanasia.<br />

<strong>Consultation</strong> Process:<br />

• Extensive debate was generated on the issue by provincial governments, non-governmental<br />

organisations, the media and individuals. For example, the Quebec provincial government<br />

conducted national assembly hearings which sought feedback from public and medical<br />

specialists. Non-government organisations (NGO) were also proactive in engaging the public<br />

on what euthanasia entailed.<br />

• The Angus Reid <strong>Public</strong> Opinion survey in 2010 showed that 67 per cent of respondents in<br />

Canada supported legalising euthanasia.<br />

Outcomes:<br />

• Despite public support for euthanasia, it was not legalised as there were insufficient votes in<br />

the House of Commons to advance the bill.<br />

• Many legislators recognised this was a sensitive issue requiring extensive debate which<br />

should continue to take place.<br />

• Guidelines and exceptions had been introduced to deal with special cases and legislation<br />

on euthanasia distinguished between passive and active euthanasia. The debate also<br />

emphasised the need to improve palliative and elder care.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 33 34 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Learning points:<br />

• While the legislation was not passed despite popular support, the extensive debate<br />

highlighted the polarity of views and key concerns of different stakeholder groups.<br />

• The debate highlighted areas of need of different stakeholder groups which needed to be<br />

addressed. Legislators were mindful that these requirements should be addressed quickly<br />

while the larger debate on the controversial topic would continue.<br />

Source:<br />

• Vision Critical, 2010, Angus Reid <strong>Public</strong> Opinion, Two-thirds of Canadians Express Support for Legalizing<br />

Euthanasia, .<br />

• International Task Force.org, Euthanasia and Assisted Suicide in Canada. <br />

• The Montreal Gazette, 16 Feb 2010, Doctors back ‘right to die’, <br />

• Toronto Sun, 21 Apr 2010, MPs band together to study palliative care, <br />

5. Controversial feedback<br />

With the introduction of new media, there are more public settings/forums where individuals<br />

can post extreme opinions or baseless claims. While participants are entitled to their opinions,<br />

there are cases where certain participants may post or bring up issues which are unreasonable<br />

or are not based on evidence.<br />

Due to the provocative nature of such comments, agencies need to handle the situation<br />

sensitively and moderate the discussion. Agencies should consider:<br />

• Removing controversial comments/postings from the public settings/forums. The agency<br />

should put a disclaimer statement in the public consultation process (e.g., in the new media<br />

platform used and information posted) that allows the agency the right to retain or remove<br />

any insensitive or controversial comments/postings received; and<br />

• Addressing the individuals or groups that raised the issue/concern through closed-door<br />

meetings.<br />

This allows the agencies to clarify their position on the issue and allows officers to resolve the<br />

concerns within a contained setting.<br />

6. Noise from minority groups<br />

Certain policies or initiatives may affect minority groups in a larger and disproportionate way<br />

compared to the majority stakeholders. Officers must balance the need to manage minority<br />

group requirements while at the same time not compromising the considerations for the<br />

majority. Minority group feedback, if not managed well, can lead to “noise” which will overcrowd<br />

and narrowly define the public consultation exercise for it to be effective.<br />

Agencies can consider:<br />

• Profiling affected stakeholders to anticipate concerns likely to be raised during the exercise;<br />

and<br />

• Assessing the need to conduct separate consultation exercises with minority groups to<br />

enable a more targeted resolution towards minority requirements.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 35 36 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Timeframe allocated to consultation period<br />

6. <strong>Consultation</strong> preparation<br />

and implementation<br />

With the establishment of the consultation strategy in the pre-consultation phase and<br />

conceptual development phase, the next phase would be to plan and implement the<br />

consultation exercise. This entails:<br />

The actual timeframe allocated to the consultation would vary with the nature, scope and extent<br />

of the policy/initiative undergoing development and the impact it has on the stakeholders.<br />

For a full-scale consultation, it is suggested that agencies allocate at least three months for the<br />

consultation process, with provisions for a longer duration if required.<br />

Logistical arrangements<br />

<strong>Public</strong> consultation is one of the customer touch points where agencies interact directly with<br />

the public. Feedback can also be collated in face-to-face sessions and not just via email. Hence,<br />

during the implementation of the consultation exercise, event management matters such as<br />

logistics and attitude of officers will affect the public’s opinion of the agencies. Some of the areas<br />

officers need to manage are captured in the checklist in Table 6-1 on page 37.<br />

• Developing the action plan and timeline of consultation;<br />

• Designing the consultation materials; and<br />

• Generating awareness amongst stakeholders to be consulted.<br />

6.1. Step 4: Develop action plan and timeline<br />

Officers need to set out an action plan and detailed timeline to implement the consultation<br />

strategy.<br />

Action plan<br />

The action plan provides a tool for the planning of the operational procedures required in a<br />

consultation exercise. Key components which need to be considered are:<br />

• Activities, such as:<br />

- Obtaining approval for the consultation strategy<br />

- Developing consultation materials<br />

- Making logistical preparation and planning<br />

- Determining the consultation period<br />

- Preparing the consultation report<br />

- Evaluating consultation effectiveness<br />

• Time required for each activity<br />

• Responsible parties involved<br />

The action plan should be continuously monitored to ensure that the activities are on track. A<br />

template of an action plan can be found in Appendix B.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 37 38 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Table 6-1: Checklist on Logistical Arrangements for <strong>Public</strong> <strong>Consultation</strong><br />

Invitation letters<br />

• Does the timeframe stated in the invitation letters provide sufficient notice to stakeholders?<br />

• Do the invitation letters contain all the relevant consultation materials and accurate information<br />

of the consultation exercise?<br />

• Do the invitation letters to the stakeholders clearly state the scope/parameter and objectives of<br />

the consultation?<br />

Event management<br />

• Is there sufficient space in the venue to cater for the expected number of participants?<br />

• Does the venue have the necessary equipment, such as sound system, audio visual equipment,<br />

projection screens, reception area?<br />

• Is the location chosen for the consultation wheel-chair accessible?<br />

• Is the venue accessible to all parties invited (e.g., for physically handicapped)?<br />

• Has sufficient food and/or refreshments been catered for?<br />

Accessibility of exercise<br />

• Is the mode of consultation accessible to all stakeholders invited to participate (including the<br />

illiterate, those who are not IT savvy, or the physically handicapped)?<br />

Materials<br />

• Will majority of the participants understand the materials prepared?<br />

• Do the materials provide sufficient background on the policy or initiative for the participants to<br />

provide meaningful feedback?<br />

Speakers/facilitators/moderators<br />

• Have the speakers/facilitators been sufficiently briefed about the background and objectives of<br />

the consultation exercise?<br />

• Have the speakers/facilitators been provided with sufficient additional materials to respond to<br />

anticipated questions or comments from the participants?<br />

• Have the speakers/facilitators been briefed on the participants’ profile and their general<br />

concerns?<br />

• Has a moderator been carefully selected to ensure the exercise stays on track and does not go<br />

out of focus?<br />

Additional information<br />

• Can the public obtain additional information on the specific policy/initiative during consultation<br />

exercise?<br />

Monitoring feedback<br />

• Are there mechanisms/resources to track the level of feedback and response rate during the<br />

consultation exercise?<br />

• Are there mechanisms to gather feedback on the effectiveness of the consultation exercise (e.g.,<br />

feedback forms for event)?<br />

• Is there a loop-back communication process to the stakeholders/public who provided key<br />

feedback at the exercise?<br />

6.2. Step 5: Design consultation materials<br />

Participants of public consultation need to be clear about the background of the issue/topic<br />

before they can be consulted. Effective design of consultation materials can ensure proper<br />

understanding, help shape direction of the discussion and increase the quality of feedback<br />

received.<br />

The consultation materials should contain sufficient information on a particular policy/initiative,<br />

giving stakeholders a proper grasp of the issue. The language used should be concise, jargonfree,<br />

and easy-to-understand for a layperson. In general, the consultation materials should<br />

contain information on the following:<br />

1. Background of policy<br />

• Impetus for new policy or change to existing policy<br />

• Key considerations and constraints<br />

2. Scope of consultation<br />

• Specific areas which stakeholders are consulted on, and where there is scope of influence<br />

3. <strong>Consultation</strong> process<br />

• Timeframe of consultation<br />

• How participants can provide feedback<br />

• Sources for more information (e.g., agency websites or hotlines)<br />

• How and when agencies will provide an update on the outcome of the consultation


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 39 40 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

In Singapore, the government may wish to also consider a four-phase communication strategy<br />

process 4 to consult on policies/initiatives<br />

6.3. Step 6: Generate awareness and plan<br />

public communication exercises<br />

Generating stakeholder awareness and planning a public communications exercise is a critical<br />

aspect of public consultation. There are generally two approaches for any agency to take as they<br />

prepare for a public communication and awareness exercise:<br />

1. Open consultation – this involves communicating to key stakeholders including the general<br />

public that a consultation exercise is going on. The agency should keep both the broadcast<br />

and print media aware of the issues and the actual consultation process. At the same time,<br />

the agency should try to think ahead and prepare their positions in anticipation of any<br />

difficult issues or responses raised.<br />

2. Closed door consultation – this involves only communicating to a selected or targeted<br />

group and inviting them to participate in the exercise. The consultation is conducted away<br />

from the public eye and the media.<br />

1. Listening phase – an early fact finding stage, where there is no need for any major public<br />

communications campaign. The messages during this phase could be to assure the public<br />

that no decision has been made and that a decision would be made only after rigorous<br />

evaluation of the issues involved.<br />

2. Holding phase – At this stage, press statements can be released to explain rationale for<br />

policy/initiative.<br />

3. <strong>Consultation</strong> phase – At this stage, state explicitly when and how public consultation would<br />

be conducted to ensure the public does not feel that the government has already made up<br />

its mind.<br />

4. Buy-in phase – With the assumption that a decision had been made on the policy/initiative,<br />

the government should explain why it decided on that policy and its plans.<br />

A public communications plan should be developed to provide a structured and well-planned<br />

approach to engage the stakeholders. A suggested communications plan checklist, outlining the<br />

key components of a communications plan, is outlined in Table 6-2.<br />

There are two key objectives in generating awareness:<br />

1. Educating stakeholders on the policy or initiative.<br />

This will increase the likelihood that the feedback<br />

provided will be meaningful.<br />

2. Increasing awareness about the consultation<br />

exercise, to ensure adequate participation from<br />

targeted stakeholders.<br />

Possible channels/platforms for<br />

raising awareness<br />

• Exhibitions and road shows<br />

• Government websites<br />

• Mailers<br />

• New media, e.g., blogs<br />

• Partnerships (with nongovernment<br />

organisations,<br />

business and trade associations,<br />

grassroot leaders<br />

• Media events<br />

• Press releases<br />

• <strong>Public</strong> notices<br />

• Information kits<br />

• Site visits<br />

4 Source: <strong>Public</strong> <strong>Consultation</strong>: Re-inventing Dialogue, Singapore: Centre of Governance and Leadership, <strong>Civil</strong> <strong>Service</strong><br />

<strong>College</strong>, 2004.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 41 42 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Table 6-2: <strong>Public</strong> Communication Plan Checklist<br />

Objectives of public communication exercise<br />

• Goals of this communications exercise (e.g., to generate awareness and increase participation<br />

level for public consultation)<br />

Key messages<br />

• Rationale for public consultation (why consult?)<br />

• Proposed changes to policy/initiative (what are the desired outcomes?)<br />

• What agency hopes to achieve from the consultation (what can we achieve?)<br />

• Potential benefits of proposed changes (what is the rationale for the proposed policy initiative?)<br />

• Specific messages for each of these groups<br />

Target Audience<br />

• Direct stakeholders<br />

- Who might benefit from policy changes?<br />

- Who might be affected by policy changes?<br />

- What are the specific implications on them?<br />

• Interest groups<br />

- Who might be interested in the issue?<br />

Strategies<br />

• For technical issues/policies/initiatives which are targeted at selected groups – determine if there<br />

is a need to engage in a publicity campaign or if engaging selected target groups in a closeddoor<br />

session would suffice<br />

• For general issues/policies/initiatives – wider publicity efforts may be needed as they impact the<br />

masses<br />

Tactics/channels<br />

• Select appropriate tools/media/platform according to the policy/initiative<br />

• Based on the target audience, select the most effective channel(s) of communication (e.g., web,<br />

portals, blogs)<br />

Timeline<br />

• When does the communication start?<br />

• When does the communication have to be completed by?<br />

• What are the key milestones in the exercise?<br />

Roles and responsibilities<br />

• Who are responsible for crafting, delivering and tracking the messages?<br />

• Have both the policy department and corporate communications department within the agency<br />

worked closely together to craft and launch the public communications exercise?<br />

Status<br />

• Track the completion status of activities (e.g., on track, completed, delayed)<br />

Evaluation<br />

• Determine/track whether the communications exercise was effective in generating<br />

awareness and increasing participation level<br />

Table 6-2: Suggested checklist for public communication exercises<br />

Source: Ministry of Information, Communications and the Arts (MICA)<br />

Case 11:<br />

URA Master Plan 2008<br />

Agency/country:<br />

• Urban Redevelopment Authority (URA), Singapore<br />

Background:<br />

• URA Master Plan 2008 guides Singapore’s physical development over the next 10 to 15 years.<br />

It incorporates the future development plans for key land uses such as housing, recreation,<br />

community, business, land transport and infrastructure needs.<br />

• <strong>Public</strong> consultation and stakeholder engagement was an integral part of the Master Plan<br />

process by URA.<br />

<strong>Consultation</strong> Process:<br />

• During the development of the Master Plan 2008, URA conducted stakeholder dialogues for<br />

the key growth areas of Jurong Lake District, Kallang Riverside, Paya Lebar Central and the<br />

new Islandwide Leisure Plan. The dialogues involved key stakeholders such as architects,<br />

developers, business organisations, NGOs, academics and the community. The dialogues<br />

allowed the plans to be detailed to the stakeholders and for them to give URA feedback<br />

on the proposals. Based on the input received, URA refined the proposals for the public<br />

exhibition.<br />

• The draft version of the Plan was exhibited to obtain public feedback<br />

- Virtual plans and videos were uploaded on the URA web portal; and<br />

- Physical plans, scaled models and videos were exhibited at the URA Centre.<br />

• Over 185,000 people viewed the draft Plan at the URA Centre and the website and 300<br />

written feedback was received on the Plan.<br />

• Based on the public input and feedback, the Master Plan 2008 was refined further before<br />

being gazetted on 10 Dec 2008.<br />

• In addition, URA developed a roving exhibition which brought the Master Plan 2008<br />

proposals to eight heartland malls. This raised public awareness of the Master Plan and<br />

key proposals and informed the wider populace of changes that would take place in their<br />

neighbourhoods.<br />

• More than 200,000 heartlanders visited the roving exhibition at the eight different venues.<br />

More than 1,300 written feedback was received. The online website garnered a visitorship of<br />

47,200 hits over the four-month period.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 43 44 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Outcomes:<br />

• The exhibitions served to educate and raise the awareness of Master Plan 2008 and<br />

its proposals, allowing the public to be aware of the existing attractions around their<br />

neighbourhood and the key changes that would be taking place at the national scale as<br />

well as in their local areas. It also allowed the public to provide meaningful feedback to the<br />

upcoming developments.<br />

Learning points:<br />

• The appropriate selection of channels and effective design of communications materials are<br />

important to be effective in generating awareness:<br />

- The use of visual exhibitions helped stakeholders to better understand the Master Plan<br />

2008, allowing them to provide meaningful feedback; and<br />

- Using different channels (e.g., physical exhibition, website, road shows) allowed URA to<br />

reach a wide audience.<br />

6.4. Step 7: Launch consultation exercise<br />

During the period of public consultation, it is important that stakeholder sentiment and<br />

expectations are well managed. The following highlights some key considerations:<br />

1. Be explicit about the scope of influence. <strong>Public</strong> officers need to be unambiguous about the<br />

parameters that are open for feedback in the consultation exercise. This will avoid creating<br />

false expectations that might result in stakeholder displeasure.<br />

2. Background knowledge. <strong>Public</strong> officers need to ensure that participants have relevant<br />

background materials and understand the policy/initiative under consultation. Please refer<br />

to Step 5 – designing consultation materials.<br />

3. Identify all feedback channels. Agencies need to make known to stakeholders all available<br />

feedback channels. The feedback channels should be intuitive and tailored to the targeted<br />

stakeholders.<br />

4. Be clear about the consultation timeline. Agencies need to state upfront the period of<br />

consultation and processing of feedback. Stakeholders should have a clear idea on when the<br />

agencies will close the loop with them and report the findings.<br />

5. Monitor the feedback received. Agencies should regularly monitor the level and type of<br />

feedback received. Agencies can then calibrate actions to be taken during the consultation<br />

exercise, such as extending the timeline, providing more background materials, or managing<br />

stakeholder sentiment.<br />

A case in point is illustrated on page 45.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 45 46 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Case 12:<br />

Penal Code (Amendment) Bill<br />

Agency/country:<br />

• Ministry of Home Affairs (MHA), Singapore<br />

Background:<br />

• MHA reviewed and proposed amendments to the Penal Code in 2007. As the Penal Code had<br />

a wide ranging impact on society, extensive public consultation was conducted to gather<br />

feedback and assess public sentiment.<br />

<strong>Consultation</strong> Process:<br />

• MHA posted the Amendment Bill on REACH’s Portal for the public to give their feedback and<br />

views.<br />

• MHA was explicit about the scope of influence; members of the public were invited to<br />

provide feedback for either one or all the amendments to the Penal Code.<br />

• To ensure participants had a clear context and background of the information a summary<br />

of the amendments to the Penal Code was provided in the e-portal of REACH to provide an<br />

explanation on the amendments. Presentations on the amendments were also delivered<br />

during the focus groups to prepare participants for the discussion.<br />

• MHA partnered REACH to post the Amendment Bill on REACH’s Portal for the public to give<br />

their feedback and views. A news release was also issued to inform members of the public on<br />

the consultation exercise.<br />

• MHA also worked with REACH to identify facilitators to conduct focus groups, and<br />

stakeholders to participate in them.<br />

• Feedback was sought from people from different walks of life, e.g., religious groups, voluntary<br />

welfare organisations (VWOs), students, grassroots members, social workers.<br />

• A women-only focus group was also set up to discuss the proposals, particularly those which<br />

concerned marital immunity which impacted them directly.<br />

• MHA also sought feedback from the Law Society on the proposed amendments.<br />

• MHA was upfront that the consultation would be over a period of five months.<br />

• REACH assisted MHA in monitoring feedback received over the e-portal and collated the<br />

feedback for MHA’s attention. MHA also actively monitored and collated feedback received<br />

from other channels such as feedback posted in the media, Law Society and focus groups for<br />

evaluation.<br />

Outcomes:<br />

• MHA evaluated the feedback received and incorporated some of the suggestions into the<br />

Bill.<br />

• The feedback was acknowledged in the Second Reading Speech in Parliament.<br />

7. Follow-up and analysis<br />

Closing the loop is a vital step in the public consultation process. After being consulted, the<br />

public will expect to know the outcome. Hence, after the consultation period ends, agencies are<br />

encouraged to follow up on:<br />

• Collating the feedback and closing the loop with stakeholders; and<br />

• Assessing the effectiveness of the consultation exercise and identifying areas for<br />

improvement.<br />

7.1. Step 8: Collate feedback and close the loop<br />

After the feedback is received from the participants, agencies need to collate the feedback to<br />

identify the common themes and important issues. Agencies should consolidate and categorise<br />

the feedback and data received and document the findings in a report.<br />

The report should contain the following information:<br />

• Number of participants;<br />

• Timeframe of the consultation exercise;<br />

• <strong>Consultation</strong> process (channels, feedback mechanisms);<br />

• Feedback received (categorised);<br />

• Explanation for accepting or rejecting each category<br />

of feedback; and<br />

• Limits of the consultation approach.<br />

In addition, agencies need to demonstrate that they recognise<br />

and acknowledge the contributions of participants and assure<br />

participants that their feedback has been taken into<br />

consideration. This will also serve to encourage further<br />

involvement in public consultation exercises in the future.<br />

“... a common grouse<br />

of the public who are<br />

unhappy with the<br />

government’s public<br />

consultation process is<br />

the oft quoted officious<br />

and non-committal<br />

replies they receive. Whilst<br />

they do not expect the<br />

government to agree to<br />

or accept every feedback<br />

and suggestion, they do<br />

expect the government<br />

to adequately address<br />

their concerns and explain<br />

the rationale for the<br />

decisions.”<br />

– Dr Amy Khor,<br />

Chairman REACH


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 47 48 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

The three stages of closing the loop and a suggested timeline are shown in the table below<br />

(Table 7-1):<br />

There are three stages in closing the loop which should be followed:-<br />

Stage What to incorporate Purpose Timeline<br />

3. <strong>Public</strong>ation<br />

Announce published report to other interested<br />

stakeholders or the general public.<br />

Acknowledgement • Recognition for<br />

feedback provided<br />

• Expected timeline<br />

for processing<br />

feedback<br />

• To demonstrate<br />

that the agency<br />

recognises and<br />

appreciates the<br />

contributions<br />

Within one working<br />

day<br />

2. Explanation<br />

Develop a report of participants’ feedback and<br />

the respective response by the agency. Share<br />

the report with the participants.<br />

Explanation • Details of<br />

consultation (date,<br />

duration, purpose)<br />

• Feedback provided<br />

by participants/<br />

stakeholders<br />

• Approach for<br />

considering<br />

feedback<br />

• Reasons for<br />

incorporating/<br />

not incorporating<br />

feedback<br />

• Outcome of<br />

consultation<br />

Note: Reports can<br />

be customised for<br />

different stakeholder<br />

groups, depending on<br />

the extent and nature<br />

of involvement<br />

• To close the loop<br />

with stakeholders<br />

who took effort<br />

and time to<br />

provide feedback<br />

• To explain to<br />

these participants<br />

how the feedback<br />

was processed,<br />

and reasons for<br />

incorporating/not<br />

incorporating the<br />

feedback<br />

• To provide<br />

assurance that<br />

the policy or<br />

initiative was<br />

developed with<br />

input from these<br />

stakeholders<br />

Varies depending<br />

on complexity of<br />

issue and agency’s<br />

decision making<br />

timeline<br />

1. Acknowledgement<br />

Generic, automated response to acknowledge<br />

individual feedback received.<br />

<strong>Public</strong>ation • Details of<br />

consultation<br />

• Summary of<br />

feedback provided<br />

• Outcome of<br />

consultation<br />

• To increase<br />

the public’s<br />

awareness of the<br />

initiative, and<br />

inform them<br />

about the issues<br />

and concerns<br />

raised, and<br />

how they were<br />

addressed<br />

Varies depending<br />

on complexity of<br />

issue and agency’s<br />

implementation<br />

timeline<br />

Table 7-1: Three stages of closing the loop


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 49 50 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Case 13:<br />

Registration framework for public accountants<br />

Agency/country:<br />

• Accounting and Corporate Regulatory Authority (ACRA), Singapore<br />

Background:<br />

• ACRA launched a consultation exercise in July 2007 to seek views on whether the registration<br />

framework for public accountants was sufficiently relevant and robust.<br />

<strong>Consultation</strong> Process:<br />

• ACRA engaged the profession and the business community by publishing the consultation<br />

report 2007 and the final report 2008 at ACRA’s annual <strong>Public</strong> Accountants Conference (PAC).<br />

The PAC was well attended by public accountants and representatives from the business<br />

community, with an average attendance of 500-700 persons. The PAC was therefore an<br />

effective channel for the consultation exercise.<br />

• ACRA pro-actively consulted the various stakeholders through focus group discussions,<br />

“consultation clinics”, written submissions and print media. The focus group sessions were<br />

useful, particularly for a number of the audit firms whose “peak season” occurred during the<br />

ACRA consultation period. Feedback was received from a number of firms that would not<br />

otherwise have provided their feedback during the consultation, as they were not able to<br />

devote their staff to prepare the written feedback (in one example, it was felt that having 10<br />

partners (senior management in audit firms) spend 2 hours to provide feedback to the ACRA<br />

team was more cost effective to the firm, compared to a few man days writing and vetting<br />

the feedback.<br />

• The stakeholders included public accounting entities (the big four firms), professional bodies<br />

(e.g., ACCA, CPA Australia), academics and general public.<br />

• The public consultation exercise took place over two months.<br />

• Closing the loop via ACRA’s annual <strong>Public</strong> Accountants Conference.<br />

• In 2008, ACRA closed the loop via a presentation to round up its consultation exercises.<br />

Outcomes:<br />

• The final report of the consultation outcomes were also posted on the ACRA website at<br />

http://www.acra.gov.sg/News_and_Events/<strong>Public</strong>+Accountants+Conference+2008.htm<br />

• Quality feedback and validation of ACRA’s Statements of policy intent and regulatory<br />

strategy: Stakeholders provided valuable feedback which supported and validated many<br />

of ACRA’s observations and proposals. At the ACRA conference which was well attended by<br />

the majority of the public accounting firms registered with ACRA, the ACRA representative<br />

also addressed feedback which did not translate into eventual policy decisions, or where<br />

the original proposal put forth for consultation was modified after due consideration of<br />

feedback.<br />

• Timely action resulting in good reputation of ACRA as a responsive government agency: The<br />

participants were pleased to note that ACRA did a prompt follow-through on the issue of the<br />

then “talent crunch” faced by the accounting profession, by committing to a review of the list<br />

of recognised qualifications for registering public accountants.<br />

Learning points:<br />

• Given the segmented nature of the public accountancy profession, the consultation enabled<br />

ACRA to better understand the diverse concerns of different stakeholder groups. The strategy<br />

to extensively reach out and engage different stakeholder groups ensured comprehensive<br />

coverage of the profession’s interest.<br />

• ACRA closed the loop effectively with participants and stakeholders through:<br />

(a) A well-documented report of the consultation exercise. The consultation<br />

report is available on the ACRA website at: http://www.acra.gov.<br />

sg/NR/rdonlyres/4C5D29D8-A7BC-4216-B951-18D47EAF0789/9845/<br />

TheRegistrationFrameworkfor<strong>Public</strong>AccountantsPathto.pdf<br />

(b) Arranging for the final report (post consultation) to be presented to the consulted<br />

parties, at an annual ACRA conference. In so doing, the consulted parties received<br />

the benefit of a face-to-face presentation, as well as the opportunities to clarify any<br />

remaining questions which they had on the policies being consulted.<br />

(c) Posting the presentation slides (outlining the outcome of the consultation exercise) on<br />

ACRA’s website. In so doing, the information contained in the “closing the loop” phase of<br />

the consultation process is “preserved” for future reference. It also helped ACRA maintain<br />

its reputation for being a transparent and responsive regulator.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 51 52 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Case 14:<br />

Identity Verification System (IVS)<br />

Country:<br />

• Department of Internal Affairs, New Zealand<br />

Background:<br />

• The New Zealand Department of Internal Affairs conducted public consultation to identify<br />

stakeholder expectations of the design and functions of the online secure government<br />

services.<br />

<strong>Consultation</strong> process:<br />

• The public provided clear and vocal feedback about the service design that they valued and<br />

expected.<br />

• After the public consultation exercise, the New Zealand government collated and analysed<br />

the feedback.<br />

• The results were published and reported in a document “What People Said”, which was<br />

released online on their government website and through other media forms.<br />

• “What People Said” report covered the details of the public consultation process, including:<br />

- The number of participants;<br />

- Timeframe of the consultation exercise;<br />

- Channels and tools for communication and their respective responses;<br />

- Evaluation and explanation of the analytical process for the feedback, and<br />

- Limits of the consultation approach.<br />

Outcomes:<br />

• Substantial support for the service led to its development. The service was partially available<br />

in 2009 and will be fully launched in 2011.<br />

7.2. Step 9: Assess effectiveness of the<br />

public consultation exercise<br />

The effectiveness of the public consultation exercise should be evaluated to:<br />

1. Assess whether involving the stakeholders contributed to improved services,<br />

actions or decision making,<br />

2. Find out what worked, what did not and why,<br />

3. Enhance learning and improve future practice; and<br />

4. Identify areas for improvement for future exercises.<br />

There are three suggestions for assessing effectiveness:<br />

1. Decision analysis, which assesses whether the strategic objectives of the consultation<br />

exercise were met.<br />

2. Process review, which assesses the effectiveness of the consultation process, e.g., whether the<br />

timeline was adhered to and whether the response rate was met.<br />

3. Participant satisfaction, which evaluates the general sentiment/satisfaction of participants<br />

who took part in the consultation process.<br />

The checklist on the following page (Table 7-2) can be used to assist officers in assessing the<br />

effectiveness of consultation exercises.<br />

Learning points:<br />

• The New Zealand government engaged an independent consultant to assist them in<br />

documenting the findings of consultation exercise. The release of the comprehensive report<br />

acknowledged the participants’ contribution to the issue, provided clarity to the participants<br />

on how their feedback was considered, and the outcome of the consultation exercise.<br />

Source:<br />

• The Department of Internal Affairs New Zealand, 2008. <strong>Public</strong> consultation about the igovt service<br />

– What people said, .


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 53 54 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Decision audit analysis<br />

Key considerations<br />

1. Were the strategic objectives of the consultation exercise met?<br />

2. Did the consultation result in an informed decision, shape a policy or an action?<br />

3. Has the consultation helped to improve the effectiveness of a service by making it match users’<br />

needs more closely?<br />

4. Did it lead to a change of policy or service?<br />

5. Has the consultation improved the relationship with the stakeholders?<br />

Process review<br />

Assessment<br />

Yes No NA<br />

1. 7.2. Was there Step sufficient 9: Assess awareness effectiveness generated about the consultation of the public exercise for consultation the targeted exercise<br />

stakeholders?<br />

2. Did all parties (e.g., staff, participants and partners) understand the objectives?<br />

3. Was the timeframe and process adhered to?<br />

4. Were the level of resources and support right?<br />

5. Were the right stakeholders involved?<br />

6. Was the consultation accessible (e.g., were materials available in other languages and formats,<br />

where necessary? Were interpreters provided or necessary? Were venues accessible?)<br />

The effectiveness of the public consultation exercise should be evaluated to:<br />

7.<br />

•<br />

Were<br />

Assess<br />

the<br />

whether<br />

methods used<br />

involving<br />

appropriate<br />

the stakeholders<br />

for the objectives?<br />

contributed to improved services, actions or<br />

8. Were decision the numbers making; that took part expected – was the initial target reached?<br />

9. • Did Find officers out what get the worked, information what needed did not in sufficient and why; time, depth and quality?<br />

10. • Were Increase results learning made known and to improve participants, future the wider practice; public and and relevant partner organisations?<br />

• Identify areas of improvement for future exercises.<br />

Participant satisfaction<br />

1. Did participants understand why they were asked to be involved in this consultation?<br />

There are three suggestions for assessing effectiveness:<br />

2. Did participants know their scope of influence (i.e., what this consultation could and could not<br />

influence)?<br />

1. Decision analysis, which assesses whether the strategic objectives of the consultation<br />

3. Was exercise the information were met; easy to understand, and did it provide them with sufficient background to<br />

provide meaningful feedback?<br />

4. 2. Was Process it easy review, for participants which to assesses give their views? the effectiveness of the consultation process, e.g., whether<br />

5. Were the timeline participants was given adhered the opportunity to, response to say everything rate was met; they wanted and to say?<br />

6. Were the practical arrangements for this consultation (e.g., meeting venues, refreshments,<br />

3. interpreters, Participant facilitators) satisfaction, satisfactory which to the evaluates participants? the general sentiment/satisfaction of participants<br />

7. Did who participants took part feel in that the their consultation contribution process. was listened to and respected?<br />

8. Are participants satisfied with the reported findings of the consultation exercise?<br />

The checklist on the following page (see Table 7 2) can be used to assist officers in assessing the<br />

9. Are participants aware of the outcome and key considerations behind the agency’s decision or<br />

course effectiveness of action? of consultation exercises.<br />

10. Do participants think the consultation made a difference to the decision?<br />

11. Did it generate a considerable volume of feedback?<br />

Assessment: Number of “Yes”<br />

Decision audit analysis = /5<br />

Process review = /10<br />

Participant satisfaction = /11<br />

Total = /26<br />

8. Conclusion<br />

This <strong>Toolkit</strong> serves to provide public officers with an overview of the process and tools for public<br />

consultation exercises. Given the diversity of stakeholders and issues/policies faced by different<br />

agencies at differing levels, the <strong>Toolkit</strong> is not meant to be prescriptive. Rather, agencies are<br />

encouraged to customise or modify the content to suit their own context and requirements.<br />

The <strong>Toolkit</strong> is an evolving document. New challenges may be encountered or new avenues/<br />

ideas generated. Agencies are encouraged to document their experiences in each consultation<br />

exercise for future reference and further improvements to the public consultation process.<br />

Table 7-2: Checklist for assessment of effectiveness


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 55 56 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Acknowledgements<br />

Index of case examples<br />

This document has resulted from the enthusiasm and knowledge of many public officers within<br />

the Singapore public sector. We would like to take this opportunity to specially thank all who<br />

have dedicated time and effort to participate in CSC’s focus groups and interviews. We would<br />

also like to thank the agencies who contributed case studies and other valuable suggestions<br />

which helped to enhance the content of this <strong>Toolkit</strong>.<br />

Participants of focus groups and interviews:<br />

Ministries<br />

• Ministry of Community Development, Youth and Sports (MCYS)<br />

• Ministry of Education (MOE)<br />

• Ministry of Finance (MOF)<br />

• Ministry of Foreign Affairs (MFA)<br />

• Ministry of Health (MOH)<br />

• Ministry of Home Affairs (MHA)<br />

• Ministry of Information, Communications and the Arts (MICA)<br />

• Ministry of Law (MinLaw)<br />

• Ministry of Manpower (MOM)<br />

• Ministry of Trade and Industry (MTI)<br />

• Ministry of Transport (MOT)<br />

• Prime Minister’s Office, <strong>Public</strong> <strong>Service</strong> Division (PMO-PSD)<br />

Statutory Boards<br />

• Accounting and Corporate Regulatory Authority (ACRA)<br />

• Central Provident Fund Board (CPFB)<br />

• Energy Market Authority (EMA)<br />

• Housing and Development Board (HDB)<br />

• Infocomm Development Authority of Singapore (IDA)<br />

• Internal Revenue Authority of Singapore (IRAS)<br />

• Land Transport Authority (LTA)<br />

• Monetary Authority of Singapore (MAS)<br />

• Media Development Authority (MDA)<br />

• National Arts Council (NAC)<br />

• National Environment Agency (NEA)<br />

• National Parks Board (NParks)<br />

• National Population Secretariat (NPS)<br />

• National Water Agency (PUB)<br />

• People’s Association (PA)<br />

• Singapore Customs<br />

• Spring Singapore (SPRING)<br />

• Urban Redevelopment Authority (URA)<br />

Non-Government Organisations<br />

• Council for Third Age (C3A)<br />

• Singapore Business Federation (SBF)<br />

• Singapore Council of Women’s Organisation (SCWO)<br />

• Singapore Children’s Society<br />

• Singapore Medical Association (SMA)<br />

• Tsao Foundation, Singapore<br />

Agency, country Case example Learning point Page<br />

1 Ministry of Education (MOE),<br />

Singapore<br />

2 Land Transport Authority<br />

(LTA), Singapore<br />

3 Murray-Darling Basin<br />

Commission, Australia<br />

4 Ministry of Manpower<br />

(MOM), Singapore<br />

5 Commission on the Future<br />

of Health Care, Canada<br />

6 National Parks Board<br />

(NParks), Singapore<br />

7 Ministry of Health (MOH),<br />

Singapore<br />

8 Monetary Authority of<br />

Singapore (MAS), Singapore<br />

9 Infocomm Development<br />

Authority (IDA), Singapore<br />

Regulatory regime for<br />

the private education<br />

sector<br />

‘Friends of LTA’<br />

The Living Murray River<br />

Restoration<br />

Tripartite efforts to<br />

overcome the downturn<br />

Improving public<br />

healthcare<br />

Sungei Buloh Wetland<br />

Reserve<br />

Proposed amendments<br />

to Human Organ<br />

Transplant (HOTA) Act<br />

Regulation of investment<br />

products<br />

Contract period and<br />

early termination<br />

charges for<br />

telecommunication<br />

services offered to<br />

consumers<br />

10 Canada Maintaining antieuthanasia<br />

regulation<br />

11 Urban Redevelopment<br />

Authority (URA), Singapore<br />

12 Ministry of Home Affairs<br />

(MHA), Singapore<br />

13 Accounting and Corporate<br />

Regulatory Authority (ACRA),<br />

Singapore<br />

14 Department of Internal<br />

Affairs, New Zealand<br />

An illustration of public<br />

consultation<br />

An illustration of public<br />

engagement<br />

Ensuring representativeness in<br />

stakeholder populations<br />

Forming partnerships with<br />

stakeholders<br />

Using appropriate tools to target<br />

stakeholders to be consulted<br />

Consulting on issue with high<br />

public interest<br />

2<br />

3<br />

14<br />

16<br />

19<br />

22<br />

Consulting on emotive issue 24<br />

Consulting on specific issue<br />

which focuses on targeted<br />

groups of participants<br />

27<br />

Consultating on technical issues 29<br />

Implementing policy against<br />

public opinion<br />

URA Master Plan 2008 URA Master Plan 2008 42<br />

Penal Code (Amendment<br />

Bill)<br />

Registration framework<br />

for public accountants<br />

Identity Verification<br />

System (IVS)<br />

32<br />

Launch of consultation exercise 45<br />

Closing the loop: Publishing the<br />

consultation report<br />

Closing the loop: Publishing the<br />

consultation report<br />

49<br />

51


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 57 58 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

References<br />

Guidelines<br />

• Corporate <strong>Consultation</strong> Secretariat 2000, Health Canada Policy <strong>Toolkit</strong> for <strong>Public</strong> Involvement<br />

in Decision Making, Canada, viewed 1 February, 2010,<br />

.<br />

• Gramberger, M., 2001. Citizens as Partners: OECD Handbook on Information, <strong>Consultation</strong> and<br />

<strong>Public</strong> Participation in Policy-making, Paris: OECD <strong>Public</strong>ations, France, viewed 29 January,<br />

2010, .<br />

• International Association for <strong>Public</strong> Participation (IAP2), 2010, IAP2 Core Values, viewed 25<br />

January, 2010, < http://www.iap2.org/displaycommon.cfm?an=4>.<br />

• International Association for <strong>Public</strong> Particiation (IAP2), 2010, IAP2 Spectrum of <strong>Public</strong><br />

Participation, viewed 22 January, 2010, .<br />

• International Association for <strong>Public</strong> Participation (IAP2), 2010, IAP2’s <strong>Public</strong> Participantion<br />

Toolbox, viewed 22 January, 2010, .<br />

• Nottinghamshire County Council, 2010, Assessment for effectiveness,United Kingdom,<br />

viewed 4 February, 2010 ,.<br />

• Organisation for Economic Co-operation and Development (OECD) <strong>Public</strong> Management<br />

Policy Brief, 2001, Engaging Citizens in Policy-making: Information, <strong>Consultation</strong> and <strong>Public</strong><br />

Participation, Viewed 25 January, 2010, .<br />

• Organisation for Economic Co-operation and Development (OECD), Reference Checklist<br />

for Regulatory Decision-Making,viewed 25 January, 2010, .<br />

• Organisation for Economic Co-operation and Development (OECD), OECD Background<br />

Document on <strong>Public</strong> <strong>Consultation</strong>, viewed 22 January, 2010, .<br />

• REACH Singapore, 2010, viewed 1 February, 2010, .<br />

• South Lanarkshire Council, 2010, South Lanarkshire Council’s Wheel of Participation, viewed<br />

29 January, 2010, <br />

• United Nations, 2008, World <strong>Public</strong> Sector Report 2008, People Matter – Civic Engagement<br />

in <strong>Public</strong> Governance, New York: United Nations <strong>Public</strong>ations, viewed 20 November, 2009,<br />

.<br />

Case examples<br />

Australia<br />

• Australian Human Rights Commission, 2010, Case study 2 - The Murray-Darling Basin – An<br />

ecological and human tragedy, Australia, viewed 26 January, 2010, .<br />

• Crase, L., Dollery, B. & Wallis, J., 2005, Community consultation in public policy: The case of the<br />

Murray-Darling Basin of Australia, Australian Journal of Political Science, 40, 221 – 237, viewed<br />

26 January, 2010, .<br />

• Macdonald, D. H., & Young, M., 2001, A case study of the Murray-Darling Basin, CSIRO Land and<br />

Water, viewed 26 January, 2010, .<br />

Canada<br />

• Dawn Ontario: DisAbled Women’s Network Ontario, 1998-2007, Responses to the final report<br />

by the Romanow Commission on the Future of Health Care in Canada, viewed 1 June, 2010,<br />

.<br />

• International Task Force, 2009. Euthanasia and Assisted Suicide in Canada, viewed 8 March,<br />

2010. .<br />

• Mapleleafweb.com: Canada’s Premier Political Education Website, Romanow Commission<br />

on the Future of Health Care: Findings and Recommendations, viewed 1 June, 2010, .<br />

• The Montreal Gazette, 16 Feb 2010, Doctors back ‘right to die’, viewed 8 March, 2010, .<br />

• Toronto Sun, 21 Apr 2010, MPs band together to study palliative care, viewed 11 May, 2010,<br />

<br />

• Vision Critical, 2010, Angus Reid <strong>Public</strong> Opinion, Two-thirds of Canadians Express Support<br />

for Legalizing Euthanasia, viewed 8 March, 2010, .


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 59 60 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

New Zealand<br />

• The Department of Internal Affairs New Zealand, 2008. <strong>Public</strong> consultation about the igovt<br />

service – What people said, viewed 26 January, 2010, .<br />

Singapore<br />

• Case compilations drafted by <strong>Civil</strong> <strong>Service</strong> <strong>College</strong>, Singapore.<br />

• Gwee, J.2004, <strong>Public</strong> <strong>Consultation</strong>: Re-inventing Dialogue, Singapore: Centre of Governance<br />

and Leadership, <strong>Civil</strong> <strong>Service</strong> <strong>College</strong><br />

• Land Transport Authority, 2009. Friends of LTA case study, viewed 1 February, 2010,<br />

.<br />

<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Appendices


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 61 62 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Appendices Content<br />

Appendix A : <strong>Consultation</strong> tools<br />

<br />

1. Community meetings <br />

2. Exhibitions/road shows 5<br />

3. <strong>Public</strong> forums 7<br />

4. Surveys 6 8<br />

5. Blogs 70<br />

6. Social media 72<br />

7. Websites 74<br />

8. Focus group discussions 76<br />

9. Workshops 78<br />

10. Charrettes 80<br />

11. Citizen juries 81<br />

12. Delphi process 82<br />

13. Expert panels 83<br />

14. Interviews 84<br />

15. Working groups 85<br />

Appendix B : Planning Aid for <strong>Public</strong> <strong>Consultation</strong> 86


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 63 64 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Appendix A:<br />

<strong>Consultation</strong> tools<br />

1. Community meetings<br />

Community meetings are dialogue sessions organised with<br />

stakeholders from localised or targeted communities.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

Tools<br />

Feel the<br />

pulse<br />

Test/<br />

refine<br />

Obtain<br />

buy-in<br />

Page<br />

reference<br />

1. Community meetings 3 3 3 64<br />

2. Exhibitions/road shows 3 3 65<br />

3. <strong>Public</strong> forums 3 3 3 67<br />

4. Surveys 3 3 68<br />

5. Blogs 3 3 3 70<br />

6. Social media 3 3 3 72<br />

7. Websites 3 74<br />

8. Focus group discussion 3 3 76<br />

9. Workshops 3 78<br />

10. Charrettes 3 3 80<br />

Target audience<br />

General public/large<br />

stakeholder population<br />

General public<br />

(IT-savvy population)<br />

The target audience of such meetings include individuals in<br />

specific housing districts or local community organisations.<br />

Before conducting community meetings, agencies<br />

should determine:<br />

• Date and Time – consider who the target audience is and<br />

the other obligations they may have. Bear in mind other<br />

events that could clash with the meeting.<br />

• Venue – choose a venue that is familiar to your target<br />

audience and the special needs they may have e.g., elderly<br />

or disabled individuals.<br />

• Speakers – ensure that the speaker(s) or facilitator(s)<br />

are thoroughly briefed about the purpose and details of<br />

the community meeting. Provide them with background<br />

materials and a list of frequently asked questions to help<br />

address queries from the community.<br />

When is it most useful?<br />

Community meetings are useful for:<br />

• Consulting with targeted group of stakeholders most<br />

affected by policies. For example, changes which affect<br />

their neighbourhood or living environment.<br />

• Leverage on partners<br />

(e.g. People’s Association,<br />

grassroot leaders, NGOs)<br />

who can help to identify<br />

participants, publicise<br />

the event and facilitate<br />

discussion.<br />

• Prepare information on<br />

related topics to address<br />

any questions participants<br />

may ask, even if the topics<br />

are under the purview of<br />

other agencies.<br />

• Consider conducting the<br />

sessions in more than<br />

one language to allow<br />

greater representation in<br />

stakeholder groups.<br />

11. Citizen juries 3 3 81<br />

12. Delphi process 3 3 82<br />

Targeted to subject<br />

matter experts,<br />

stakeholder population<br />

• Gathering feedback from the general public to reach<br />

individuals from all walks of life.<br />

Considerations<br />

13. Expert panels 3 3 3 83<br />

14. Interviews 3 3 84<br />

15. Working groups 3 85<br />

Participants may be varied in their understanding or<br />

background knowledge of the topic. It is therefore important<br />

for the meeting to provide sufficient background information<br />

on the policy or initiative being consulted so that the<br />

feedback is meaningful.<br />

Its is equally important to appoint an effective facilitator to<br />

moderate the meetings and keep it from going off track.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 65 66 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

2. Exhibitions/road shows<br />

Exhibitions or roadshows allow agencies to utilise numerous<br />

formats to engage and share information with the public<br />

and obtain public feedback. During these events, agencies<br />

can provide a visual representation of the issues at hand<br />

(e.g. housing projects, nature parks). It also provides an<br />

opportunity for greater interaction between staff and the<br />

public.<br />

Agencies should determine the types of media available at<br />

the event, and prepare the necessary items such as flyers,<br />

information guide and presentations.<br />

The target audience for such exhibits/road shows are the<br />

general public.<br />

Before conducting exhibitions/road shows, agencies<br />

should determine:<br />

• Location – ensure that the location chosen for the event<br />

is easily accessible to the target audience. It should be<br />

conveniently located, welcoming and comfortable.<br />

• Atmosphere – an exhibition/road show provides agencies<br />

the opportunity to be creative in the way information is<br />

presented. Ensure that the variety of media planned for<br />

display is interesting without being overwhelming.<br />

• Content – information should be tailored to the target<br />

audience. If a sensitive topic is being addressed, ensure<br />

that personnel are well-equipped to handle potentially<br />

difficult members of the public.<br />

• Staff – ensure that officers selected for the event are well<br />

equipped with the knowledge and information to explain<br />

concepts and answer questions or gain feedback from the<br />

public. Officers should be trained to be polite, courteous<br />

and helpful. It would also be beneficial to have multilingual<br />

officers available to attend to members of the<br />

public who are non-English speakers.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Ensure that the variety of<br />

media planned for display<br />

is interesting without<br />

being overwhelming.<br />

• If feedback is obtained<br />

from comment cards or<br />

short questionnaires,<br />

ensure that they are<br />

prominently displayed.<br />

Always supply writing<br />

materials.<br />

• Consider documenting the<br />

verbal feedback received<br />

at roadshows.<br />

When is it most useful?<br />

Exhibitions/road shows are most useful when a substantial amount of visual representations<br />

are required to adequately explain the subject (e.g. architectural concepts). They allow for the<br />

use of interactive technology, and provide a comfortable avenue for confrontational issues to<br />

be discussed. Exhibitions/road shows are also beneficial in reaching an audience that may not<br />

otherwise be involved in consultation. They allow members of the public who may not speak<br />

English to engage with the issues through staff who are trained in another language or dialect.<br />

Considerations<br />

Exhibitions/road shows can be very staff intensive, and a large amount of preparation is required<br />

to ensure that the event is smooth-running.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 67 68 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

3. <strong>Public</strong> forums<br />

4. Surveys<br />

<strong>Public</strong> forums/dialogues are large-scale gatherings which can<br />

be used to obtain general feedback.<br />

The target audience of public forums include general public or<br />

large stakeholder groups who are impacted or interested in a<br />

particular issue.<br />

Before conducting public forums, agencies should<br />

determine:<br />

• Date and time – consider who the target audience is<br />

and the other obligations they may have, to determine<br />

the most convenient date/time to hold the forum. Bear in<br />

mind other events that could clash with the meeting.<br />

• Venue – choose a venue that is familiar to your target<br />

audience and the special needs they may have (e.g. elderly<br />

or disabled individuals).<br />

• Speaker(s) – choose a speaker or panel of speakers<br />

with sufficient seniority and experience to engage<br />

the audience effectively. Ensure that the speakers are<br />

thoroughly briefed about the purpose and details of the<br />

forum.<br />

When is it most useful?<br />

<strong>Public</strong> forums are useful for policy issues that affect a large<br />

proportion of the public. The forums can be used to educate<br />

stakeholders about the policy and obtain general feedback.<br />

<strong>Public</strong> forums are typically less useful for gathering in-depth<br />

feedback from specific stakeholders.<br />

Considerations<br />

<strong>Public</strong> forums carry the risk that the agenda may be<br />

dominated by interest groups or vocal individuals. This is<br />

particularly the case if the policy or initiative being consulted<br />

is sensitive or emotive.<br />

Its is equally important to appoint an effective facilitator to<br />

moderate the meetings and keep it from going off track.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• <strong>Public</strong>ise the meetings<br />

through engaging the<br />

media (e.g., broadcast or<br />

print), and if appropriate,<br />

make the material<br />

available online.<br />

A survey or questionnaire is essentially a series of questions<br />

used to solicit information from individuals. The questions<br />

can be open-ended (i.e., where participants can provide<br />

qualitative feedback), closed (i.e., where questions have<br />

pre-defined answers that respondents can select from), or a<br />

combination of both.<br />

It can be conducted through various modes, including inperson,<br />

telephone postal and internet. The resources required<br />

to conduct the surveys will depend on the modes of survey<br />

selected.<br />

The target audience of surveys are typically randomly selected<br />

individuals who represent the larger target population for a<br />

policy/initiative.<br />

Before using surveys, agencies must determine:<br />

• Content – agencies must have clear objectives and<br />

understand why they are surveying the general public.<br />

The survey should ideally contain no more than 10 to 15<br />

questions. Questions should be direct, brief and simple.<br />

Long, multipart questions should be avoided.<br />

• Type – all surveys should be tested with a pilot audience<br />

prior to mass use in order to procure feedback about how<br />

the survey can be improved. Agencies need to decide the<br />

amount of time and resources they have available before<br />

choosing a survey method.<br />

Different modes of survey<br />

a) In-person survey: This can be conducted through door-todoor<br />

interviews, or street-intercept interviews.<br />

• When is it useful?<br />

Surveys conducted in person are useful for obtaining<br />

immediate feedback and information from respondents.<br />

Questions can be asked and clarified as they arise. This<br />

mode of survey typically has a higher rate of response.<br />

• Considerations<br />

This method requires an on-site officer at all times and<br />

can be labour-intensive. Officers need to be aware of the<br />

issues of privacy and space for participants. The presence<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Be as specific as possible.<br />

Instead of subjective<br />

questions like ‘do you use<br />

this facility often’, change<br />

this to specify conditions,<br />

such as ‘never, once a week,<br />

more than three times a<br />

week’.<br />

• Break a topic down into<br />

distinct elements with a<br />

question on each.<br />

• Ask relevant questions –<br />

do not waste respondents’<br />

time by asking questions<br />

unrelated to the topic.<br />

• Keep the survey brief, it<br />

should ideally take 5-10<br />

minutes to complete.<br />

• Provide incentives (e.g.<br />

cash vouchers, discount<br />

coupons) to increase the<br />

response rate.<br />

• Try not to appear<br />

judgmental or impose<br />

personal views when<br />

conducting surveys,<br />

so as not to influence<br />

participants.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 69 70 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

of the surveyor and the public setting may compel the participants to respond in a certain<br />

manner and bias the survey results.<br />

b) Telephone survey<br />

• When is it useful?<br />

Telephone surveys are useful for general attitudinal surveys. Agencies can explore options<br />

with participants and assist them with unfamiliar words or questions. This method yields fast<br />

results, and has a higher response rate than mailed-in surveys.<br />

• Considerations<br />

Although to a lesser extent than in-person survey, the tele-surveyor may still compel the<br />

participants to respond in a certain manner and bias the survey results. For this method to<br />

work successfully, officers must be trained to handle questions and different personalities<br />

over the phone sensitively and objectively. Depending on the profile of the target audience,<br />

surveyors may need to be proficient in different languages.<br />

c) Mailed survey: Surveys can be mailed to the home or organisation addresses of the target<br />

audience.<br />

• When is it useful?<br />

Mailed surveys can reach a large geographical location and are less labour-intensive than<br />

in-person or telephone surveys conducted. Participants can complete the surveys at their<br />

convenience and in private; hence it is suitable for sensitive issues.<br />

• Considerations<br />

It is harder for participants to seek clarification for mailed surveys. This method is limited<br />

to literate members of the public and requires an up-to-date address list. There also tends<br />

to be a lower response rate for mailed survey because it requires participants to take the<br />

additional step of returning the surveys to the agencies.<br />

d) Internet survey: E-mail and online surveys (distributed through a website link) are the key<br />

forms of internet surveys. Links explaining different terms or concepts can also be provided<br />

online to provide more comprehensive information. Data is automatically entered into a<br />

database and can be automatically analysed or exported to other software programmes.<br />

When is it most useful?<br />

<strong>Public</strong> forums are useful for policy issues that affect a large proportion of the public. The forums<br />

can be used to educate stakeholders about the policy and obtain general feedback. <strong>Public</strong><br />

forums are typically less useful for gathering in-depth feedback from specific stakeholders.<br />

Considerations<br />

<strong>Public</strong> forums carry the risk that the agenda may be dominated by interest groups or vocal<br />

individuals. This is particularly the case if the policy or initiative being consulted is sensitive or<br />

emotive.<br />

5. Blogs<br />

A blog (a contraction of the term ‘web log’) is a website<br />

that usually contains informal commentaries or personal<br />

opinions about a subject. Feedback functions in the blogs<br />

allow the public to provide comments and responses to<br />

the information posted. Agencies also have the option of<br />

embedding their blog on the agency’s website. The blog page<br />

can then be easily updated either through the website or<br />

through applications on mobile devices.<br />

Through this medium, agencies or public figures such as<br />

Ministers can ask the opinions of blog readers on a specific<br />

subject or test the reaction of blog readers towards a certain<br />

topic. This can allow the government to conduct informal<br />

or “soft” consultation with the public. In addition, the<br />

contributor(s) can also provide an insider’s perspective on<br />

various policies (e.g. tax) and events (e.g. National Day). Such<br />

posts allow the public to relate to the government on a more<br />

personal and informal level.<br />

The main distinction between the government’s website<br />

and blog posts is that the website provides comprehensive<br />

information, while blog posts provide snippets of information<br />

– summaries, opinions, circumstances and reasons<br />

surrounding various policies and principles. Typically, blogs<br />

present the contributors’ personal perspectives.<br />

The target audience of blogs are technologically-savvy<br />

individuals.<br />

How it works<br />

A typical blog combines text, images, video and links to other<br />

blogs or websites. An account is first created at a blog website<br />

(e.g. blogspot.com). The blog page can be personalised, or<br />

selected from a template, and finally, the contributor can<br />

begin sharing content online.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Keep blog posts<br />

interesting – readers are<br />

keen to explore issues on a<br />

personal level.<br />

• Short posts are fine if timeconstraints<br />

are present.<br />

The key is to be consistent<br />

between time spans of<br />

blog posts.<br />

• ‘Tag’ entries according to<br />

different categories, so that<br />

readers may be able to<br />

search for similar topics on<br />

the blog.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 71 72 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

Before using blogs, agencies should determine:<br />

• Content – the level of information that they wish to disseminate. Agencies should always<br />

keep in mind that they would be contributing to a ‘public blog’ and as such, should be<br />

sensitive to the readers they may have.<br />

• Privacy and safety – never distribute private information that the public does not need to<br />

know about, e.g. personal schedules, numbers or addresses.<br />

When is it most useful?<br />

Blogs are useful for sounding out ideas and testing the reaction of readers towards a certain<br />

topic, to conduct informal or ‘soft’ consultation with the public. It also provides agencies with an<br />

informal setting to connect with the public and creates an opportunity to ‘humanise’ abstract<br />

issues.<br />

Considerations<br />

Contributors should consider the implications of their words to the general public, and should<br />

always bear in mind that their posts are available on the public domain.<br />

Agencies should also note that the blog discussion takes place on a public domain. Agencies<br />

therefore need to be prepared for negative comments and responses in a public domain which<br />

may potentially influence the views of other readers.<br />

6. Social media<br />

Social media (e.g. Facebook, twitter, LinkedIn) is a new form of<br />

technologically-enabled consultation tool, where government<br />

policy information can be instantaneously disseminated to a<br />

multitude of people. It has the additional benefit of being a<br />

‘two-way’ channel of communication where participants can<br />

comment or reply almost immediately.<br />

Social media are useful for agencies to informally consult and<br />

engage with the population. Similar to blogs, public officers<br />

or government agencies can post comments/ideas/issues on<br />

the websites and the general public can respond to them.<br />

The target audience for such social media are younger, more<br />

technologically-savvy individuals. In the advent of mobile<br />

broadband technology, these participants are able to access<br />

information in transit and are no longer confined to a<br />

particular geographical location, time of day, or availability of<br />

information outlets (e.g. news stands, television or radio).<br />

How it works<br />

Social platforms often merge features such as email, instant<br />

messaging, image and video sharing, applications and ‘status<br />

updates’. It allows for the creation of ‘groups’ that participants<br />

can join where they receive relevant information pertaining<br />

to that particular ‘group’. Users are often allowed to log in to<br />

one interface with numerous features, rather than needing to<br />

filter through a myriad of social interaction applications (e.g.<br />

instant messaging programmes, YouTube).<br />

An account is first set up by the agency before the various<br />

tabs/applications can be populated accordingly. The typical<br />

sections available are as follows:<br />

• Summary page (e.g. ‘wall function in Facebook’) – the<br />

summary page displays status updates, and links or videos<br />

with summaries to relevant sites from the agency. It<br />

provides an informal avenue for government agencies to<br />

keep the public informed about current events.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Responding to comments<br />

within a short period of<br />

time gives participants a<br />

sense that the government<br />

is managing the channel<br />

and is actively taking an<br />

interest in their feedback.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 73 74 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

• Profile – this describes the agency and what its purpose and objectives are (it is essentially<br />

the agency’s biography). This tab can also be linked to the agency’s main website, Twitter<br />

account and other relevant sites associated with the agency.<br />

• Events – this updates participating fans and followers regarding events that the agency may<br />

be organising (e.g. meet and greets, gathering for focus groups or discussions). Participants<br />

may accept or decline invites to such events, or simply pass the message along to ‘friends’ on<br />

their accounts.<br />

• Pictures and videos – this gives the agency an opportunity to humanise the government.<br />

Photos and videos of events and people provide the public with a more casual and<br />

approachable means of accessing the agency, and the processes culminating in the<br />

construction of respective policies.<br />

• Discussion – this function gives participants the opportunity to set up their own ‘forums’. It<br />

should be carefully moderated by the agencies to ensure appropriate content is posted.<br />

When is it most useful?<br />

The design and informal nature of social media encourages the public to be more open and<br />

honest in their feedback. The advantage of this is that the government can gauge the actual<br />

ground sentiments on a particular issue.<br />

Considerations<br />

The drawback of new media is that some users might publish insensitive, untrue or<br />

discriminatory remarks on the forum. This may tarnish the reputation of the agency and even<br />

the country. Hence, usage of new media needs to be properly planned and actively managed to<br />

mitigate the risk factors.<br />

New media respondents tend to be of a certain demographic profile and agencies should be<br />

mindful of that and balance with feedback from other sources, if necessary, for a consultation<br />

exercise.<br />

7. Websites<br />

A government website is an information platform hosted on<br />

the internet that can contain details on government policies,<br />

key issues, press releases, and events.<br />

Agencies can conduct public consultation through websites<br />

by publishing an electronic consultation paper/document<br />

on the website. The general public can view the document<br />

and provide feedback to the agencies either via a feedback<br />

channel on the website itself, or through emails.<br />

Another website platform for agencies to conduct public<br />

consultation is REACH (reaching everyone for active<br />

citizenry@ home – http://www.reach.gov.sg/). REACH was<br />

launched in October 2006 when the Feedback Unit was<br />

restructured to move beyond gathering public feedback,<br />

to become the lead agency for engaging and connecting<br />

with citizens. REACH was created to encourage and promote<br />

an active citizenry through citizen participation and<br />

involvement.<br />

Agencies can leverage on the REACH website to host<br />

electronic consultation document, conduct an opinion poll<br />

on a specific issue and as a source of general feedback from<br />

the public through the various forums available on the REACH<br />

website.<br />

The target audience of websites is the general public that are<br />

literate and have access to the Internet.<br />

Before using websites for public consultation,<br />

agencies should consider:<br />

• Content – <strong>Consultation</strong> papers posted on websites should<br />

be accessible, concise and easy-to-understand for a<br />

layperson without background technical information.<br />

• Layout – having a layout that is clean, simple, and easyto-navigate<br />

is critical. Users should be able to find the<br />

material they are looking for with ease.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Websites can be<br />

complemented by social<br />

media such as Facebook<br />

and Twitter to inform<br />

the public of changes on<br />

the site, such as content<br />

updates.<br />

• Consider offering the<br />

website in more than one<br />

language to extend its<br />

outreach.<br />

• Ensure that there is<br />

sufficient bandwidth to<br />

support the volume of<br />

visitor ‘traffic’.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 75 76 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

• Awareness – websites are passive channels. Therefore, to solicit feedback on consultation,<br />

sufficient awareness should be generated about the consultation exercise. Allow users the<br />

option to subscribe to ‘email’ updates or RSS feeds as and when there is new information on<br />

the website.<br />

When is it most useful?<br />

Websites are useful for conducting consultation with members of the public who are literate,<br />

IT savvy, and have a good command of the English language. It allows detailed information to<br />

be made available to the public in the form of a consultation document. It can also be used for<br />

surveys to obtain quick polls, as well as allow active discussion of a topic (e.g. forum).<br />

Considerations<br />

Websites may not be able to reach out to members of the public who are illiterate, do not have<br />

access to computers, are not IT-savvy and do not have good command of the English language.<br />

Information posted on websites also tend to be less interactive (with the exception of blogs and<br />

forums). It is therefore recommended that when websites are used in public consultation, they<br />

should be used in conjunction with other tools which allow greater interactivity and are able to<br />

reach a more diverse audience.<br />

8. Focus group discussions<br />

A focus group discussion (FGD) is a platform where a<br />

facilitator discusses and gathers feedback from a group<br />

of individuals. Groups typically consist of six to 10 people<br />

specifically selected to meet specific criteria in order<br />

to broadly represent a particular segment of society,<br />

or communities of interest (e.g., age group, affiliated<br />

associations, ethnicity and educational level). FGDs typically<br />

last for one to two hours.<br />

The target audience for FGDs is generally the direct<br />

stakeholders and individuals with specific knowledge,<br />

experience and/or interest in the policy/initiative that the<br />

agency is consulting on.<br />

Before conducting FGDs, agencies should determine:<br />

• Purpose – agencies must be clear about the purpose<br />

of the discussions so as not to be distracted during the<br />

allotted time. They should determine a set of questions<br />

that will be asked, and be prepared to steer the discussion<br />

back on track if participants go off course.<br />

• Facilitator – given the time constraints of FGDs, the<br />

facilitator chosen should be skilled and tactful in<br />

encouraging participants to provide useful feedback<br />

without frequently going off-topic. The discussion should<br />

be guided in a structured manner.<br />

• Recruitment – FGD participants can be selected through<br />

random sampling. Agencies can also work with relevant<br />

partners (e.g. associations, grassroot leaders, NGOs)<br />

to identify participants from the targeted stakeholder<br />

groups.<br />

• Venue – discussions should be held in a quiet room,<br />

free from noise or interruptions. It should also be easily<br />

accessible to FGD participants.<br />

• Resources – ensure sufficient writing materials are<br />

available during discussions so that participants can<br />

actively make notes or provide visual representation for<br />

their ideas.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Ensure that to the<br />

participants are clear<br />

about the purpose of<br />

the FGD, and how their<br />

feedback will be handled.<br />

• Acknowledge<br />

contributions made by<br />

participants so they will be<br />

encouraged to continue<br />

providing feedback.<br />

• Agencies can consider<br />

conducting focus groups<br />

for non-English speakers<br />

to ensure stakeholder<br />

populations are well<br />

represented.<br />

• Grouping similar types of<br />

participants together help<br />

to reduce inhibition and<br />

promote discussion.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 77 78 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

• Recording – the FGDs should be recorded (taped, transcribed or documented) to ensure<br />

accuracy. These notes can be used for analysis at a later date. Always inform participants if<br />

they are being recorded during the session.<br />

When is it most useful?<br />

• FGDs are most useful when issues need to be explored in-depth, and when there is a need<br />

to understand reasons for attitudes, behaviours or generating new ideas. Agencies are able<br />

to obtain a snapshot of public opinion when time constraints do not allow a full review or<br />

survey.<br />

• FGDs can also be used in conjunction with surveys to identify issues that need to be<br />

quantified, as well as after a survey is conducted to investigate results in greater depth.<br />

Considerations<br />

FGDs may be too small or biased to provide reliable results. Additionally, this method may<br />

involve payment to participants – an appropriate method of payment and amount should be<br />

decided beforehand, and participants should be informed of this.<br />

9. Workshops<br />

A workshop is an informal meeting that includes plenary and<br />

breakout discussion sessions between participants.<br />

A workshop is facilitated by an officer skilled in groupwork,<br />

who can encourage quieter members of the group<br />

to speak up while creating a constructive, problem-solving<br />

atmosphere.<br />

The discussion is focused, but not overly formal, the aim of<br />

which is for everyone to participate comfortably. Workshops<br />

allow individuals to network and exchange ideas and to<br />

develop an action plan recommendations or proposals.<br />

The target audience for this tool is selected individuals with<br />

knowledge and/or experience in the relevant area.<br />

Before conducting workshops, agencies should<br />

determine:<br />

• Topic – agencies need to ensure that the topic is<br />

sufficiently precise and meaningful to participants.<br />

Background information may be sent out to participants<br />

prior to the workshop so that participants are prepared.<br />

• Group sizes – group sizes should be large enough to<br />

encourage lively deliberation, but not so large that most<br />

participants are unable to be involved effectively. The ideal<br />

size would be 15 to 20 participants.<br />

• Venue – ensure the room chosen is of an appropriate size<br />

that will comfortably accommodate the workshop. Ensure<br />

participants with disabilities or special needs have full<br />

access.<br />

• Facilitator – an experienced facilitator will enhance<br />

the quality of the workshop by creating a conducive<br />

environment that encourages discussion, while remaining<br />

neutral. Facilitators must work to keep participants<br />

realistic in the solutions they suggest.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Give busy participants<br />

ample notice to allow<br />

them to fit the workshops<br />

into their schedule.<br />

• Ensure that logistical<br />

considerations such as<br />

room availability and food<br />

services are planned well<br />

in advance.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 79 80 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

• Activities – ensure that the session enables participants to:<br />

- Understand the policy or initiative at hand (e.g. through presentations, background<br />

reading),<br />

- Brainstorm, discuss and develop strategies or options (e.g. breakout groups, debates,<br />

voting),<br />

- Present the key resolutions of their discussion; and<br />

- At the end of the workshop, gather all participants for closing remarks informing them of<br />

how the proceedings of the workshop will be shared.<br />

When is it most useful?<br />

Workshops are most useful when bringing representatives from diverse groups who have a<br />

common interest in an issue, but bring different perspectives as to how the issue should be<br />

addressed. This process works best when it is limited to participants who are actively involved,<br />

interested and directly impacted by the issue, who will be motivated to find practical, feasible<br />

solutions to the proposed issue.<br />

Considerations<br />

Proper facilitation and grouping of participants are key to the success of workshops. Otherwise,<br />

a small number of participants may dominate the discussion. The selection of the participants is<br />

also important. In a small, self-selected group, viewpoints from other unrepresented members of<br />

the stakeholder groups will be absent.<br />

10. Charrettes<br />

A charrette typically involves intense and possibly multi-day<br />

sessions involving different stakeholders. The session is akin<br />

to a visual brainstorming meeting which serves as a way of<br />

quickly generating ideas within a specified time limit, tapping<br />

on the aptitudes and interests of a diverse group of people.<br />

The target audience for this tool is selected individuals with a<br />

stake in the issue, or experts who can contribute to the design<br />

of the solution. For example, in the context of urban planning,<br />

this could include government officials, developers, residents<br />

and architects.<br />

Before using charrettes, the agency should<br />

determine:<br />

• Issues – agencies need to be clear and focussed about the<br />

purpose of the activity, and the scope of feedback desired.<br />

• Setting – as charrettes are typically used for<br />

brainstorming, the setting should encourage openness<br />

and creativity.<br />

• Facilitator – an experienced facilitator is important to<br />

ensure that a variety of views are heard and the discussion<br />

is kept on track<br />

When is it most useful?<br />

A charrette is a problem-oriented tool – it encourages full<br />

participation and discussion about interrelationships and<br />

impacts of policies. It is most effective early in the projectplanning<br />

phase where brainstorming is required. Charrettes<br />

are usually deployed for design-related matters, such as the<br />

design of a new town centre, urban planning, etc.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• If there are multiple<br />

stakeholder groups with<br />

diverse views involved,<br />

agencies can also consider<br />

conducting separate<br />

charrettes for each group.<br />

Considerations<br />

Charrettes are relatively exclusive because only the experts<br />

are usually invited to participate. Thus participants may not<br />

be viewed as being representative of the wider populace.<br />

Preparatory work leading to a charrette is typically also timeand<br />

resource-intensive.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 81 82 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

11. Citizen juries<br />

Citizen jury is a randomly selected and demographically<br />

representative panel comprising members of the public used<br />

for examining and deliberating on a policy issue.<br />

The target audience of this technique is a group of ordinary<br />

citizens who are selected based on the requirements of the<br />

issue at hand.<br />

Before using citizen juries, agencies should<br />

determine:<br />

• Selection – members of the jury should be carefully<br />

selected to reflect the wider public in terms of<br />

demographics and opinions.<br />

• Agenda – care and thought must be placed in<br />

considering what is to be presented. Participating jurors<br />

must be informed enough to understand the issue and<br />

the information should have several points of view, so that<br />

jurors may construct effective questions to ask during the<br />

session.<br />

• Logistics – due to the time and effort commitment<br />

required of the participants, agencies also should consider<br />

hosting the meeting at a convenient location or provide<br />

transport arrangements for the participants to incentivise<br />

the public to participate in the deliberation process.<br />

When is it most useful?<br />

Citizen juries are useful for involving the public to develop a<br />

deep understanding of an issue. The extensive deliberation<br />

process by the public can provide the agencies with<br />

additional viewpoints on the issues/concerns of a particular<br />

policy. Since the jurors are ‘non-experts’, the general public are<br />

more likely to identify and agree with their conclusions and<br />

recommendations.<br />

Considerations<br />

The entire process requires a high level of patience and<br />

requires commitment from participants. Participants need<br />

to be screened to ensure they possess the capacity to ask<br />

constructive questions so as to maintain time efficiency of the<br />

entire process.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• In order to maintain<br />

‘neutrality’ of the jurors,<br />

they should not mix<br />

informally (e.g., over lunch)<br />

with agency officers or<br />

the experts before the<br />

completion of the process.<br />

12. Delphi process<br />

The Delphi process involves several iterations of participant responses to a questionnaire with<br />

results tabulated and disseminated until following iterations no longer result in significant<br />

changes. It is similar to an expert panel, except that agreement can be reached without the need<br />

for a face-to-face group process.<br />

How it works<br />

A group of experts are first selected and presented with a number of questions regarding the<br />

subject topic. Participants contribute anonymously, which allows a free flow of ideas. The Delphi<br />

process provides an opportunity for discussion without the need for meeting. It continues until<br />

there is no longer a need for modification of opinions, and when the final iteration resembles<br />

the most ‘optimal solution’.<br />

Usually all participants maintain anonymity even after the final report is completed. This ensures<br />

that participants are not influenced by anyone based on authority, personality or biases. It<br />

allows them to express their opinions and critiques without constraint, and modify errors or<br />

revise earlier opinions without fear of judgment. The process is stopped after a pre-defined stop<br />

criterion is reached (e.g. consensus achieved, stability of results and number of rounds).<br />

The target audience of this process is a select group of people with expertise on the policy issue.<br />

Before using the Delphi process, agencies should determine:<br />

• Participants – ensuring the select panel have sufficient knowledge about the subject matter<br />

is critical to gaining useful and relevant information.<br />

• Facilitating the information collation – responses need to be collected and analysed after<br />

each round to identify common or conflicting viewpoints.<br />

When is it most useful?<br />

The Delphi process is useful for forecasting potential impact of policy implementation. Experts<br />

may be asked to give their estimated probabilities regarding the long-term trend of a certain<br />

area like healthcare or economic trends and education. It provides relatively quicker forecasts if<br />

experts are readily available.<br />

Considerations<br />

The Delphi process requires significant investment of time and effort from experts who may<br />

have busy schedules. Agencies need to convince the experts on the value of the consultation<br />

process and keep the experts engaged and active in each round in order to obtain optimal<br />

effectiveness.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 83 84 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

13. Expert panels<br />

14. Interviews<br />

An expert panel is a specially constructed group of individuals<br />

who are considered technical specialists in their field. The<br />

panel can be used as a credible evaluative and deliberative<br />

tool, representing various points of view regarding policies or<br />

projects in a balanced and impartial way.<br />

Generally, six to 12 experts are selected to form members<br />

of the panel. The panel can then meet at intervals either in<br />

a public meeting with members of the media asking them<br />

questions, or be conducted with a neutral moderator posing<br />

questions to the panel members.<br />

The target audience of this method are experts that are<br />

recognised as independent specialists in their respective<br />

spheres.<br />

Before using expert panels, agencies should<br />

determine:<br />

• Participants – the experts chosen should have extensive<br />

experience in the field and preferably be independent<br />

with regards to the proposed policy.<br />

• Moderator – it is important to appoint an experienced<br />

moderator who is able to keep the discussion on track,<br />

raise discussion points or questions to solicit relevant<br />

insights, and ensure that the consultation objectives are<br />

met.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Establishing guidelines or<br />

ground rules for expert<br />

panel discussions may<br />

encourage panel members<br />

to be focussed on the topic<br />

at hand.<br />

• In addition to expertise in<br />

their field, try increasing<br />

the diversity of the<br />

members. This may build<br />

credibility and help<br />

address public concerns<br />

about equity.<br />

Interviews are one-to-one discussions with experts,<br />

stakeholders, or prominent public figures where agencies can<br />

gain insight on a particular issue/policy.<br />

An interview usually lasts around an hour and is framed<br />

around a particular subject. During an interview, it is possible<br />

to gain in-depth and detailed information without peer<br />

pressure. Personal, face-to-face contact allows for a more<br />

detailed understanding of the reasons and rationale behind<br />

people’s attitudes and opinions.<br />

The target audience for this tool is selected individuals with<br />

knowledge and/or experience in the relevant area.<br />

Before conducting interviews, agencies should<br />

determine:<br />

• Topic – ensure appropriate questions are crafted prior<br />

to the interview, and be clear about the reason for<br />

conducting the interview.<br />

• Questions – use open-ended questions as opposed<br />

to questions resulting in ‘yes/no’ answers. Ensure that<br />

questions are relevant to the subject area so as to fully<br />

utilise the available time.<br />

When is it most useful?<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Be sensitive to the needs<br />

of the person you are<br />

interviewing.<br />

• Ensure an appropriate<br />

venue is selected with<br />

refreshments provided<br />

depending on the<br />

anticipated length of the<br />

interview.<br />

• Provide the interviewer<br />

with the questions or areas<br />

of discussion prior to the<br />

interview to prepare the<br />

interviewer for the session.<br />

When is it most useful?<br />

This method presents an opportunity for a balanced<br />

discussion of issues. Expert panels are suitable for presenting<br />

different considerations and viewpoints, particularly for<br />

subject areas which are controversial or uncertain. Expert<br />

panels are also useful in estimating future impacts of an<br />

implemented policy.<br />

Considerations<br />

Agencies need to be cognisant that although experts<br />

are more knowledgeable than the general public, their<br />

statements and opinions still need to be properly clarified<br />

and verified to ensure accuracy. When used properly, the<br />

synthesised ideas developed during these sessions form<br />

credible sources of information.<br />

Interviews are most useful when obtaining feedback from<br />

stakeholders, experts and excluded or minority groups.<br />

Interviews offer participants a degree of privacy in a nonthreatening<br />

environment to express views, and identify new<br />

issues that might not otherwise have been thought of.<br />

Considerations<br />

Scheduling multiple interviews, collating data and analysing<br />

data can be time consuming and labour intensive. Agencies<br />

should therefore be selective in conducting one-to-one<br />

interview with individuals who can contribute the most to the<br />

policy development.


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 85 86 <strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong><br />

15. Working groups<br />

A working group consists of a number of selected<br />

stakeholders who meet periodically to provide their views.<br />

It provides an opportunity for in-depth analysis of policy or<br />

initiative being consulted.<br />

The target audience of this method is stakeholder-centric, and<br />

focuses on stakeholders with a direct/indirect interest in the<br />

proposed government project or policy. This may comprise<br />

experts, industry players, interest groups or selected members<br />

of public.<br />

Before organising regular working groups, agencies<br />

should determine:<br />

• Size – the typical size of a working group is eight to 15<br />

members.<br />

• Roles – ensure roles and responsibilities of participants<br />

are defined upfront so that they are aware of their duties.<br />

The required time commitment should also be clear.<br />

• Participants – consider the group dynamics of the<br />

individuals selected for the working group. Participants<br />

can be identified through:<br />

- Agencies’ past experience;<br />

- Recommendations from external organisations<br />

(e.g. other government agencies, trade/business<br />

associations, unions); or<br />

- Prominent individuals who are known to be experts or<br />

leading players in their field.<br />

When is it most useful?<br />

Working groups are useful during the early stage of policy<br />

formulation, where there is scope for developing, influencing<br />

and assessing the strategic options available<br />

Considerations<br />

Agencies need to be aware that working groups involve<br />

selected individuals and may not necessarily represent<br />

the views of the larger stakeholder population. In addition,<br />

the effectiveness of a working group is dependent on the<br />

commitment of its members.<br />

TIPS FOR<br />

EFFECTIVENESS<br />

• Get workgroups to<br />

champion the cause by<br />

allowing them to gain<br />

a sense of ownership<br />

of the policy that they<br />

assisted the government in<br />

creating.<br />

Appendix B:<br />

Planning aid for public consultation<br />

The following can be customised by agencies to suit their own needs.<br />

Agency<br />

Policy initiative for<br />

consultation<br />

Responsible party(s)<br />

Start of consultation<br />

process<br />

DD / MM / YYYY<br />

A. Objective(s) of consultation exercise<br />

1<br />

2<br />

B. Strategy for consultation<br />

Stakeholders who<br />

will benefit<br />

Stakeholders who<br />

are adversely<br />

affected<br />

Stakeholders<br />

who may have<br />

skills/resources to<br />

contribute<br />

Other stakeholders<br />

who may be<br />

interested<br />

Identify<br />

stakeholders to be<br />

consulted<br />

1. E.g. the elderly<br />

2.<br />

1.<br />

2.<br />

1.<br />

2.<br />

1.<br />

2.<br />

What tools/<br />

channels are most<br />

suitable to engage<br />

the identified<br />

stakeholder group<br />

E.g. community<br />

meetings, public<br />

forums<br />

Targeted completion<br />

date<br />

What are some<br />

potential issues/<br />

risks<br />

E.g. participation<br />

rate may be low<br />

DD / MM / YYYY<br />

What are<br />

mitigating<br />

strategies<br />

E.g. partner<br />

with NGOs (e.g.<br />

Third Age, Tsao<br />

foundation)


<strong>Public</strong> <strong>Consultation</strong> <strong>Toolkit</strong> 87<br />

C. Develop action plan and timeline<br />

Categories<br />

Key activities<br />

Estimated<br />

time<br />

required<br />

Person(s)<br />

responsible<br />

Planned<br />

start date<br />

Planned<br />

completion<br />

date<br />

Status<br />

<strong>Consultation</strong><br />

strategy<br />

Develop consultation<br />

strategy<br />

Obtain approval for<br />

consultation strategy<br />

Draft consultation<br />

materials<br />

<strong>Consultation</strong><br />

materials<br />

Obtain approval for<br />

consultation materials<br />

Develop and print<br />

consultation materials<br />

Generate<br />

awareness for<br />

consultation<br />

exercise<br />

Development of<br />

communications plan<br />

Obtain approval for<br />

communications plan<br />

Implement<br />

communications activities<br />

to generate awareness<br />

Plan consultation launch<br />

date(s)<br />

Make<br />

logistical<br />

arrangements<br />

Make facility<br />

arrangements (e.g. venue,<br />

refreshments)<br />

Identify and invite<br />

speakers/facilitators/<br />

partners/vendors<br />

Send invitations/<br />

notifications to<br />

participants<br />

Track participation rate<br />

During<br />

consultation<br />

period<br />

Track type of feedback<br />

provided<br />

Assess need to extend<br />

consultation or provide<br />

more information<br />

Collate feedback and<br />

develop report on<br />

consultation<br />

Close the loop<br />

Obtain approval for<br />

consultation report<br />

Publish report to<br />

participants

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!