Hunting Black Swans & Taming Black Elephants: Peter Ho

IPS-Nathan Lectures 2016/17: Lecture I - Hunting Black Swans & Taming Black Elephants: Governance in a Complex World


Ex-civil service head Peter Ho: Shape future, don't predict it, this will help Singapore tackle a more complex world
By Charissa Yong, Political Correspondent, The Straits Times, 6 Apr 2017

Before the United Kingdom voted last June on whether to leave the European Union, polls showed that the outcome of the Brexit referendum would be a close call.

Despite this, the UK Treasury did not prepare for the "leave" scenario.

Former civil service head Peter Ho cited this yesterday as an example of a "black elephant" event - "a problem that is actually visible to everyone, but no one wants to deal with it, and so they pretend it is not there".



Speaking at his first lecture as the Institute of Policy Studies' S R Nathan Fellow for the Study of Singapore, he said such occurrences are a cross between a rare and hard-to-predict event, popularly known as a black swan, and the proverbial elephant in the room.

"When it blows up as a problem, we all feign surprise and shock, behaving as if it were a black swan," added Mr Ho, who is a senior adviser to the Centre for Strategic Futures.

Governments today have to grapple with an increasingly complex world with more moving parts, and it has become harder to predict the outcome of the interactions between those parts, he told 490 officials, academics and students at the hour-long lecture.

To minimise the chances of being blindsided in such an environment, policymakers will have to think about how they can shape the future instead of predicting it, he said.

An event Singapore did not predict was the effect of climate change on the drainage systems.

Citing the flash floods that hit Orchard Road in 2010, Mr Ho said during a question-and-answer session that the Government missed the initial warning signs of climate change.

But when the floods persisted, it started looking into the issue and discovered that rising temperatures had made rainfall more intense.

It was then that it realised the drainage system had to be upgraded to cope with the change.

"Every now and then, we will be confronted with these kinds of problems. The question is how long we take to respond," said Mr Ho, who led the civil service from 2005 until his retirement in 2010.

He suggested that one way of dealing with the increased complexity is scenario planning, so policymakers can see their own biases and be more imaginative. Singapore started this 20 years ago and now runs national scenario planning exercises every few years.

Another way is horizon scanning, that is, trying to identify the game-changing events.

For this, Singapore has a set of computer tools, the Risk Assessment and Horizon Scanning system, that use big data to search for trends and issues that could evolve into sudden shocks.

But in tackling such issues, government agencies and ministries must work together and share information, instead of dividing the problem and handling it in silos, said Mr Ho.

He acknowledged that this "whole-of-government" approach requires a difficult cultural shift.

"Often, the leader must nag his people to remind them that the whole-of-government imperative takes precedence over narrow sectoral interests and perspectives."

This is why the Strategy Group was set up under the Prime Minister's Office two years ago to coordinate policies across the Government and make this approach a priority.

"If we look at each issue from a narrow perspective, we will miss the wood for the trees," he said.

The black elephant challenge for governments
This is an excerpt from a speech by Peter Ho, former head of civil service. He was delivering his first lecture on Wednesday as the Institute of Policy Studies' S R Nathan Fellow for the Study of Singapore.
The Straits Times, 7 Apr 2017

Stephen Hawking, the world-famous theoretical physicist, said: "I think the next century (the 21st century) will be the century of complexity." But what is complexity? And what is its relevance to governance?

Complex is different from complicated. An engineering system is merely complicated. It could be an A-380 or a telecommunications satellite. Its inner workings may be very difficult (to understand) for a layman, who is more likely than not to describe it as complex, when it is actually just complicated. Complicated systems have Newtonian characteristics in that they perform pre-determined functions that are predictable and repeatable, in which input leads to a predictable outcome.

In contrast, a complex system will not behave in a repeatable and pre-determined manner. A complex system contains a large number of autonomous parts - agents - connected to one another, and interacting in a great many ways. They often generate their own feedback loops. To understand a complex system, we must understand not only the behaviour of each of these agents but also how they interact with one another, and how they act together as a whole.

Cities - like Singapore - are complex systems. They are made up of hundreds of thousands, even millions, of people - who are the "agents" in the parlance of complexity. Each person interacts with others, producing outcomes that often confound and astonish planners and policymakers.

All human systems are complex, not just cities. Countries are complex, as are political systems. The world as a whole is complex.

There are many definitions of complexity, but all of them agree that complex systems are characterised by the property of emergence. The connections and interactions among the many agents in a complex system lead to outcomes that are inherently unpredictable ex ante, and that are revealed only when they actually occur. So, when something happens, we are surprised.

BLACK SWANS AND BUTTERFLY EFFECT

Nicholas Nassim Taleb famously described one class of such surprises - rare and hard-to- predict events - as black swans. In Taleb's view, black swans are not just surprising, but also have another important characteristic: their impact is large and game-changing.

In 2002, not long after 9/11, Donald Rumsfeld who was then US Secretary of Defence, introduced us to a close relative of the black swan, the unknown unknown. He said: "There are known knowns. These are things we know we know. We also know there are known unknowns. That is to say we know that there are some things we do not know. But there are also unknown unknowns, the ones we don't know we don't know."

In this highly-interconnected world, what happens in one part is going to affect other parts - the so-called butterfly effect which postulates that the flap of a butterfly's wings in Brazil can set off a tornado in Texas. This was the title of a lecture by Dr Edward Lorenz.

The butterfly effect is the concept that small changes in initial conditions can produce large effects in a complex system.

COMPLEXITY AND GOVERNMENTS

The rise of complexity will generate more uncertainty, and increase the frequency of black swans and other strategic surprises. In other words, complexity can cause big headaches for governments.

Yet, governments often ignore the complexity of their operating environment. They typically deal with complexity as if it is amenable to simple and deterministic, even linear, policy prescriptions. In a sense, the crux of public policy has been to apply - if not impose - orderly solutions to the myriad of complex problems that afflict our societies, our politics and our lived everyday experiences, in largely vain attempts to make what is complex merely complicated.

We see this in legal systems that are based on uniform punishments for complex and varied crimes, in public health enterprises that treat patients as largely homogenous, and education systems and pedagogies that assume that all children develop uniformly, or ought to.

THE BLACK ELEPHANT

This leads me to another member of my menagerie, the black elephant. The black elephant is the evil spawn of our cognitive biases. It is a cross between a black swan and the proverbial elephant in the room. The black elephant is a problem that is actually visible to everyone, but no one wants to deal with it, and so they pretend it is not there. When it blows up as a problem, we all feign surprise and shock, behaving as if it were a black swan.

Last year, many of us would have been astonished to learn that the Treasury in the United Kingdom had made no contingency plans for Brexit, despite the fact that the polls showed that the outcome of the referendum would be a close call. The British military - which I presume is like most armed forces and makes contingency plans at the drop of the hat - also reportedly did nothing. The UK government looked decidedly flat-footed the day after the referendum.

Surely this is an example of a black elephant? In fact, the only institution that had a Plan B was the Bank of England. My surmise is that because the Governor is not British - Mark Carney is Canadian-Irish - he had no emotional skin in the game, and could take an objective, dispassionate, look at the situation.

GOVERNANCE IN COMPLEXITY

So, what can governments do to improve the way they manage complexity, and at the same time mitigate the effects of the various cognitive biases that afflict them?

We can start by accepting that complexity creates uncertainty. Prediction is not possible.The right approach is an orientation towards thinking about the future in a systematic way.

Clearly, changes need to be made to the way governments organise themselves. Their toolbox must be enlarged. We can adopt methods and processes that help us to reduce the frequency of strategic surprise, and when the inevitable shock occurs, to reduce the amplitude or intensity of its impact. Some of us call this foresight, or futures thinking.

There are foresight methodologies - ways to think about the future systematically, and ways to help overcome some of our latent biases and our inherent cognitive constraints. One of them is the famous scenario planning method, which was developed and pioneered by the oil giant, Shell. Shell famously avoided the impact of the oil shock after an Arab oil embargo imposed in 1973 after the Yom Kippur War.

Today, scenario planning is a key part of the Singapore Government's strategic planning process. National scenario planning exercises are run every few years, and are even incorporated into the annual Budget cycle. The resultant scenarios are used by ministries and agencies as a base reference for their own strategic planning.

The big benefit of scenario planning is that it helps to overcome our cognitive biases by surfacing hidden assumptions and challenging mental models.

Scenario planning helps to inculcate an anticipatory mindset in planners and policymakers so that they instinctively raise "what if" questions on the issues they deal with. It helps them to overcome their blind spots, and to confront or at least be aware of black elephants.

WICKED PROBLEMS

The complexity of our operating environment that produces black swans also produces wicked problems - complex, large and intractable, with no immediate or obvious solutions. They have causes and influencing factors that are not easily determined ex ante. They hardly ever sit conveniently within the responsibility of a single agency. Worse, they have many stakeholders, each of which sees these problems from different perspectives, and who have divergent goals. This means there are no immediate or obvious solutions, because nobody can agree on what the problems are in the first place, never mind what the solutions should be.

Wicked problems include the big challenges of our age, such as climate change, the environment, population, urbanisation, inequality. Most crises are wicked problems. There are many stakeholders, but they have competing perspectives and divergent interests. Please one and you upset many others. Solve one problem and others will arise.

Terrorism is a particularly wicked problem. Even if everyone agreed on how to distinguish terrorists from legitimate freedom fighters, and there was consensus that terrorism should be banished, it is not clear that any policy prescriptions would gain universal acceptance. If that were the case, terrorism would not be the persistent problem that it is today, and the Islamic State would not be such a serious threat.

There is no single agency in government that is really equipped to deal with a wicked problem in its entirety. But, letting departments tackle different parts of a wicked problem on their own often leads to duplication or to waste and sub-optimal policies, and even to new wicked problems.

THE DANGERS OF REDUCTIONISM

Efforts to understand our complex world and to deal with wicked problems often rely on an assumption - that what is complex can be reduced to simpler subsets that are easier to evaluate, and that when re-aggregated, will produce results that approximate the real world.

This approach is reductionism.It led to the tendency to dissect the complex world into smaller and less complex parts, and to favour explanations framed at the lowest level of scale.

Arguably in government, the assumption of reductionism results in a tendency to divide big problems into smaller pieces. It goes a long way to explain the proliferation of agencies and bureaucracies as standard response to emerging and wicked problems.

Despite the enormous importance of this approach, it gives the false impression that investigating things at a holistic level is less informative than investigating the properties of the components. Outside the realm of science, reductionism has not been as effective in explaining phenomena in such areas as ecology and economics.

Complexity science abjures reductionism for the study of how systems interact with other systems, how agents interact with other agents, and then how these lead to emergent, rather than causal, results.

Complexity science tools include agent-based modelling, which examines how autonomous agents interact with one another and influence system behaviour. These tools, when applied to economics and to other areas like urban planning, provide fresh and usable insights that deterministic models have failed to produce. In Singapore, government agencies are beginning to use such tools to address complex problems in areas such as land transportation, health and housing.

EVERYTHING IS CONNECTED

Another way to counter the problems inherent in the reductionist approach is to look at situations more holistically. This is important because in our complex world, "everything is connected to everything else". If we look at each issue from a narrow perspective, we will miss the wood for the trees.

At heart, this is an argument in favour of enlarging our field of vision to see how economics, demographics, societal issues, issues of environment and of technology, interact with each other to produce the complexities of the operating environment. This is a more interdisciplinary and counter-reductionist approach.

Interdisciplinary collaboration is essential for solving the big challenges of today, in science and technology, in the social sciences, in the economy, in urbanisation, and in the environment. Why not also in geopolitics, geo-strategy and geo-economics? It is not possible, for example, to separate the conduct of foreign policy from other large national interests like economics and trade. So, there has to be a lot of internal coordination, and sharing of information.

To this end, inter-agency cooperation requires good leadership to grow. This is, in part, reflected in Singapore's coordinating ministers, a position first established in 2003 with the appointment of the first-ever Coordinating Minister for Security and Defence. Now there are three coordinating ministers, who cover the entire spectrum of government functions - namely national security, economic and social policies, and infrastructure. The establishment of these three positions marks the transformation of the Singapore Government from a traditional hierarchy into a new-age system of government, characterised by a Whole-of-Government approach.

WHOLE-OF-GOVERNMENT

This transformation is significant, because the Whole-of-Government approach is an important response to managing complexity and dealing with wicked problems.

An organisation that breaks down vertical silos encourages the spontaneous horizontal flow of information that will enlarge and enrich the worldview of all agencies. This improves the chances that connections, emergent challenges and opportunities are discovered early.

It is a mindset of willingly working together to achieve common national outcomes, instead of serving the interests of individual agencies.

Take terrorism as an example. No single ministry or government agency - not Mindef (Ministry of Defence) or MHA (Ministry of Home Affairs) - has the full range of competencies or capabilities to deal with this threat on its own. Instead, the efforts of many agencies have to be coordinated and brought to bear on this problem in a Whole-of-Government approach. This insight - and the looming challenge of transnational terrorism - led the Singapore Government to set up the National Security and Coordination Secretariat.

Whole-of-Government looks eminently reasonable - on paper. But it is not easily achieved. Governments, like any large hierarchy, are organised into vertical silos. For Whole-of-Government to work, these vertical silos need to be broken down, so that information can flow horizontally to reach other agencies.

But this is a Sisyphean effort. Whole-of-Government is antithetical to a deeply-ingrained bureaucratic instinct to operate within silos. More insidiously, institutional identity is sometimes so strong that it colours how each agency views or prioritises national interests.

One of the big challenges of government - especially the hierarchical Westminster Western model that the Singapore Government is derived from - is the occurrence of bureaucratic silos, where information and coordination flow vertically, rather than develop horizontally. This is, in turn, an organisational impediment to the sharing of insights and information critical to thinking about the future.

This is a big hurdle to overcome.

It requires not just a lot of effort but also a real change of culture. Often, the leader must nag his people to remind them that the Whole-of-Government imperative takes precedence over narrow sectoral interests and perspectives.

The Whole-of-Government approach is today a priority of the Singapore Government. There are inter-agency platforms that have been established to share information among ministries, statutory boards and other agencies, in order to take in different ideas and insights, so that wicked problems can be viewed in their manifold dimensions.

Coordinating bodies now deal with cross-agency strategic issues, like the National Climate Change Secretariat and the National Population & Talent Division. Two years ago, the Government set up the PMO Strategy Group with the mission of Whole-of-Government policy development and coordination. And most recently, the Government announced the establishment of the Smart Nation & Digital Government Group to give a further Whole-of-Government push to the Smart Nation effort.

URBAN PLANNING

Let me take up the issue of urban planning, a uniquely wicked problem for Singapore. While other countries have large land areas, which allow new cities to develop and replace other cities that may decline in relevance and fortune, Singapore, as a small city-state in an island, does not have that luxury.

Instead, urban planning in Singapore needs to take into account the challenge of packing in housing, green space, industrial land, commercial and retail space, land for transportation needs, and military training areas, all within the confines of a small island of 718 sq km. This is less than half the size of London, and two-thirds the size of New York City.

In Singapore, the entire process of urban planning involves close collaboration among economic, social and development ministries and agencies. It also entails consultations with various stakeholders in the private sector and the general public. This approach enables all stakeholders to better understand interdependencies and implications of land use and strategic decisions.

Planning so far ahead and for multiple possible functions is inherently complex and invariably involves many uncertainties. So, national scenarios are used to factor in these uncertainties. Plans are also regularly reviewed. This process of long-term planning and regular review has enabled Singapore to anticipate its needs far in advance, and provides the flexibility to respond to surprises and to adapt to changes over time.

But such plans are only possible because of the embrace of a Whole-of-Government approach, in which trade-offs in land use are made among agencies. What is protected is not the narrow sectoral interests of the various ministries and agencies, but the larger national interest. It is not just a matter of coordination of roles and actions. At its core, Whole-of-Government means finding consensus on strategic priorities. Consensus is made possible because processes like scenario planning help align the government agencies to the larger national interests.

WHOLE-OF-NATION

But with increasing complexity, the role of the government transforms from being a direct service provider, and becomes more of what the Manhattan Institute for Policy Research describes as a "lever of public value inside the web of multi-organisational, multi-governmental and multi-sectoral relationships".

This is sometimes called networked government, which refers to the management of the webs of relationships within and surrounding government.

For instance, government social services rely on collaboration with non-profit and community-based organisations. Examples like this do not indicate a diminishing importance of the government's role. Instead, government may be understood as having multiplied its capabilities by extending its reach beyond its institutional boundaries.

A government that operates in a networked manner deploys mechanisms that promote reach within the whole nation. Tackling the Jemaah Islamiah (JI) threat is not just about removing the immediate threat that the JI posed to Singapore's security. It also requires engaging multiple stakeholders, including community groups like the religious teachers who started the Religious Rehabilitation Group. It means engaging the private sector to help develop protective systems, processes and security infrastructure. This approach clearly needs not just many agencies of government coming together, but also bringing in the people and the private sectors.

In a way, it is not just a Whole-of-Government approach, but also a Whole-of-Nation effort. This is because the JI poses a multi-dimensional threat that requires not only collaboration among security agencies, but also with social agencies that have oversight of issues affecting local communities. The Singapore approach is to fight the JI network with Whole-of-Nation networks. This is networked government in action.

This Whole-of-Nation approach continues today with the SGSecure initiative, which is specifically targeted at building community networks. The SGSecure national movement aims to "sensitise, train and mobilise the community" as part of its response in the face of national threats.

The rise of complexity in the world today throws up enormous challenges for governments. Black swans will confront them, and they will have to deal with wicked problems. Black elephants will be lurking in the background.

Foresight will help governments to better deal with complexity and its challenges. The concept of governance must also change, in tandem with rising expectations and a more educated and empowered citizenry. Government-by-Agency will evolve into Whole-of-Government, which in turn will embrace the broader Whole-of-Nation approach that includes business, civil society and the man in the street.

Collectively, these multi-sectoral actors will change the concept of governance, even if they are not part of "government", traditionally defined. The future of governance in a world of complexity lies in such systems-level coordination.

* Civil service must never be politicised, says former chief Peter Ho
Public servants must be able to give independent advice and not capitalise on relationships with political leaders
By Charissa Yong, The Straits Times, 7 Dec 2017

Civil servants need to keep political leaders at arm's length and must never make use of their relationship with them, said former top civil servant Peter Ho.

This separation is critical because "the day the civil service gets politicised, we have a problem", he said in an interview with The Straits Times yesterday.

"I would discourage my civil servants from capitalising on relationships. I never allowed myself to," said Mr Ho.

This is especially important as many senior civil servants might have gone to school with political leaders, noted the University of Cambridge alumnus, who headed the civil service from 2005 until his retirement in 2010. His book on governance will be launched tomorrow.

The civil service today is impartial, he stressed.

"I will not assume that observations - which are made from time to time - of politicisation of the civil service are either fair or an accurate description," he said, responding to perceptions from some quarters that the civil service is politicised.

Specifically, the Workers' Party (WP) had accused the National Development Ministry of bias in issuing regular statements on alleged misconduct by the WP-run town council during the 2015 General Election, but not after Polling Day.

There are also longstanding grumbles that the People's Association helps the ruling People's Action Party (PAP) mobilise the ground.

Amid such talk, Mr Ho's advice to civil servants is: "You have to keep your nose clean. Otherwise, you will open yourself up precisely to these kinds of accusations that you are being politicised or you are being influenced by the political leadership."

On whether there is any conflict of interest when so many senior civil servants become PAP politicians, he said: "I do not think anyone who becomes a political leader, at least in Singapore, sees his position as a continuation of his career in the civil service. I would be worried if they do."

The 63-year-old was speaking ahead of the launch of his book, The Challenges Of Governance In A Complex World. It consists of the four lectures he gave this year as the Institute of Policy Studies' S R Nathan Fellow for the Study of Singapore.

In his lectures, Mr Ho - now a senior adviser at the Centre for Strategic Futures - spoke of the need for governments to be prepared for unexpected trends or events.

After one lecture, an audience member asked: What if one unexpected event is the fall of the PAP?

Asked to elaborate yesterday, Mr Ho said with a laugh: "You cannot rule this kind of scenario out."

The civil service and the PAP have worked together for so long that they have developed an "instinctive understanding" of each other.

"Is this good? Is this bad? I don't know. But there are a lot of advantages when the civil service instinctively understands the thinking of the political leadership, and vice-versa," said the former permanent secretary at the Foreign Affairs and Defence ministries.

For one, "it leads to less potential for misunderstanding, less friction and less time wastage".

But at the end of the day, officials must maintain a professional position of being able to offer objective independent advice to ministers.

Mr Ho himself has a thick hide from being "chewed out so many times" by ministers in his 34-year career in the public sector.

Such disagreements are par for the course, he said. "From time to time, we do have to tell the ministers, basically, this is a dumb idea.''

He did not give examples, but said ministers would not ignore such advice given to them in a "reasonably compelling way".

Mr Ho also gave his take on how governance evolved with the times, and said the Government must learn to listen more to the people.

"It is not a situation where people are just throwing stones. They are very well informed and do their homework, and they sometimes pick up on things which governments don't pick up on," he said.

SMRT chairman Seah Moon Ming's decision to quit day job 'laudable'
By Charissa Yong, The Straits Times, 7 Dec 2017

SMRT chairman Seah Moon Ming's recent decision to step down from his day job to focus on fixing SMRT's woes should be lauded, said former civil service head Peter Ho.

He used Mr Seah's case to make the point that the correct approach for the authorities and SMRT to the ongoing train troubles was to do one's best to solve the problem, instead of seeking only to apportion blame for what went wrong.

This mindset applies to the civil service too, he said.

"Do we want to embrace blame-seeking culture or a problem-solving culture? The main thing is to solve the problem," said Mr Ho, who retired from the civil service in 2010 and is now senior adviser at the Centre for Strategic Futures.

Mr Ho, 63, was speaking to The Straits Times ahead of tomorrow's launch of his book, The Challenges Of Governance In A Complex World. In it, he addresses governance in an age of complexity and cites the idea of a "black elephant" - a problem actually visible to everyone, but which no one wants to deal with until it blows up in their faces.



Asked if the MRT's sub-par maintenance was one such example, he replied that apportioning blame in such a way was unhelpful.

"In a way, it doesn't really matter. It has happened and you have to solve the problem," he said.

He acknowledged that "if something went wrong, we have to find the people who fail and deal with them accordingly".

"But the main thing is to solve the problem," said Mr Ho. This was what Mr Seah was doing, he added.

Mr Seah was appointed SMRT chairman in July. Three months later, a flooded MRT tunnel disrupted services on the North-South Line. Last month, two trains collided at Joo Koon MRT station.

Mr Seah announced on Tuesday that he was stepping down as chief executive of Temasek unit Pavilion Energy to focus on his SMRT role.

Mr Ho said: "Because he is a real gentleman, he feels obliged to solve the problem. But the only way to solve the problem - and he is not being paid for any of this - is to resign from his real job to deal with this problem.

"That is a very honourable thing to do. Is he being thanked for it? No."