Europe’s fiscal compact went into effect January 1, as a result of its ratification December 21 by the 12^th country, Finland, a year after German Chancellor Angela Merkel prodded eurozone leaders into agreement.   The compact (technically called the Treaty on Stability, Coordination and Governance in the Economic and Monetary Union) requires  member countries to introduce laws limiting their structural government budget deficits to less than ½ % of GDP.  A limit on the “structural deficit” means that a country can run a deficit above the limit to the extent — and only to the extent — that the gap is cyclical, i.e., that its economy is operating below potential due to temporary negative shocks.   In other words, the target is cyclically adjusted.  The budget balance rule must be adopted in each country, preferably in their national constitutions, by the end of 2013.

    Will the new approach help?   The aim is to fix Europe’s long-term fiscal problem, which since the date of the euro’s inception has been evident in the failure of the Stability and Growth Pact (SGP), the crisis in Greece and other periphery countries that surfaced in 2010, and the various ways in which these countries were subsequently bailed out.  

     There is no reason to doubt that the eurozone countries will follow through to the extent of adopting the national rules by the end of the year.  ["The granting of new financial assistance under the European Stability Mechanism is conditional on ratification of the fiscal compact and transposition of the balanced budget rule into national legislation in due time."]  But after that the fiscal compact will probably founder on precisely the same shoals as the SGP.

    Since the inception of the euro, its members have made official fiscal forecasts that are systematically biased in the optimistic direction.   Other countries do this too, but the bias among eurozone countries is, if anything, even worse than that elsewhere.  During a period of economic expansion, such as 2002-07, governments are tempted to forecast that the boom will continue indefinitely.  Forecasts for tax revenue and budget surpluses are correspondingly optimistic and so hide the need for adjustment of fiscal policies.  During a period of recession, such as 2008-2012, governments are tempted to forecast that their economies and budgets will soon rebound.  Since forecasting is subject to so much genuine uncertainty, nobody can prove that the forecasts are biased when they are made.

     Fiscal rules such as the SGP ceilings won’t constrain budget deficits, if forecasts are biased.  The reason is that governments can in any given year forecast that their growth rates, tax revenues, and budget balances will improve in the subsequent years, and then next year say that the shortfalls were unexpected.   Indeed, it turns out that the eurozone bias in official forecasts during 1999-2011 can be neatly characterized as responding to the SGP’s 3% limit on budget deficits by offering over-optimistic forecasts each time governments exceed the limit.  In other words, they adjust their forecasts rather than their policies.   (The results described here come from a new paper, coauthored with Jesse Schreger: “Over-optimistic Official Forecasts and Fiscal Rules in the Eurozone,” forthcoming 2013 in the Review of World Economy, vol.149, no.2, from Germany’s Kiel Institute.)

    Phrasing the budget rules in cyclical terms, while highly desirable in terms of macroeconomic impact, does not help solve the problem of forecast bias.  It can even make it worse.  In a year when a forecast for the actual budget deficit turns out to have been over-optimistic, the government has to admit that it made a mistake, which can carry some embarrassment.  In a year when a forecast for the structural budget deficit turns out to have been over-optimistic, the government can still claim that its own calculations show the shortfall to have been cyclical rather than structural.   After all, estimation of potential output and hence the cyclical versus structural decomposition is notoriously, even after the fact.

   Will it help that under the fiscal compact the rules are to be adopted at the national level, as opposed to the supranational level on which the SGP operated?  A look at the various rules and institutions that have already been tried by European countries shows that some work and others don’t.  Creating an independent fiscal institution that provides its own independent budget forecasts works, in that it reduces the bias in projections.  Euro area governments with an independent budget forecasting institution have a mean bias when making forecasts while in violation of the Excessive Deficit Procedure (EDP) that is smaller by 2.7% of GDP [at the one-year horizon], compared to euro area countries that are in violation of the EDP without such an independent fiscal institution.

    It would be better still if the governments were legally bound to use these independent forecasts in their budget plans (thereby borrowing an innovation from Chile).  

   Regardless how well-designed the rules are, clever and determined politicians can find ways around them.  One of the tricks is the privatization of government enterprises which reduces the budget deficit this year on a one-time non-repeatable basis, but might raise it in the long-term if the enterprise had been earning profits.  Another trick is phony legislated sunsets on tax cuts, in order to make future revenues look larger despite the political intention later to make the tax cuts permanent. 

   Still, other things equal, the right institutions can reduce the procyclicality of fiscal policy in the short run and help deliver debt sustainability in the long run.    Examples of the right institutions are cyclically adjusted budget targets combined with independent agencies that make independent fiscal forecasts.  Things can still go wrong even if such mechanisms are in place; but, as the history of the SGP illustrates, the risk is higher if they are not.

     [The original of this post appears at Project Syndicate.  Comments may be posted there.]

Why do so many countries so often wander far off the path of fiscal responsibility? Concern about budget deficits has become a burning political issue in the United States, has helped persuade the United Kingdom to enact stringent cuts despite a weak economy, and is the proximate cause of the Greek sovereign-debt crisis, which has grown to engulf the entire eurozone. Indeed, among industrialized countries, hardly a one is immune from fiscal woes.

Clearly, part of the blame lies with voters who don’t want to hear that budget discipline means cutting programs that matter to them, and with politicians who tell voters only what they want to hear. But another factor has attracted insufficient notice: systematically over-optimistic official forecasts.

Such forecasts underlie governments’ failure to take advantage of boom periods to strengthen their finances, including running budget surpluses. During the expansion of 2001-2007, for example, the US government made optimistic budget forecasts at each stage.  These forecasts supported enacting big long-term tax cuts and accelerating growth in spending (both military and domestic).  European countries behaved similarly, running up ever-higher debts.  Predictably, when global recession hit in 2008, most countries had little or no “fiscal space” to implement countercyclical policy.

In most cases, the problems have long been plain for objective observers to see, but public officials kept their heads buried in the sand.  Over the period 1986-2009, the bias in official U.S. deficit forecasts averaged 0.4 % of GDP at the one-year horizon, 1% at two years, and 3.1% at three years.  Forecasting errors were particularly damaging during the past decade.  The U.S. government in 2001-03, for example, was able to enact large tax cuts and accelerated spending measures by forecasting that budget surpluses would remain strong.   The Office of Management and Budget long turned out optimistic budget forecasts, no matter how many times it was proven wrong.   For eight years, it never stopped forecasting that the budget would return to surplus by 2011, even though virtually every independent forecast showed that deficits would continue into the new decade unabated.

How were American officials in the last decade able to make forecasts that departed so far from subsequent reality?   In three sorts of ways.  The first comes in the form of optimistic baseline macroeconomic assumptions such as a high and everlasting growth rate.  OMB forecasts of economic growth were biased upward:  by a huge 3.8% at the three-year horizon.

Second, some politicians argued that tax cuts were consistent with fiscal discipline by appealing to two fanciful theories:   the Laffer Proposition, which says that cuts in tax rates will pay for themselves via higher economic activity, and the Starve the Beast Hypothesis, which says that tax cuts will increase the budget deficit but that this will put downward pressure on federal spending. 

Sanguine macroeconomic assumptions will do the job in the context of OMB forecasts and fanciful theories about the effects of tax cuts can deliver the rosy scenarios of presidential speeches.  But to get optimistic fiscal forecasts out of the Congressional Budget Office a third, more extreme, strategy was required.  (In 2003, when some Lafferite congressmen tried to get CBO to say that “dynamic scoring” of the effects of  tax rate cuts would show higher revenue, the estimates from the independent agency did not give the answer they wanted.) 

To understand the third strategy, begin with the requirement that CBO’s baseline forecasts must take their tax and spending assumptions from current law.   Elected officials in the last decade therefore hard-wired over-optimistic budget forecasts from CBO by excising from current law expensive policies that they had every intention of pursuing in the future.  Often they were explicit about the difference between their intended future policies and the legislation that they wrote down. 

Four examples: (i) the continuation of wars in Afghanistan and Iraq (which were paid for with “supplemental” budget requests when the time came, as if they were an unpredictable surprise); (ii) annual revocation of purported cuts in payments to doctors that would have driven them out of Medicare if ever allowed to go into effect; (iii) annual patches for the Alternative Minimum Tax (which otherwise threatened to expose millions of middle class families to taxes that had never been intended to apply to them); and (iv) the intended extension in 2011 of the income tax cuts and estate tax abolition that were legislated in 2001 with a sunset provision for 2010, which most lawmakers knew would be difficult to sustain.    All four are examples of expensive policy measures that Congress fully intended would take place, but that it excluded from legislation so that the official forecasts would misleadingly appear to show smaller deficits and a return to surplus after 2010.

Unrealistic macroeconomic assumptions, fanciful theories about tax cuts, and legislation that deliberately misrepresented policy plans all worked as intended, yielding over-optimistic forecasts.  These in turn help to explain excessive budget deficits. In particular, they explain the failure to run surpluses during the economic expansion from 2002-2007: if growth is projected to last indefinitely, retrenchment is regarded as unnecessary.

Many have suggested that budget woes can best be held in check through fiscal-policy rules such as deficit or debt caps. Some countries have already enacted laws along these lines.  The most important and well-known example is the eurozone’s fiscal rules, which supposedly limit budget deficits to 3% of GDP and public debt to 60% of GDP for countries to join.  The European Union’s Stability and Growth Pact (SGP) dictated that member countries must continue to meet the criteria.   We have now seen how well that worked out.

Other countries have also adopted fiscal rules, most of which fail.  Switzerland’s structural budget rule (”debt brake”) is well-designed to allow higher deficits in recessions automatically, counterbalanced by surpluses in expansion periods. But the success of any budget rule depends on accurate forecasts of government spending and revenues. Getting those forecasts right has proven to be difficult for most countries.

Part of the problem is that governments that are subject to budget rules, such as Europe’s SGP, put out official forecasts that are even more biased than the US or other countries.  The Greek government, for example, in 2000 projected that its fiscal deficit would shrink below 2% of GDP one year in the future and below 1% of GDP two years into the future, and that the fiscal balance would swing to surplus three years into the future. The actual balance was a deficit of 4-5% of GDP - well above the EU’s 3%-of-GDP ceiling.

In almost all industrialized countries, official forecasts have an upward bias, which is stronger at longer horizons. On average, the gap between the projected budget balance and the realized balance among a set of 33 countries is 0.2% of GDP at the one-year horizon, 0.8 % at the two-year horizon, and 1.5 % at the three-year horizon.  So, how can governments’ tendency to satisfy fiscal targets by wishful thinking be overcome? In 2000, Chile created structural budget institutions that may have solved the problem. Independent expert panels, insulated from political pressures, are responsible for estimating the long-run trends that determine whether a given deficit is deemed structural or cyclical.

The result is that, unlike in most industrialized countries, Chile’s official forecasts of growth and fiscal performance have not been overly optimistic, even in booms. The ultimate demonstration of the success of the country’s fiscal institutions:  unlike many countries in the North, Chile took advantage of the 2002-2007 expansion to run substantial budget surpluses, which enabled it to loosen fiscal policy in the 2008-2009 recession. Perhaps other countries should follow its lead.

[A shorter version of this op-ed was published by Project Syndicate.   It draws on several recent academic publications of mine, especially "Over-optimism in Forecasts by Official Budget Agencies and Its Implications,"  Oxford Review of Economic Policy  27, no.4, 2011, 536-562.]