Liberty Street Economics

« Working as a Barista After College Is Not as Common as You Might Think | Main | Crisis Chronicles: The Gold Panic of 1869, America’s First Black Friday »

January 13, 2016

Fundamental Disagreement: How Much and Why?


Everyone disagrees, even professional forecasters, especially about big economic questions. Has potential output growth changed since the financial crisis? Are we bound for a period of “secular stagnation”? Will the European economy rebound? When is inflation getting back to mandate-consistent level? In this post, we document to what degree professional forecasters disagree and discuss potential reasons why.

In a recent working paper, we document a set of novel facts about disagreement among professional forecasters over the last thirty years. We focus on the “trinity” of U.S. output growth, inflation, and the policy rate for different forecast horizons with particular emphasis on the very long run.

Some Facts about Disagreement in the Long Run
The chart below shows the average disagreement for the trinity of variables for the years 1986-2013 for professional forecasts ranging from one quarter (Q1) to six-to-eleven years (Y6-11) ahead. The forecast disagreement comes from the Blue Chip Financial Forecasts (BCFF) survey, which we have used previously to understand reactions to the August 2011 Federal Open Market Committee (FOMC) statement. This survey has been conducted monthly since the early 1980s and asks participants to provide forecasts at different horizons. It is the longest-running survey that includes forecasts at short, medium, and long horizons for our three key U.S. macroeconomic variables. This breadth ensures that we can study forecaster disagreement through different phases of the U.S. economy such as the disinflationary period over the 1980s and the Great Moderation. We measure disagreement as the difference between the average top ten and bottom ten forecasts in the survey.

The Average Term Structure of Disagreement

The chart shows that forecasters disagree about output growth and inflation, not just in the coming quarters, but also at very long horizons. Furthermore, disagreement about the long run—which we call “fundamental disagreement”—can be lower, higher, or the same as disagreement for short forecast horizons. Most notably, forecasters disagree very little about the near-term outlook for the policy rate, but substantially about its long-run value. For example, at the longest forecast horizon the difference between the forecast of the highest ten responses and the lowest ten responses has, on average, been a sizable two percentage points!

The next chart shows that disagreement varies considerably over time. For example, disagreement about the federal funds rate and about CPI inflation has declined substantially since the end of the 1990s, potentially due to enhanced price stability and increased FOMC transparency. Meanwhile, disagreement increased notably about the future path of policy in the aftermath of the financial crisis and the last recession.

Long-Run Disagreement (Y6-11) in the Last 30 Years

So why do forecasters disagree?
What factors drive forecasters’ disagreement? We argue that professional forecasters (and the rest of us) face two important challenges stemming from their “imperfect information” about the economic environment.

First, they only have a foggy view of current economic conditions. For example, GDP data are released with a delay and are subject to major revisions. As a result, forecasters have to produce their own “nowcasts” of this variable. Even if their assessments of current economic conditions are based on the same publicly available data, forecasters interpret the data in different ways. For example, unusually harsh or mild weather would likely affect GDP growth, but forecasters are likely to disagree about its quantitative effects. And while forecasters observe multiple price and cost indexes, those are only noisy measures of underlying inflation trends. Of course, one variable for which all forecasters have a clear view is the federal funds rate which is published daily. However, forecasters can still disagree about its future value since the level of the federal funds rate depends on future values of inflation and output growth reflecting the reaction function of the FOMC.

Second, forecasters need to filter from the observed changes in economic conditions the temporary factors from the slow-moving, permanent components of the variables of interest (such as changes to potential output growth). By their very nature, the slow-moving components are very difficult to detect, especially when the economy is being buffeted by multiple shocks as it was during and after the financial crisis.

In our working paper, we introduce a simple model which embeds these two factors—uncertainty about current conditions and the difficulty of distinguishing temporary from permanent changes. Our results suggest that both factors are important to match the observed data and, in particular, the second challenge is crucial to explain fundamental disagreement.

In the charts below, the gold line corresponds to a model where forecasters do not need to parse temporary from permanent changes to the economy, while the gray line represents a model which embeds both challenges. Clearly, the former model fails to replicate the observed term structure of disagreement even only a few quarters out. The failure is starkest for the long-run forecast of the federal funds rate.

Explaining the Term Structures of Disagreement

So which factor caused the elevated level of disagreement about the future path of policy after the financial crisis? It is unlikely that the quality and availability of data has changed over the last few years. Instead, it is more likely that the elevated disagreement reflects the difficulty in teasing out whether there have been meaningful permanent changes to the U.S. economy. Our model suggests that disagreement about the medium-term evolution of the policy rate can be explained in roughly equal parts by disagreement about medium-term inflation and output growth expectations and disagreement about the longer-term value of the policy rate.

The views expressed in this post are those of the authors and do not necessarily reflect the position of the Federal Reserve Bank of New York or the Federal Reserve System. Any errors or omissions are the responsibility of the authors.

Richard CrumpRichard Crump is an assistant vice president in the Federal Reserve Bank of New York’s Research and Statistics Group.

Stefano Eusepi Stefano Eusepi is an assistant vice president in the Federal Reserve Bank of New York’s Research and Statistics Group.
Posted by Blog Author at 07:00:00 AM in Forecasting, Macroecon

Feed You can follow this conversation by subscribing to the comment feed for this post.

The comments to this entry are closed.

About the Blog
Liberty Street Economics features insight and analysis from economists working at the intersection of research and policy. The editors are Michael Fleming, Andrew Haughwout, Thomas Klitgaard, and Donald Morgan.

The views expressed are those of the authors, and do not necessarily reflect the position of the New York Fed or the Federal Reserve System.

Economic Research Tracker

Liberty Street Economics is now available on the iPhone® and iPad® and can be customized by economic research topic or economist.

Useful Links
Comment Guidelines
We encourage your comments and queries on our posts and will publish them (below the post) subject to the following guidelines:
Please be brief: Comments are limited to 1500 characters.
Please be quick: Comments submitted after COB on Friday will not be published until Monday morning.
Please be aware: Comments submitted shortly before or during the FOMC blackout may not be published until after the blackout.
Please be on-topic and patient: Comments are moderated and will not appear until they have been reviewed to ensure that they are substantive and clearly related to the topic of the post. We reserve the right not to post any comment, and will not post comments that are abusive, harassing, obscene, or commercial in nature. No notice will be given regarding whether a submission will or will not be posted.‎
Disclosure Policy
The LSE editors ask authors submitting a post to the blog to confirm that they have no conflicts of interest as defined by the American Economic Association in its Disclosure Policy. If an author has sources of financial support or other interests that could be perceived as influencing the research presented in the post, we disclose that fact in a statement prepared by the author and appended to the author information at the end of the post. If the author has no such interests to disclose, no statement is provided. Note, however, that we do indicate in all cases if a data vendor or other party has a right to review a post.