Liberty Street Economics

« | Main | »

April 19, 2017

Is Chinese Growth Overstated?


LSE_Is Chinese Growth Overstated?

For analysts of the Chinese economy, questions about the accuracy of the country’s official GDP data are a frequent source of angst, leading many to seek guidance from alternative indicators. These nonofficial gauges often suggest Beijing’s growth figures are exaggerated, but that conclusion is not supported by our analysis, which draws upon satellite measurements of the intensity of China’s nighttime light emissions—a good proxy for GDP growth that is presumably not subject to whatever measurement errors may affect the country’s official economic statistics.

Doubts about the Data

In the eyes of many observers, China’s economy seemed to be entering a tailspin in 2015, with a stock market crash in June followed by a surprise currency devaluation in August. And yet, the official GDP data showed growth slowing hardly at all, ticking down to 6.8 percent at the end of the year from 7.2 percent in 2014. The financial press pounced on these “questionable” statistics, often citing a now-famous 2007 exchange between Premier Li Keqiang, then the Communist Party secretary of Liaoning Province, and U.S. Ambassador Clark Randt. Li admitted that he preferred to assess the state of Liaoning’s economy by averaging the growth rates of electricity production, rail freight, and bank loans, adding that official statistics were “man-made” and “for reference only.”

Li’s metric—since dubbed the “Li Keqiang index”—has declined for four of the past six years, recording an especially precipitous drop in 2015. Such signals have prompted many observers to believe the Chinese economy is weaker than official statistics portray it to be (notwithstanding the fact that the index rose over the course of 2016).

Skeptical of the official numbers, many Wall Street analysts have constructed their own models of Chinese economic growth, combining elements of the Li Keqiang index with statistics on retail sales, construction, and other types of activity. Many of these measures suggested that Chinese economic growth in the last quarter of 2015 was indeed much lower than the official rate of 6.8 percent—with the “true” figure often claimed to be less than 5 percent, or even below 3 percent.

Imperfect Alternatives

These nonofficial indexes are all based on assumptions about and models of the Chinese economy that are difficult to express, let alone test. Each model implies a particular set of weightings for a particular set of economic indicators, and changing these parameters would have profound implications. As the chart below shows, the components of the Li Keqiang index—the growth rates of electricity production, rail freight, and bank loans—have followed separate trajectories over the past twelve years. Placing greater weight on any of these inputs would produce a much different stream of GDP growth estimates.

Is Chinese Growth Overstated?

We see that the growth rate of bank loans has been very stable over time, hovering around 12-13 percent year over year, except during the financial crisis of 2008 and its immediate aftermath. Meanwhile, the rail freight growth series has shown a sustained decline over the past twelve years, reaching a low point in December 2015. This precipitous deceleration was one reason that market participants a year ago were so concerned that official statistics were not reflecting the true state of the Chinese economy. However, there are more innocuous explanations for the decline of rail freight growth, such as the structural transition of the Chinese economy from heavy industry toward services.

In light of the structural changes under way in the Chinese economy, we might devise a modified Li Keqiang index, placing more weight on the bank loans series than on the rail freight series (instead of weighting the three growth rate series equally). This approach would have sparked much less cause for concern at the end of 2015. But what weightings would be statistically sound? And, more fundamentally, how can we tell what the best set of weightings would be?

Satellite Readings

To resolve these issues, we need to develop a transparent, data-driven procedure centered on an independent gauge of Chinese economic growth—one whose measurement error is unrelated to those associated with the components of the Li Keqiang index. We argue that such an independent measure exists in the form of satellite-recorded data on the brightness of nighttime lights across Chinese provinces over time. It has been well established that growth in nighttime light intensity is a good proxy for economic growth. By gauging how well changes in different economic variables correlate to fluctuations in nighttime light intensity, we can see which series are more reliable as growth indicators.

The task of measuring the relationship between nighttime light intensity and true unobserved economic output is complicated by weather and atmospheric disturbances, both of which affect how light is captured by orbiting satellites. These errors are plausibly unrelated to those that dog conventional statistical measures, which are subject to systematic reporting errors by people and businesses, mistaken decisions by statistical agencies, or, in some cases, outright manipulation by government officials or economic actors. Hence, nighttime lights are useful as an “independent referee” to determine the quality of conventional statistical series.

The heart of our analysis—as detailed in our recent NBER paper—is a regression of growth in nighttime lights across Chinese provinces and over time on the growth rates of the various statistical series used to calculate the Li Keqiang index and the various indices devised by Wall Street analysts. Under our key assumption—that measurement errors in nighttime lights are independent of the measurement errors of the other variables utilized—the regression coefficients we obtain on the statistical series are proportional to the optimal weights that should be applied to these measures in order to derive predictions for true Chinese GDP growth.

This hypothesis holds for a variety of possible interrelationships between true GDP growth and nighttime lights growth. In particular, as long as true GDP growth and nighttime lights growth are correlated, we can allow this correlation to change over time or vary across different areas of China. The correlation between official GDP growth and nighttime lights growth is documented in the scatter plot below. Our regression also includes flexible factors that absorb any nationwide changes in nighttime light intensity (or economic growth). For example, if Chinese lighting technology changed during the time period of our analysis, leading to a proportional brightening of all Chinese lights, the weightings we derive for the components of our new GDP growth proxy would not be affected.

Is Chinese Growth Overstated?

Reweighting the Li Keqiang Index

We find that the components of the Li Keqiang index should not be assigned equal weighting, as is typically supposed. In fact, our analysis indicates that bank loan growth should be given six to eight times more weight than rail freight growth, with the optimal weighting on electricity production growth somewhere in between. Under additional assumptions (specifically, if we normalize our proxy to match the level and trend of official Chinese GDP growth before 2012), the implications of this reweighting on our optimal estimate of Chinese GDP growth are profound. We find that since 2012, our estimate of Chinese GDP growth was never appreciably lower, and was in many years higher, than the GDP growth rate reported in the official statistics. Adding other series besides those incorporated in the Li Keqiang index does not change our results.

The chart below presents the path of official Chinese GDP growth alongside our modified Li Keqiang index (with the weights determined by the nighttime lights regression). We place a 95 percent confidence interval around our prediction.

Is Chinese Growth Overstated?

Looking back at the prediction for the end of 2015, we can reject the dire growth-collapse scenarios that were suggested by some of the Wall Street indices at the time, with it being very unlikely that the true growth rate of China was much below 6 percent. On the contrary, while we generally can’t reject that the official growth estimates are correct, we also can’t reject that they have understated Chinese growth since 2012, with the true level being closer to the average seen in the 2005-12 period. Our results are consistent with work by Rosen and Bao, who argue that Chinese statistical services have chronically underestimated the size of the service sector. Rosen and Bao’s hypothesis is consistent with our finding that rail freight growth should receive less weight than the other indicators in the Li Keqiang index. Hence, as the Chinese economy becomes increasingly service-oriented, the (conventional) Li Keqiang index will likely send increasingly faulty signals about the state of China’s economy. In fact, our estimate for Chinese growth shows an appreciable acceleration in 2016, even as the official growth rate remained virtually unchanged.

It is important to understand the limitations of our analysis. While we present evidence that China’s growth was not as weak as claimed by some analysts in 2015 and is not experiencing a sharp slowdown right now, we have no way of saying whether the current pace of growth will be sustainable far into the future. The fact that bank loan growth appears to have been such a durable predictor of China’s overall economic growth raises some cause for concern. Should lending decline for some reason—if, for example, the assumptions underlying existing lending are found to be unwarranted—then the Chinese economy could experience considerable turmoil. Rather than dismissing such risks, our research simply indicates that, at present, there are few immediate indications that Chinese growth is being systematically overestimated.

Disclaimer

The views expressed in this post are those of the authors and do not necessarily reflect the position of the Federal Reserve Bank of New York or the Federal Reserve System. Any errors or omissions are the responsibility of the authors.



Hunter Clark
Hunter L. Clark is an assistant vice president in the Federal Reserve Bank of New York’s Research and Statistics Group.

Maxim Pinkovskiy
Maxim L Pinkovskiy is an economist in the Bank‘s Research and Statistics Group.

Xavier X. Sala-i-Martin is the Jerome and Matthew Grossman Professor of Economics at Columbia University.

How to cite this blog post:

Hunter L. Clark, Maxim L. Pinkovskiy, and Xavier X. Sala-i-Martin, “Is Chinese Growth Overstated?” Federal Reserve Bank of New York Liberty Street Economics (blog), April 19, 2017, http://libertystreeteconomics.newyorkfed.org/2017/04/is-chinese-growth-overstated.html.

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

Kent, eychenne: Thank you very much for your interest in our work. We are currently investigating employing this technique to look at economic activity in other countries, and look forward to posting results once we have them. Unfortunately, nighttime lights are a better indicator of economic growth in developing countries rather than in developed ones. In particular, until very recently, the satellites recording the lights had a maximum sensitivity that is close to the brightness of a typical developed-world city, which limited their ability to show lights brightening and dimming with developed country business cycles.

Talley: We are still doing research using these data and will likely update the blog with links to some data series once the project is concluded. Watch this blog for updates!

Andrew: Great question. In our analysis, we control for all general national trends in China, which should capture changes such as transitions to a different lighting technology. To alleviate the concern that such technology may be adopted differentially in more urban parts of China, we can also control for trends that vary by urbanization status, which does not affect our results.

Interesting research. Have you made allowances for the fact that cost of lighting has become very low with new technology? And therefore, the propensity to deploy has gone up significantly. ab

excellent question as their population grows together with its GDP. There is a possibility for more job opportunities as their economy is growing rapidly fast. Because majority of the companies across the globe are relying on china to create their products.

So, in examining this proxy, have you compared the same type of light data against known GDP data of other countries? If so, what were your findings?

How can I gain access to the data for your re-weighted Li Keqiang Index? For example, will you publish the time series on FRED?

Hello, fantastic for China ! Does it work for other zones ? US, Euro,… Thanks for your very interesting job

Excellent question. We believe that nighttime lights are, on average, a good proxy for economic growth, but that they also have large and random fluctuations that make them inconvenient to be used directly. A better (less noisy) proxy may be an appropriate index of more precisely measured variables that captures the signal that is present in the nighttime lights data. The extra steps allow us to compute this index – essentially, what weight we should place on each variable.

Excellent work gentlemen, and very interesting. Can I ask a naive question? If light emissions are such a good proxy for economic activity….why all the other steps? Why not just use their changes to measure growth?

The comments to this entry are closed.

About the Blog

Liberty Street Economics features insight and analysis from New York Fed economists working at the intersection of research and policy. Launched in 2011, the blog takes its name from the Bank’s headquarters at 33 Liberty Street in Manhattan’s Financial District.

The editors are Michael Fleming, Andrew Haughwout, Thomas Klitgaard, and Asani Sarkar, all economists in the Bank’s Research Group.

Liberty Street Economics does not publish new posts during the blackout periods surrounding Federal Open Market Committee meetings.

The views expressed are those of the authors, and do not necessarily reflect the position of the New York Fed or the Federal Reserve System.

Economic Research Tracker

Image of NYFED Economic Research Tracker Icon Liberty Street Economics is available on the iPhone® and iPad® and can be customized by economic research topic or economist.

Economic Inequality

image of inequality icons for the Economic Inequality: A Research Series

This ongoing Liberty Street Economics series analyzes disparities in economic and policy outcomes by race, gender, age, region, income, and other factors.

Most Read this Year

Comment Guidelines

 

We encourage your comments and queries on our posts and will publish them (below the post) subject to the following guidelines:

Please be brief: Comments are limited to 1,500 characters.

Please be aware: Comments submitted shortly before or during the FOMC blackout may not be published until after the blackout.

Please be relevant: Comments are moderated and will not appear until they have been reviewed to ensure that they are substantive and clearly related to the topic of the post.

Please be respectful: We reserve the right not to post any comment, and will not post comments that are abusive, harassing, obscene, or commercial in nature. No notice will be given regarding whether a submission will or will
not be posted.‎

Comments with links: Please do not include any links in your comment, even if you feel the links will contribute to the discussion. Comments with links will not be posted.

Send Us Feedback

Disclosure Policy

The LSE editors ask authors submitting a post to the blog to confirm that they have no conflicts of interest as defined by the American Economic Association in its Disclosure Policy. If an author has sources of financial support or other interests that could be perceived as influencing the research presented in the post, we disclose that fact in a statement prepared by the author and appended to the author information at the end of the post. If the author has no such interests to disclose, no statement is provided. Note, however, that we do indicate in all cases if a data vendor or other party has a right to review a post.

Archives