On the inaccuracies of macroeconomic observations

Peter A.G. van Bergeijk; Peter A.G. van Bergeijk

doi:10.3934/NAR.2024017

National Accounting Review

2024, Volume 6, Issue 3: 367-383. doi: 10.3934/NAR.2024017

Previous Article Next Article

Research article

On the inaccuracies of macroeconomic observations

Peter A.G. van Bergeijk ^,

International Institute of Social Studies (ISS), Erasmus University Rotterdam, Kortenaerkade 12, 2518, AX, The Hague, the Netherland

Received: 05 June 2024 Revised: 17 August 2024 Accepted: 06 September 2024 Published: 11 September 2024
JEL Codes: A1, E01, C18

Transparency about measurement errors in macroeconomic statistics is lacking. Inaccuracy is usually acknowledged only during extraordinary situations or under specific policy demands. Despite advances in technology and methodology, the overall accuracy has not improved due to economic changes and new complex activities. Even striking historical efforts did not change the persistence of substantial inaccuracies and biases. While the pioneers of national accounting addressed inaccuracies by using multiple accounting approaches and transparently reported error estimates, current statistical offices and other data producers rarely publish error measures, thereby creating an illusion of precision. Best practices and new measurement methods, such as satellite observation, Big Data, and Artificial Intelligence, promise improvements but face significant challenges without clear standards and an awareness of measurement error and bias. Regular and transparent reporting of measurement errors is and will be essential to improve the data reliability. Empowering data users—funding agencies, academics, and journalists—through error reporting and education can challenge the status quo.
- measurement error,
- gross planetary product,
- national accounting,
- International Monetary Fund,
- empowerment,
- education
Citation: Peter A.G. van Bergeijk. On the inaccuracies of macroeconomic observations[J]. National Accounting Review, 2024, 6(3): 367-383. doi: 10.3934/NAR.2024017

Related Papers:

Abstract

Transparency about measurement errors in macroeconomic statistics is lacking. Inaccuracy is usually acknowledged only during extraordinary situations or under specific policy demands. Despite advances in technology and methodology, the overall accuracy has not improved due to economic changes and new complex activities. Even striking historical efforts did not change the persistence of substantial inaccuracies and biases. While the pioneers of national accounting addressed inaccuracies by using multiple accounting approaches and transparently reported error estimates, current statistical offices and other data producers rarely publish error measures, thereby creating an illusion of precision. Best practices and new measurement methods, such as satellite observation, Big Data, and Artificial Intelligence, promise improvements but face significant challenges without clear standards and an awareness of measurement error and bias. Regular and transparent reporting of measurement errors is and will be essential to improve the data reliability. Empowering data users—funding agencies, academics, and journalists—through error reporting and education can challenge the status quo.

References

[1]	Abeln B, Jacobs JPAM (2022) COVID-19 and seasonal adjustment. J Bus Cycle Res 18: 159–169. https://doi.org/10.1007/s41549-022-00071-z doi: 10.1007/s41549-022-00071-z
[2]	Akritidis L (2002) Accuracy assessment of National Accounts statistics. Economic Trends, 38–53. Available from: https://escoe-website.s3.amazonaws.com/wp-content/uploads/2020/01/01233815/ET-589-Accuracy-assessment-of-national-accounts-statistics-L-Akritidis-Dec-2002.pdf.
[3]	Biddle J, Boumans M (2021) Exploring the History of Statistical Inference in Economics: Introduction. Hist Polit Econ 53: 1–24. https://doi.org/10.1215/00182702-9414747 doi: 10.1215/00182702-9414747
[4]	Bos F (2009) The National Accounts as a Tool for Analysis and Policy: In View of History, Economic Theory and Data Compilation Issue.
[5]	Boskin MJ, Dulberger ER, Gordon RJ, et al. (1996) Toward a more accurate measure of the cost of living: final report to the Senate Finance Committee, Advisory Commission to Study the Consumer Price Index, United States Congress, Washington D.C. Available from: https://www.ssa.gov/history/reports/boskinrpt.html.
[6]	Centraal Bureau voor de Statistiek, Statistics Netherlands (1953) Nationale jaarrekeningen 1948–1950, CBS: Voorburg.
[7]	Comim F (2001) Richard Stone and measurement criteria for national accounts. Hist Polit Econ 33: 213–234. https://doi.org/10.1215/00182702-33-Suppl_1-213 doi: 10.1215/00182702-33-Suppl_1-213
[8]	Coyle D (2017) The future of the national accounts: Statistics and the democratic conversation. Rev Income Wealth 63: S223–237. https://doi.org/10.1111/roiw.12333 doi: 10.1111/roiw.12333
[9]	de Jonge E (2020) Communicating uncertainties in official statistics—A review of communication methods. Available from: https://ec.europa.eu/eurostat/documents/3888793/12135507/KS-TC-20-011-EN-N.pdf/b2ee60fe-ed5b-ad3e-05bd-56f6b87dfec0?t = 1609752126728.
[10]	Du Rietz S (2024) Accounting for GDP—A study of epistemic strategies when calculating the quarterly economy. Account Organ Soc 112: 101522. https://doi.org/10.1016/j.aos.2023.101522 doi: 10.1016/j.aos.2023.101522
[11]	Fariss CJ, Anders T, Markowitz JN, et al. (2022) New estimates of over 500 years of historic GDP and population data. J Confl Resolut 66: 553–591. https://doi.org/10.1177/00220027211054432 doi: 10.1177/00220027211054432
[12]	Feldstein M (2017) Underestimating the real growth of GDP, personal income, and productivity. J Econ Perspect 31: 145–164. https://doi.org/10.1257/jep.31.2.145 doi: 10.1257/jep.31.2.145
[13]	Goolsbee AD, Klenow PJ (2018) Internet rising, prices falling: Measuring inflation in a world of e-commerce. AEA papers and proceedings 108: 488–492. https://doi.org/10.1257/pandp.2018103 doi: 10.1257/pandp.2018103
[14]	Grassman S (1983) Comments, In: von Furstenberg, G.M. (ed.), International money and credit: the policy rules, IMF, Washington DC, 248–252. https://doi.org/10.5089/9780939934270.071
[15]	Griliches Z (1994) Productivity, R&D, and the Data Constraint. Am Econ Rev 84: 1–23.
[16]	Guberek T (2019) Data Dilemmas: The Science and Politics of Communicating Uncertainty in Human Rights Information, PhD thesis University of Michigan: Ann Arbor.
[17]	Harchaoui TK, Kaci M, Maynard JP, et al. (2004) The Statistics Canada Productivity Program: Methodology 2000, Statistics Canada, Ontario.
[18]	Hu Y, Yao J (2022) Illuminating economic growth. J Econom 228: 359–378. https://doi.org/10.1016/j.jeconom.2021.05.007 doi: 10.1016/j.jeconom.2021.05.007
[19]	Indaco A (2020) From twitter to GDP: Estimating economic activity from social media. Reg Sci Urban Econ 85. https://doi.org/10.1016/j.regsciurbeco.2020.103591 doi: 10.1016/j.regsciurbeco.2020.103591
[20]	International Monetary Fund (1983) Statistical asymmetry in global current account balances, In: World Economic Outlook, IMF, Washington DC, 16–17.
[21]	International Monetary Fund (1987) Report on the World Current Account Discrepancy. IMF, Washington, DC.
[22]	International Monetary Fund (1992) Report on the Measurement of International Capital Flows. IMF, Washington, DC.
[23]	Jerven M (2013) Poor Numbers: How We Are Misled by African Development Statistics and What to Do about It, Cornell University Press: Ithaca.
[24]	Kenessey Z (1997) A perspective on the accuracy of economic observations. Int Stat Rev 65: 247–259.
[25]	Knibbe M (2019) Macroeconomic measurement versus macroeconomic theory, London: Routledge. https://doi.org/10.4324/9781351136709
[26]	Kuznets S (1941) National Income and its composition, 1918–1938, NBER: New York.
[27]	Kuznets S (1950) Review of On the Accuracy of Economic Observations by Oskar Morgenstern. J Am Stat Assoc 45: 576–579. https://doi.org/10.1080/01621459.1950.10501149 doi: 10.1080/01621459.1950.10501149
[28]	Linsi L, Tanaka S, Giumelli F, et al. (2023) Measuring the unmeasurable: The politics of guestimates, 2022 International Political Economy Society Conference, Pittsburg.
[29]	Manski CF (2011) Policy analysis with incredible certitude. Econ J 121: F261–F289. https://doi.org/10.1111/j.1468-0297.2011.02457.x doi: 10.1111/j.1468-0297.2011.02457.x
[30]	Manski CF (2015) Communicating uncertainty in official economic statistics: An appraisal fifty years after Morgenstern. J Econ Lit 53: 631–653. http://dx.doi.org/10.1257/jel.53.3.631 doi: 10.1257/jel.53.3.631
[31]	Manski CF (2020) The lure of incredible certitude. Econ Philos 36: 216–245. https://doi.org/10.1017/S0266267119000105 doi: 10.1017/S0266267119000105
[32]	Matolcsy G, Nagy M, Palotai D, et al. (2020) Inflation in the digital age: Inflation measurement and bias in the 21st Century. Financ Econ Rev 19: 5–36. https://doi.org/10.33893/FER.19.1.536 doi: 10.33893/FER.19.1.536
[33]	Meader R, Tily G (2008) Monitoring the quality of the National Accounts. Econ Lab Market Rev 2: 24–33. https://doi.org/10.1057/elmr.2008.39 doi: 10.1057/elmr.2008.39
[34]	Meng XL (2018) Statistical paradises and paradoxes in big data: law of large populations, big data paradox, and the 2016 us presidential election. Ann Appl Stat 12: 685–726. https://doi.org/10.1214/18-AOAS1161SF doi: 10.1214/18-AOAS1161SF
[35]	Mitchell WC, King WI, Macaulay FR (1922) Income in the United States, Its Amount and Distribution, 1909–1919: Detailed report, Brace: Harcourt.
[36]	Morgenstern O (1950) On the Accuracy of Economic Observations, Princeton University Press: Princeton.
[37]	Morgenstern O (1963) On the Accuracy of Economic Observations, (2^nd completely revised edition), Princeton University Press: Princeton.
[38]	Moulton BR (2018) The measurement of output, prices, and productivity: What's Changed Since the Boskin Commission?, The Hutchins Center on Fiscal and Monetary Policy, Brookings Institution: Washington, DC.
[39]	Nordhaus W, Chen XI (2015) A sharper image? Estimates of the precision of nighttime lights as a proxy for economic statistics. J Econ Geogr 15: 217–246. https://doi.org/10.1093/jeg/lbu010 doi: 10.1093/jeg/lbu010
[40]	O'Brien ES (1998) Contested accounts: the evolution of the meaning and measurement of national income, PhD thesis University of Notre Dame: Notre Dame, Indiana.
[41]	Obstfeld MO, Hemmati M, Milesi-Ferretti GM, et al. (2015) The choice of numeraire matters when calculating world GDP growth.
[42]	Reiss J (2008) Error in Economics: Towards a More Evidence-Based Methodology, Routledge.
[43]	Stone R, Champernowne DG, Meade JE (1942) The precision of national income estimates. Rev Econ Stud 9: 111–125. https://doi.org/10.2307/2967664 doi: 10.2307/2967664
[44]	Tiozzo-Pezzoli L, Tosetti E (2022) Seismonomics: Listening to the heartbeat of the economy. J R Stat Soc Ser A-Stat Soc 185: S288–S309. https://doi.org/10.1111/rssa.12912 doi: 10.1111/rssa.12912
[45]	van Bergeijk PAG (2013) Earth Economics: An Introduction to Demand Management, Long-Run Growth and Global Economic Governance, Edward Elgar: Cheltenham.
[46]	van Bergeijk PAG (2024) On the inaccuracies of economic observations: Why and How We Could Do Better Edward Elgar: Cheltenham.
[47]	van Delden A, Scholtus S, Burger J, et al. (2023) Accuracy of Estimated Ratios as Affected by Dynamic Classification Errors. J Surv Stat Methodol 11: 942–66. https://doi.org/10.1093/jssam/smac015 doi: 10.1093/jssam/smac015
[48]	van der Bles AM, van der Linden S, Freeman ALJ et al. (2019) Communicating uncertainty about facts, numbers and science. R Soc Open Sci 6: 181870. https://doi.org/10.1098/rsos.181870 doi: 10.1098/rsos.181870

Reader Comments

Your name:*

Email:*
© 2024 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)