BazEkon - The Main Library of the Cracow University of Economics

BazEkon home page

Main menu

Author
Payson Steven
Title
Cite This Economics Paper! It Is Time for the House of Cards to Fall Down
Source
Open Economics, 2019, vol. 2, iss. 1, s. 1-18, bibliogr. 17 poz.
Keyword
Pracownicy naukowi, Ewaluacja, Ekonomia
Academic staff, Evaluation, Economics
Note
summ.
Abstract
This paper takes a fresh look at citation counts and publications in top-rank journals, which the academic economics profession uses to evaluate and promote its members. It first examines how and why citations are mentioned in an article, and what this implies about their counts. The discussion then examines how average citation counts to articles are used to rank journals, and the paper reviews the concerns that have been expressed about this practice. These concerns identify the large variance in citation counts among articles of the same journal, implying that those articles themselves must vary greatly in quality (Engemann and Wall 2009). To address these concerns, the paper proposes the classification of citations into three categories: Fodder Citations (for references that contribute only trivially to a paper), Relevant Citations (which substantively contribute to the paper, though the paper would remain roughly the same without them), and Essential Citations (which have a major influence). The paper argues that counts of citations by the last two categories offers greater credibility in the application of citation counts to evaluate economic literature. Finally, the paper provides an opportunity for economists to participate in a new project that solicits information on citations by these categories.(original abstract)
Full text
Show
Bibliography
Show
  1. In accordance with the classification of citations in this paper {"Payson (2019)" as it should be listed in future papers}, the Essential Citations for this paper were Colussi (2018), Engemann and Wall (2009), Heckman and Moktan (2018), and Payson (2017), and the additional Relevant Citations were Akerlof (2018) and Stern (2013).
  2. Akerlof, G. A. (2018, January 5-7). Sins of Omission and the Practice of Economics. Paper presented on Annual Meetings of the American Economic Association, Philadelphia, PA.
  3. Bergstrom, C. (2007). Eigenfactor: Measuring the Value and Prestige of Scholarly Journals. College and Research Libraries News, 68 (5), 314-16.
  4. Bollen, J., Van de Sompel, H., Hagberg, A., & Chute, R. (2009). A Principal Component Analysis of 39 Scientific Impact Measures. PLoS One, 4 (6), e6022.
  5. Bostaph, S. (2018) Book Review: How Economics Professors Can Stop Failing Us. Quarterly Journal of Austrian Economics, 21 (1), 79-86.
  6. Card, D., & DellaVigna, S. (2013). Nine Facts About Top Journals in Economics. Journal of Economic Literature, 51 (1), 144-161.
  7. Colussi, T. (2018). Social Ties in Academia: A Friend is a Treasure. The Review of Economics and Statistics, 100 (1), 45-50.
  8. Engemann, K. M., & Wall, H. (2009). A Journal Ranking for the Ambitious Economist. Federal Reserve Bank of St. Louis Review, 90 (3), 127-39.
  9. Hamermesh, D., (2015). Citations in Economics: Measurement, Uses and Impacts. Working Paper No. 21754. National Bureau of Economic Research.
  10. Heckman, J. & Moktan, S. (2018). "Publishing and Promotion in Economics: The Tyranny of the Top Five," National Bureau of Economic Research Working Paper.
  11. Kalaitzidakis, P, Mamuneas, T. P., & Stengos, T. (2003). Rankings of Academic Journals and Institutions in Economics. Journal of the European Economic Association 1 (6), 1346-66.
  12. Laband, D. N., & Piette, M. J. (1994). The Relative Impacts of Economics Journals: 1970-1990. Journal of Economic Literature, 32 (2), 640-66.
  13. Liebowitz, S. J., & Palmer, J. P. (1984). Assessing the Relative Impacts of Economics Journals. Journal of Economic Literature, 22 (1), 77-88.
  14. Moed, H. F. (2010). Measuring Contextual Citation Impact of Scientific Journals. Journal of Informetrics, 4 (3), 265-77.
  15. Ӧnder, A., & Terviӧ, M. (2015). Is Economics a House Divided? Analysis of Citation Networks. Economic Inquiry. 53 (3), 1491-1505.
  16. Oswald, A. J. (2007). An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers. Economica, 74 (293), 21-31.
  17. Palacios-Huerta, I., & Volij, O. (2004). The Measurement of Intellectual Influence. Econometrica, 72 (3): 963-77.
  18. Payson, S. (2017). How Economics Professors Can Stop Failing Us: The Discipline at a Crossroads. Lanham, MD: Rowman and Littlefield.
  19. Powdthavee, N., Riyanto, Y. E., & Knetsch, J. L. (2017). Impact of Lower Rated Journals on Economists' Judgments of Publication Lists: Evidence from a Survey Experiment. IZA Discussion Papers 10752, Institute for the Study of Labor (IZA).
  20. Powdthavee, N., Knetsch, J., & Riyanto, Y., (2018, January 5-7). Negative Impact of Lower Rated Journals on Economists' Judgments of Publication Lists: Evidence from a Survey Experiment. Paper presented on Annual Meetings of the American Economic Association, Philadelphia, PA. https://tinyurl.com/ycy69mbe.
  21. Pinski, G., & Narin, F. (1976). Citation Influence for Journal Aggregates of Scientific Publications: Theory, with Application to the Literature of Physics. Information Processing and Management, 12 (5), 297-312.
  22. RePEc. (2018a). Ideas now has a fantasy League. The RePEc Blog. Accessed August 5, 2018. https://tinyurl.com/yamn5wye.
  23. RePEc. (2018b). Ideas Fantasy League. Accessed August 5, 2018. https://ideas.repec.org/fantasy.html.
  24. RePEc. (2018c). Top 10% Authors, as of July 2018. Accessed August 11, 2018. https://ideas.repec.org/top/top.person.all.html.
  25. Stern, D. I. (2013). Uncertainty Measures for Economics Journal Impact Factors. Journal of Economic Literature, 51 (1), 173-189.
  26. Wall, H. J. (2009). Journal Rankings in Economics: Handle with Care. Working Paper No. 2009-014A. Federal Reserve Bank of St. Louis.
  27. Zimmerman, C. (2012). Academic Rankings with RePEc. Working Paper 2012-023A. Federal Reserve Bank of St. Louis.
Cited by
Show
ISSN
2451-3458
Language
eng
URI / DOI
https://doi.org/10.1515/openec-2019-0001
Share on Facebook Share on Twitter Share on Google+ Share on Pinterest Share on LinkedIn Wyślij znajomemu