Portal de Periódicos da CAPES

Great Expectatrics: Great Papers, Great Journals, Great Econometrics

2011; Taylor & Francis; Volume: 30; Issue: 6 Linguagem: Inglês

10.1080/07474938.2011.586614

1532-4168

Chia‐Lin Chang, Michael McAleer, Les Oxley,

scientometrics and bibliometrics research

Abstract The article discusses alternative Research Assessment Measures (RAM), with an emphasis on the Thomson Reuters ISI Web of Science database (hereafter ISI). Some analysis and comparisons are also made with data from the SciVerse Scopus database. The various RAM that are calculated annually or updated daily are defined and analyzed, including the classic 2-year impact factor (2YIF), 2YIF without journal self-citations (2YIF*), 5-year impact factor (5YIF), Immediacy (or zero-year impact factor (0YIF)), Impact Factor Inflation (IFI), Self-citation Threshold Approval Rating (STAR), Eigenfactor score, Article Influence, C3PO (Citation Performance Per Paper Online), h-index, Zinfluence, and PI-BETA (Papers Ignored – By Even The Authors). The RAM are analyzed for 10 leading econometrics journals and 4 leading statistics journals. The application to econometrics can be used as a template for other areas in economics, for other scientific disciplines, and as a benchmark for newer journals in a range of disciplines. In addition to evaluating high quality research in leading econometrics journals, the paper also compares econometrics and statistics, alternative RAM, highlights the similarities and differences of the alternative RAM, finds that several RAM capture similar performance characteristics for the leading econometrics and statistics journals, while the new PI-BETA criterion is not highly correlated with any of the other RAM, and hence conveys additional information regarding RAM, highlights major research areas in leading journals in econometrics, and discusses some likely future uses of RAM, and shows that the harmonic mean of 13 RAM provides more robust journal rankings than relying solely on 2YIF. Keywords: Article influenceCited article influenceC3POEigenfactorIFIImmediacyImpact factors h-IndexPI-BETASTARResearch assessment measuresZinfluenceJEL Classification: C43C10Z0 ACKNOWLEDGMENTS The authors wish to thank Dennis Fok, Philip Hans Franses, Jan Magnus, the Editor and two referees for very helpful comments, suggestions, and discussions. For financial support, the first author acknowledges the National Science Council, Taiwan, the second author acknowledges the Australian Research Council, National Science Council, Taiwan, and the Japan Society for the Promotion of Science, and the third author acknowledges the Royal Society of New Zealand, Marsden Fund. Notes Data for econometrics (statistics) journals downloaded from ISI on April 28, 2010 (May 19, 2010) for all citations for 1988–2010. Econometric Reviews and Econometrics Journal have been included in ISI for only 2 years. Data for econometrics (statistics) journals downloaded from ISI on April 28, 2010 (May 19, 2010) for all citations for 1988–2010. Econometric Reviews and Econometrics Journal are not included, as the data for these two journals do not cover a full five-year period that is required to calculate 5YIF and Article Influence. Data downloaded from ISI on November 19, 2010. Data downloaded from ISI on November 19, 2010. Data downloaded from ISI on April 28, 2010. Data downloaded from ISI on April 28, 2010. Data downloaded from ISI on April 28, 2010. Data downloaded from ISI on April 28, 2010. Data downloaded from ISI on April 28, 2010. Data downloaded from ISI on April 28, 2010. Data downloaded from ISI on May 19, 2010. Data downloaded from ISI on May 19, 2010. Data downloaded from ISI on May 19, 2010. Data downloaded from ISI on May 19, 2010. Data downloaded from ISI on April 28, 2010. There are 7 Nobel Laureates in the 100 Most Highly Cited Papers in major econometrics journals. [K. J. Arrow (NL) has one citation (CES production function), though his significant contributions to economics would not generally be regarded as econometric in nature.] (1) Econometrica: 64 (9/10, 16/20, 24/30, 29/40, 35/50, 44/60, 51/70, 55/80, 59/90). (2) Journal of Econometrics (J. Econometrics): 17. (3) Review of Economics and Statistics (REStat): 12. (4) Journal of Business and Economic Statistics (JBES): 5. (5) Econometric Theory (ET): 1. (6) Journal of Applied Econometrics (J. Applied Econometrics): 1. Data downloaded from ISI on April 28, 2010. There are 7 Nobel Laureates in the 100 Most Highly Cited Papers in Econometrics, who contributed 9 distinct papers and 24 papers in total. The data were downloaded from Scopus on November 21, 2010. From the Scopus www site – 'about calculations'. Citations Total number of citations received by a journal in the year, considering all documents. Documents Total number of documents published in the journal in the year. % Not Cited Percentage of documents published in that year that have never been cited to date.