Abstract
Most studies investigating individual achievement in criminology and criminal justice equate total publications with scholarly productivity. The current study sought to broaden the definition of scholarly productivity by incorporating empirical indices of the quantity and quality of scholarly productivity and applying these indices to both total and first author publications. Analyses performed using publication and citation data from the top 100 criminology and criminal justice scholars over the past 5 years revealed that the total number of publications was no substitute for an integrated (quantity and quality) assessment. Results further indicated that averaging across the total publication and first author integrated models seemed to provide the fairest and most balanced assessment of scholarly productivity. It was also noted that compared to non-theoreticians, theoreticians were more likely to publish first author articles and fared significantly better when evaluated against the first author integrated model than when evaluated against the total publications integrated model. Use of these models to assess scholarly productivity in criminology, criminal justice, and other fields may be warranted.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
American Educational Research Association. (2013). Rethinking faculty evaluation: AERA report and recommendations on evaluating educational research, scholarship, and teaching in postsecondary education. Washington, DC: Author.
Bernard, T. J., Snipes, J. B., & Gerould, A. L. (2010). Vold’s theoretical criminology (6th ed.). New York: Oxford University Press.
Bornmann, L. (2012). Redundancies in H index variants and the proposal of the number of top-cited papers as an attractive indicator. Measurement, 10, 149–153.
Cohn, E. G., & Farrington, D. P. (2014). Publication productivity of criminologists. Journal of Criminal Justice Education, 25, 275–303.
Cohn, E. G., Farrington, D. P., & Iratzoqui, A. (2013). Most-cited scholars in criminology and criminal justice, 1986–2010. New York, NY: Springer.
Cohn, E. G., Farrington, D. P., & Sorensen, J. R. (2000). Journal publications of Ph.D. graduates from American criminology and criminal justice programs. Journal of Criminal Justice Education, 11, 35–49.
Copes, H., Khey, D. N., & Tewksbury, R. (2012). Criminology and criminal justice hit parade: Measuring academic productivity in the discipline. Journal of Criminal Justice Education, 23, 423–440.
Egghe, L. (2006). Theory and practice of the g-index. Scientometrics, 69, 131–152.
Englebrecht, T. D., Hanke, S. A., & Kuang, Y. (2008). An assessment of patterns of coauthorship for academic accountants within premier journals: Evidence from 1979–2004. Advances in Accounting, 9, 172–181.
Falagas, M. E., Pitsouni, E. I., Malietzis, G. A., & Pappas, G. (2008). Comparison of PubMed, Scopus, web of science, and Google scholar: Strengths and weaknesses. The FASEB Journal, 22, 338–342.
Gordon, R. A., & Vicari, P. J. (1992). Eminence in social psychology: A comparison of textbook citation, social sciences citation index, and research productivity rankings. Personality and Social Psychology Bulletin, 18, 26–38.
Harzing, A.W. (2007) Publish or perish (Release 4.6.4). Available from http://www.harzing.com/pop.htm.
Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. PNAS, 102, 16569–16572.
Jennings, W. G., Schreck, C. J., Sturtz, M., & Mahoney, M. (2008). Exploring the scholarly output of academic organization leadership in criminology and criminal justice: A research note on publication productivity. Journal of Criminal Justice Education, 19, 404–416.
Jogalekar, A. (2013). Theorists, experimentalists and the bias in popular physics. Scientific American. http://blogs.scientificamerican.com/the-curious-wavefunction/2013/06/03/popular-physics-is-there-an-experimentalist-in-the-house/.
Kleck, G., & Barnes, J. C. (2011). Article productivity among the faculty of criminology and criminal justice doctoral programs, 2005–2009. Journal of Criminal Justice Education, 22, 43–66.
Kulkarni, A. V., Aziz, B., Shams, I., & Busse, J. W. (2009). Comparisons of citations in Web of science, Scopus, and Google scholar for articles published in general medical journals. JAMA, 302, 1092–1096.
Long, H., Boggess, L. N., & Jennings, W. G. (2011). Re-assessing publication productivity among academic “stars” in criminology and criminal justice. Journal of Criminal Justice Education, 22, 102–117.
Meehl, P. E. (1995). Bootstraps taxometrics: Solving the classification problem in psychopathology. American Psychologist, 50, 266–275.
Orrick, E. A., & Weir, H. (2011). The most prolific sole and lead authors in elite criminology and criminal justice journals, 2000–2009. Journal of Criminal Justice Education, 22, 24–42.
Rice, S. K., Terry, K. J., Miller, H. V., & Ackerman, A. R. (2007). Research trajectories of female scholars in criminology and criminal justice. Journal of Criminal Justice Education, 18, 360–384.
Selek, S., & Saleh, A. (2014). Use of h index and g index for American academic psychiatry. Scientometrics, 99, 541–548.
Sember, M., Utrobicic, A., & Petrak, J. (2010). Croatian medical journal citation score in web of science, Scopus, and Google scholar. Croatian Medical Journal, 51, 99–103.
Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251.
Tewksbury, R., DeMichele, M. T., & Miller, J. M. (2005). Methodological orientations of articles appearing in criminal justice’s top journals: Who publishes what and where. Journal of Criminal Justice Education, 16, 265–279.
Tewksbury, R., & Mustaine, E. E. (2011). How many authors does it take to write an article? An assessment of criminology and criminal justice research article author composition. Journal of Criminal Justice Education, 22, 12–23.
Van Aalst, J. (2010). Using Google scholar to estimate the impact of journal articles in education. Educational Researcher, 39, 387–400.
Vimala, V., & Reddy, V. P. (1996). Authorship pattern and collaborative research in the field of zoology. Malaysian Journal of Library & Information Science, 1, 43–50.
Walters, G. D. (2014). Measuring scholarly productivity in faculty members of doctoral programs in criminology and criminal justice. Unpublished manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Walters, G.D. Measuring the quantity and quality of scholarly productivity in criminology and criminal justice: a test of three integrated models. Scientometrics 102, 2011–2022 (2015). https://doi.org/10.1007/s11192-014-1496-z
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-014-1496-z