Skip to main content
Log in

Using Publications Counts to Measure an Institution's Research Productivity

  • Published:
Research in Higher Education Aims and scope Submit manuscript

Abstract

Studies that attempt to evaluate and rank institutions often overlook the research activities of an institution. In this article, we show how readily available data from the Institute of Scientific Inquiry (ISI) may be used to estimate the number of scholarly articles written by an institution's faculty. We show how institutions are ranked according to total publications and the ratio of publications to full-time faculty, how these measures vary by type of institution, and how they are correlated with other selected measures of research resources and institutional quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  • Adams, A., and Krislov, J. (1978). Evaluating the quality of American universities: A new approach. Res. Higher Educ. 8: 97–109.

    Google Scholar 

  • Baird, L. (1986). What characterizes a productive research department? Res. Higher Educ. 25: 211–225.

    Google Scholar 

  • Baird, L. (1991). Publication productivity in doctoral research departments: Interdisciplinary and intradisciplinary factors. Res. Higher Educ. 32: 303–318.

    Google Scholar 

  • Banta, T., and Borden, V. (1994). Performance indicators for accountability and improvement. In: Borden, V., and Banda, T. (eds.), Using Performance Indicators to Guide Strategic Decision Making, New Directions for Institutional Research, no. 82, Jossey-Bass, San Francisco, pp. 95–106.

    Google Scholar 

  • Bell, J., and Seater, J. (1978). Publishing performance: Departmental and individual. Econ. Inq. 16: 599–615.

    Google Scholar 

  • Bellas, M., and Toutkoushian, R. (1999). Faculty time allocation and research productivity: Gender, race and family effects. Rev. Higher Educ. 22: 367–390.

    Google Scholar 

  • Borokhovich, K., Bricker, R., Brunarski, K., and Simkins, B. (1995). Finance research productivity and influence. J. Finance 50: 1691–1717.

    Google Scholar 

  • Bowker, A. (1965). Quality and quantity in higher education. J. Am. Stat. Assoc. 60(309): 1–15.

    Google Scholar 

  • Braxton, J., and Bayer, A. (1986). Assessing faculty scholarly performance. In: Cresswell, J. W. (ed.), Measuring Faculty Research Performance, New Directions for Institutional Research, no. 50, Jossey-Bass, San Francisco, pp. 25–42.

    Google Scholar 

  • Braxton, J. (1996). Contrasting perspectives on the relationship between teaching and research. In: Braxton, J. (ed.), Faculty Teaching and Research: Is There a Conflict? New Directions for Institutional Research, no. 90, Jossey-Bass, San Francisco, pp. 5–14.

    Google Scholar 

  • Bray, N., Braxton, J., and Smart, J. (1996). Research activity and the support of undergraduate education. In: Braxton, J. (ed.), Faculty Teaching and Research: Is There a Conflict? New Directions for Institutional Research, no. 90, Jossey-Bass, San Francisco, pp. 23–30.

    Google Scholar 

  • Brinkman, P. (1981). Factors affecting instructional costs at major research universities. J. Higher Educ. 52: 265–279.

    Google Scholar 

  • Brown, D. (1967). The Mobile Professors, The American Council on Education, Washington, DC.

    Google Scholar 

  • Buchmueller, T., Dominitz, J., and Hansen, W. (1999). Graduate training and the early career productivity of Ph.D. economists. Econ. Educ. Rev. 18: 65–77.

    Google Scholar 

  • Cohn, E., Rhine, S., and Santos, M. (1989). Institutions of higher education as multiproduct firms: Economies of scale and scope. Rev. Educ. Stat. 71: 284–290.

    Google Scholar 

  • Creamer, E. (1998). Assessing faculty publication productivity: Issues of equity. ASHEERIC Higher Education Report Volume 26, No. 2, The George Washington University, Graduate School of Education and Human Development, Washington, DC.

    Google Scholar 

  • Davis, P., and Papanek, G. (1984). Faculty ratings of major economics departments by citations. Am. Econ. Rev. 74: 225–230.

    Google Scholar 

  • de Groot, H., McMahon, W., and Volkwein, J. (1991). The cost structure of American research universities. Rev. Econ. Stat. 73: 424–431.

    Google Scholar 

  • Diamond, A. (1986). What is a citation worth? J. Hum. Resour. 21: 200–215.

    Google Scholar 

  • Diamond, N., and Graham, H. (2000). How should we rate research universities? Change 32: 20–33.

    Google Scholar 

  • Dolence, M., and Norris, D. (1994). Using key performance indicators to drive strategic decision making. In: Borden, V., and Banda, T. (eds.), Using Performance Indicators to Guide Strategic Decision Making, New Directions for Institutional Research, no. 82, Jossey-Bass, San Francisco, pp. 63–80.

    Google Scholar 

  • Dundar, H., and Lewis, D. R. (1998). Determinants of research productivity in higher education.Res. Higher Educ. 39: 607–631.

    Google Scholar 

  • Ehrenberg, R., and Hurst, P. (1996). The 1995 NRC ratings of doctoral programs: A hedonic model. Change 28(3): 46–50.

    Google Scholar 

  • Feldman, K. (1987). Research productivity and scholarly accomplishment of college teachers as related to their instructional effectiveness: A review and exploration. Res. Higher Educ. 26: 227–298.

    Google Scholar 

  • Fox, M. (1992). Research, teaching and publication productivity: Mutuality versus competition in academia. Sociol. Educ. 65: 293–305.

    Google Scholar 

  • Gaither, G., Nedwek, B., and Neal, J. (1994). Measuring up: the Promises and pitfalls of performance indicators in higher education. ASHE-ERIC Higher Education Report No. 5, The George Washington University, Graduate School of Education and Human Development, Washington, DC.

    Google Scholar 

  • Gander, J. (1999). Faculty gender effects on academic research and teaching. Res. Higher Educ. 40: 171–184.

    Google Scholar 

  • Garfield, E. (1979). Citation Indexing: Its Theory and Applications in Science, Technology, and Humanities, Free Press, New York.

    Google Scholar 

  • Gavlick, M. (1996). Triangulating the relationships among publication productivity, teaching effectiveness, and student achievement. In: Braxton, J. (ed.), Faculty Teaching and Research: Is There a Conflict? New Directions for Institutional Research, no. 90, Jossey-Bass, San Francisco, pp. 49–56.

    Google Scholar 

  • Gerrity, D., and McKenzie, R. (1978). The ranking of southern economics departments: New criterion and further evidence. Southern Econ. J. 45: 608–614.

    Google Scholar 

  • Golden, J., and Carstensen, F. V. (1992). Academic research productivity, department size and organization: further results, comment. Econ. Educ. Rev. 11: 153–160.

    Google Scholar 

  • Graham, A., and Thompson, N. (2001). Broken ranks. The Washington Monthly, September, pp. 1–8. Available: http://www.washingtonmonthly.com/features/2001/0109.graham.thompson.hml

  • Graves, P., Marchand, J., and Thompson, R. (1982). Economics departmental rankings: Research incentives, constraints, and efficiency. Am. Econ. Rev. 72: 1131–1141.

    Google Scholar 

  • House, D., and Yeager, J. (1978). The distribution of publication success within and among top economics departments: A disaggregative view of recent evidence. Econ. Inq. 16: 593–598.

    Google Scholar 

  • Hughes, R. (1925). A Study of Graduate Schools of America, The Miami University Press, Oxford, OH.

    Google Scholar 

  • Hughes, R. (1934). Report of the Committee on Graduate Instruction. Educ. Record 15: 192–234.

    Google Scholar 

  • Johnes, J., and Johnes, G. (1995). Research funding and performance in U.K. university departments of economics: A frontier analysis. Econ. Educ. Rev. 14: 301–314.

    Google Scholar 

  • Jones, L., Lindzey, G., and Coggeshall, P. (eds.) (1982). An Assessment of Research-Doctorate Programs in the United States: Mathematical and Physical Sciences, The National Academy Press, Washington, DC.

    Google Scholar 

  • Jordan, J., Meador, M., and Walters, S. (1988). Effects of department size and organization on the research productivity of academic economists. Econ. Educ. Rev. 7: 251–255.

    Google Scholar 

  • Keith, B. (1999). University eminence and the contextual effect of institutional performance indicators. Paper presented at the 1999 meetings of the Association of Institutional Research, Seattle, WA.

  • Keniston, H. (1959). Graduate Study in Research in the Arts and Sciences at the University of Pennsylvania, The University of Pennsylvania Press, Philadelphia.

    Google Scholar 

  • Koshal, R., and Koshal, M. (1999). Economies of scale and scope in higher education: A case of comprehensive universities. Econ. Educ. Rev. 18: 269–277.

    Google Scholar 

  • Lindsey, D. (1989). Using citation counts as a measure of quality in science. Scientometrics 15: 189–203.

    Google Scholar 

  • Lombardi, J., Craig, D., Capaldi, E., Gater, D., and Mendonca, S. (2001). The Top American Research Universities, The Center at the University of Florida, Gainesville.

  • Long, J., and McGinnis, R. (1981). Organizational context and scientific productivity. Am. Sociol. Rev. 46: 422–442.

    Google Scholar 

  • Manis, J. (1951). Some academic influences upon publication productivity. Soc. Forces 29: 267–272.

    Google Scholar 

  • Miller, J., and Tollison, R. (1975). Rates of publications per faculty member in fortyfive 'rated' economics departments. Econ. Inq. 13: 122–123.

    Google Scholar 

  • Monks, J., and Ehrenberg, R. (1999). U.S. News and World Report's college rankings: Why do they matter? Change 31: 42–51.

    Google Scholar 

  • Nedwek, B. (1996). Public policy and public trust: The use and misuse of performance indicators in higher education. In: Smart, J. C. (ed.), Higher Education: Handbook of Theory and Research (Vol. 11), Agathon Press, New York, pp. 47–89.

    Google Scholar 

  • Noser, T., Manakyan, H., and Tanner, J. (1996). Research productivity and perceived teaching effectiveness: a survey of economics faculty. Res. Higher Educ. 37: 299–321.

    Google Scholar 

  • Patrick, W., and Stanley, E. (1998). Teaching and research quality indicators and the shaping of higher education. Res. Higher Educ. 39: 19–41.

    Google Scholar 

  • Perry, R., Clifton, R., Menec, V., Struthers, C., and Menges, R. (2000). Faculty in transition: A longitudinal analysis of perceived control and type of institution in the research productivity of newly hired faculty. Res. Higher Educ. 41: 165–194.

    Google Scholar 

  • Porter, S., and Umbach, P. (2001). Analyzing faculty workload using multilevel modeling. Res. Higher Educ. 42: 171–196.

    Google Scholar 

  • Ransom, M., and Megdal, S. (1993). Sex differences in the academic labor market in the affirmative action era. Econ. Educ. Rev. 12: 21–43.

    Google Scholar 

  • Rodenhouse, M. (ed.) (2001). 2001 Higher Education Directory, Higher Education Publications, Inc., Falls Church, VA.

    Google Scholar 

  • South Carolina Commission on Higher Education (2002). Performance funding guidelines and updates. Available: http://www.che400.state.sc.us/web /Perform/ReportCards/ Report_Frames.htm Southwick, L. (1969). Cost trends in land grant colleges and universities. Appl. Econ. 1: 167–182.

    Google Scholar 

  • Tan, D. (1986). The assessment of quality in higher education: A critical review. Res. Higher Educ. 24: 223–265.

    Google Scholar 

  • Taylor, B., and Massy, W. (1996). Strategic Indicators for Higher Education: Vital Benchmarks and Information to Help You Evaluate and Improve Your Institution's Performance, Peterson's, Princeton, NJ.

    Google Scholar 

  • Tien, F., and Blackburn, R. (1996). Faculty rank system, research motivation, and faculty research productivity. J. Higher Educ. 67: 2–22.

    Google Scholar 

  • Toutkoushian, R. (1994). Using citations to measure sex discrimination in faculty salaries. Rev. Higher Educ. 18: 61–82.

    Google Scholar 

  • Toutkoushian, R. (1999). The value of cost functions for policymaking and institutional research. Res. Higher Educ. 40: 1–15.

    Google Scholar 

  • Toutkoushian, R., and Danielson, C. (2003). Using performance indicators to evaluate decentralized budgeting systems and institutional performance. In: Priest, D. M., Becker, W. E., Hossler, D., and St. John, E. P. (eds.), Incentive-Based Budgeting Systems in Public Universities, Edward Elgar Publishing Inc., Northampton, MA, pp. 205–226.

    Google Scholar 

  • Toutkoushian, R., Dundar, H., and Becker, W. (1998). The National Research Council graduate program ratings: What are they measuring? Rev. Higher Educ. 21: 427–443.

    Google Scholar 

  • U.S. Department of Education (1997). Federal Support for Education: Fiscal years 1980 to 1997, NCES 97-383, by C. M. Hoffman, National Center for Education Statistics, Washington, DC.

    Google Scholar 

  • U.S. Department of Education (2001a). Digest of Education Statistics, 2000, NCES 2001-034, by T. D. Snyder and C. M. Hoffman, National Center for Education Statistics, Washington, DC.

    Google Scholar 

  • U.S. Department of Education (2001b). Background Characteristics, Work Activities, and Compensation of Faculty and Instructional Staff in Postsecondary Institutions: Fall 1998, NCES 2001-152, by L. J. Zimbler, National Center for Education Statistics, Washington, DC.

    Google Scholar 

  • Wanner, R., Lewis, L., and Gregorio, D. (1981). Research productivity in academia: A comparative study of the sciences, social sciences, and humanities. Sociol. Educ. 54: 238–253.

    Google Scholar 

  • Webster, D. (1983). America's highest ranking graduate schools, 1925-1982. Change 15(4): 14–24.

    Google Scholar 

  • Webster, D., and Skinner, T. (1996). Rating PhD programs: What the NRC report says... and doesn't say. Change 28(3): 22–44.

    Google Scholar 

  • Zheng, H., and Stewart, A. (2002). Assessing the performance of public research universities using NSF/NCES data and data envelopment analysis technique. AIR Prof. File 83: 1–21.x

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Toutkoushian, R.K., Porter, S.R., Danielson, C. et al. Using Publications Counts to Measure an Institution's Research Productivity. Research in Higher Education 44, 121–148 (2003). https://doi.org/10.1023/A:1022070227966

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1022070227966

Navigation