skip to main content
10.1145/1460563.1460571acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
research-article

Mopping up: modeling wikipedia promotion decisions

Published:08 November 2008Publication History

ABSTRACT

This paper presents a model of the behavior of candidates for promotion to administrator status in Wikipedia. It uses a policy capture framework to highlight similarities and differences in the community's stated criteria for promotion decisions to those criteria actually correlated with promotion success. As promotions are determined by the consensus of dozens of voters with conflicting opinions and unwritten expectations, the results highlight the degree to which consensus is truly reached. The model is fast and easily computable on the fly, and thus could be applied as a self-evaluation tool for editors considering becoming administrators, as a dashboard for voters to view a nominee's relevant statistics, or as a tool to automatically search for likely future administrators. Implications for distributed consensus-building in online communities are discussed.

References

  1. Bryant, S. L., Forte, A., & Bruckman, A. (2005). Becoming Wikipedian: Transformation of Participation in a Collaborative Online Encyclopedia. GROUP 2005, 1--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Butler, B., Joyce, E., and Pike, J. Don't look now, but we've created a bureaucracy: The nature and roles of policies and rules in Wikipedia. Proc. CHI 2008, ACM Press (2008). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Collier, B., Burke, M., Kittur, N. and Kraut, R. E., Retrospective versus Prospective Evidence for Promotion: The Case of Wikipedia. In 2008 annual meeting of the Academy of Management, (Anaheim, California, 2008), Academy of Management.Google ScholarGoogle Scholar
  4. Cosley, D., Frankowski, D., Terveen, L., and Riedl, J. SuggestBot: Using intelligent task routing to help people find work in Wikipedia. Proc. IUI 2007, ACM Press (2007), 32--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Dawes, R. M. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34(7), 571--582.Google ScholarGoogle ScholarCross RefCross Ref
  6. Ducheneaut, N. Socialization in an open source software community: A socio-technical analysis. Computer Supported Cooperative Work 14 (2006), 323--368. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Forte, A., and Bruckman, A. Scaling consensus: Increasing decentralization in Wikipedia governance. Proc. HICSS 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Giles, G. (2005). Internet Encyclopedias Go Head to Head. Nature, 438(7070), 900--901.Google ScholarGoogle ScholarCross RefCross Ref
  9. Hastie, R., & Dawes, R. M. (2001). Rational choice in an uncertain world: The psychology of judgment and decision making. Thousand Oaks, CA: Sage Publications.Google ScholarGoogle Scholar
  10. Hobson, C. J., & Gibson, F. W. (1983). Policy Capturing as an Approach to Understanding and Improving Performance Appraisal: A Review of the Literature. The Academy of Management Review, 8(4), 640--649.Google ScholarGoogle ScholarCross RefCross Ref
  11. Hocking, R. (2003). Collinearity in multiple regression. Chapter 5 of Methods and Applications of Linear Models: Regression and the Analysis of Variance. Hoboken, NJ: Wiley-Interscience.Google ScholarGoogle ScholarCross RefCross Ref
  12. Karau, S., and Williams, K. Social loafing: A meta-analytic review and theoretical integration. Journal of Personality and Social Psychology, 65 (1993), 681--706.Google ScholarGoogle Scholar
  13. Kittur, A., Chi, E., Pendleton, B., Suh, B., and Mytkowicz, T. Power of the few vs. wisdom of the crowd: Wikipedia and the rise of the bourgeoisie. Proc CHI 2007, ACM Press (2007).Google ScholarGoogle Scholar
  14. Kittur, A., Suh, B., Pendleton, B. A., Chi., E. (2007). He says, she says: Conflict and coordination in Wikipedia. Proc CHI 2007, ACM Press (2007), 453--462. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Locke, E. A. and Latham, G. P. Building a practically useful theory of goal setting and task motivation: A 35 year odyssey. American Psychologist, 57 (9). 705--717.Google ScholarGoogle Scholar
  16. Meehl, P. E. Clinical vs. statistical prediction: A theoretical analysis and review of the literature. Menneapolis, University of Minnesota Press, 1954.Google ScholarGoogle Scholar
  17. Ng, T. W. H., Eby, L. T., Sorensen, K. L., & Feldman, D. C. (2005). Predictors of objective and subjective career success: A meta-analysis. Personnel Psychology, 58(2), 367--409.Google ScholarGoogle ScholarCross RefCross Ref
  18. Priedhorsky, R., Chen, J., Lam, S., Panciera, K., Terveen, L., and Riedl, J. 2007. Creating, destroying, and restoring value in Wikipedia. Proc GROUP 2007, ACM Press (2007), 259--268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Stumpf, S. A., & London, M. (1981). Capturing rater policies in evaluating candidates for promotion. The Academy of Management Journal, 24(4), 752--766.Google ScholarGoogle Scholar
  20. Viegas, F., Wattenberg, M., and Dave., K. Studying cooperation and conflict between authors with history flow visualizations. Proc CHI 2004, ACM Press (2004), 575--582. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Viegas, F., Wattenberg, M., Kriss, J., and van Ham, F. Talk before your type: Coordination in Wikipedia. Proc HICSS 2007, 575--582. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Vroom, V., Porter, L., and Lawler, E. Expectancy Theories. in Miner, J. B. ed. Organizational Behavior 1: Essential Theories of Motivation and Leadership, ME Sharpe, Armonk NY, 2005, 94--113.Google ScholarGoogle Scholar
  23. Zedeck, S., & Kafry, D. (1977). Capturing Rater Policies for Processing Evaluation Data. Organizational Behavior and Human Performance, 18(2), 269--294.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Mopping up: modeling wikipedia promotion decisions

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          CSCW '08: Proceedings of the 2008 ACM conference on Computer supported cooperative work
          November 2008
          752 pages
          ISBN:9781605580074
          DOI:10.1145/1460563

          Copyright © 2008 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 8 November 2008

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate2,235of8,521submissions,26%

          Upcoming Conference

          CSCW '24

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader