Skip to main content
SpringerLink
Log in

Improving Statistical Practice in HCI

  • Chapter
  • First Online:
Modern Statistical Methods for HCI

Part of the book series: Human–Computer Interaction Series ((HCIS))

  • 4724 Accesses

Abstract

So you have come to the end. You have, if all is according to plan, learned novel methods and have started to think fairly critically about the methods that are of common use in HCI. Perhaps you are convinced that we could, and should, improve our reporting practice. The previous chapter has highlighted, practically without reference to specific methods or choosing a “camp” (Bayesian or Frequentist), a large number of possible directions for improvements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The search was carried out in Sept 2013.

  2. 2.

    Other types of corrections may be more suitable given the intentions of the original research team: this is merely an illustrative example.

  3. 3.

    See http://oulasvirta.posterous.com/86113982 for this discussion.

  4. 4.

    Quote retrieved from: http://interactionculture.wordpress.com/2012/01/27/a-position-on-peer-reviewing-in-hci-part-1/.

  5. 5.

    See http://cs.swansea.ac.uk/turntothewild/.

  6. 6.

    The first replichi special interest group can be found at: http://chi2012.acm.org/program/desktop/Session25.html.

  7. 7.

    From http://www.cs.nott.ac.uk/\(\sim \)mlw/pubs/RepliCHI-panel_CR.pdf.

  8. 8.

    For a detailed discussion of this see Stuart Reeve’s blog at http://notesonresearch.tumblr.com/.

  9. 9.

    Comment on http://web.archive.org/web/20100914113440/ http://unraveled.com/archives/2003/10/hci_as_science.

  10. 10.

    Comment on http://web.archive.org/web/20100914113440/ http://unraveled.com/archives/2003/10/hci_as_science.

  11. 11.

    See: http://dubfuture.blogspot.co.uk/2009/11/i-give-up-on-chiuist.html.

  12. 12.

    Comment on http://web.archive.org/web/20100914113440/ http://unraveled.com/archives/2003/10/hci_as_science.

References

  • American Psychological Association (2009) Publication Manual of the American Psychological Association, 6th edn, p. 272

    Google Scholar 

  • Box GEP (1979) Robustness in the strategy of scientific model building, Technical summary rept. University of Wisconsin

    Google Scholar 

  • Claypool M, Le P, Wased M, Brown D (2001) Implicit interest indicators. In: Proceedings of the 6th international conference on intelligent user interfaces—IUI ’01. ACM Press, New York, pp 33–40

    Google Scholar 

  • Dienes Z (2008) Understanding psychology as a science: an introduction to scientific and statistical inference, 1st edn, p 150. Palgrave Macmillan

    Google Scholar 

  • Dubrovsky V, Kiesler S, Sethna B (1991) The equalization phenomenon: status effects in computer-mediated and face-to-face decision-making groups. Human-Comput Interact 6(2):119–146

    Google Scholar 

  • Endsley MR, Kaber DB (1999) Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics 42(3):462–492

    Google Scholar 

  • Frick RW (1998) A better stopping rule for conventional statistical tests. Behav Res Methods Instrum Comput 30:690–697

    Article  Google Scholar 

  • Hassenzahl M (2004) The Interplay of beauty, goodness, and usability in interactive products. Human-Comput Interact 19(4):319–349

    Google Scholar 

  • Ioannidis JPA (2005) Why most published research findings are false. In: Jantsch W, Schaffler F (eds) PLoS Med 2(8):e124

    Google Scholar 

  • Kanda T, Hirano T, Eaton D, Ishiguro, H (2004) Interactive robots as social partners and peer tutors for children: a field trial. Human-Comput Interact 19(1):61–84

    Google Scholar 

  • Kaptein MC, Nass C, Markopoulos P (2010) Powerful and consistent analysis of likert-type ratingscales. In: Proceedings of the 28th international conference on human factors in computing systems—CHI ’10. ACM Press, New York, pp 2391–2401

    Google Scholar 

  • Kaptein MC, Robertson J (2012) Rethinking Statistical Methods for HCI. In: Proceedings of the 2011 annual conference on human factors in computing systems, CHI 212. ACM Press, New York, pp 1105–1114

    Google Scholar 

  • Kruschke JK (2011) Bayesian assessment of null values via parameter estimation and model comparison. Perspect Psychol Sci 6(3):299–312 (May 2011)

    Google Scholar 

  • Meho LI, Rogers Y (2008) Citation counting, citation ranking, and h-index of human-computer interaction researchers: a comparison of scopus and web of science. J Am Soc Inform Sci Technol 59(11):1711–1726

    Google Scholar 

  • Morahan-Martin J, Schumacher P (2000) Incidence and correlates of pathological internet use among college students. Comput Hum Behav 16(1):13–29

    Google Scholar 

  • Oakes M (1986) Statistical Inference: a commentary for the social and behavioural sciences. Wiley, p 196

    Google Scholar 

  • Schumacher P, Morahan-Martin J (2001) Gender, internet and computer attitudes and experiences. Comput Hum Behav 17(1):95–110

    Google Scholar 

  • Simmons JP, Nelson LD, Simonsohn U (2011) False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci 22(11):1359–1366

    Google Scholar 

  • Tractinsky N, Katz A, Ikar D (2000) What is beautiful is usable. Interact Comput 13(2):127–145

    Google Scholar 

  • Ziliak S, McCloskey D (2008) The cult of statistical significance: how the standard error costs us jobs, justice and lives. University of Michigan Press, Ann Arbor

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Moray House School of Education, Edinburgh University, Edinburgh, UK

    Judy Robertson

  2. Donders Centre for Cognition, Radboud University Nijmegen, Nijmegen, The Netherlands

    Maurits Kaptein

Authors
  1. Judy Robertson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maurits Kaptein
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Judy Robertson .

Editor information

Editors and Affiliations

  1. Moray School of Education, Edinburgh University, Edinburgh, United Kingdom

    Judy Robertson

  2. Donders Centre for Cognition, Radboud University Nijmegen, Tilburg, The Netherlands

    Maurits Kaptein

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Robertson, J., Kaptein, M. (2016). Improving Statistical Practice in HCI. In: Robertson, J., Kaptein, M. (eds) Modern Statistical Methods for HCI. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-319-26633-6_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26633-6_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26631-2

  • Online ISBN: 978-3-319-26633-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation