Abstract
Asking respondents to record their activity in a diary can be a difficult task due to retrospective reporting and cognitive burden as well as the complexity of the data collection tool. Diary questionnaires typically require multiple pieces of information including demographics, activities, and duration over a data collection period. Like other questionnaire types, visual design principles can be used to help people perceive and understand what is being asked of them during diary measurement. Eye tracking, a technology that allows us to passively study people’s eye movements, has been used mostly for questionnaire testing within the survey research field. This study focuses on using eye tracking and other user experience measures to analyze how respondents perceive, understand and experience different designs of the paper Nielsen TV Diary. We used eye tracking to gain insights into visual elements that draw attention, the amount of text that respondents read (e.g., terms/instructions), and how respondents complete the survey. This paper centers on the collecting and analyzing of qualitative and quantitative measures of the user experience, including eye-tracking data (e.g., fixation count, time to fixate), participants’ verbalizations, self-reported satisfaction, and performance data (e.g., accuracy, steps to complete). We also provide recommendations about the design of the paper diary based on the user experience and eye-tracking results.
Chapter PDF
Similar content being viewed by others
References
Groves, R.M., Lyberg, L.: Total survey error: Past, present, and future. Public Opinion Quarterly 74(5), 849–879 (2010)
Redline, C.D., Lankford, C.P.: Eye-movement analysis: A new tool for evaluating the design of visually administered instruments (paper and web). In: Proceedings of the Section on Survey Research Methods, American Statistical Association. Paper presented at 2001 AAPOR Annual Conference, Montreal, Quebec, Canada (2001)
Graesser, A.C., Cai, Z., Louwerse, M.M., Daniel, F.: Question understanding aid (quaid) a web facility that tests question comprehensibility. Public Opinion Quarterly 70(1), 3–22 (2006)
Galesic, M., Tourangeau, R., Couper, M.P., Conrad, F.G.: Eye-tracking data new insights on response order effects and other cognitive shortcuts in survey responding. Public Opinion Quarterly 72(5), 892–913 (2008)
Lenzner, T., Kaczmirek, L., Galesic, M.: Seeing through the eyes of the respondent: An eye-tracking study on survey question comprehension. International Journal of Public Opinion Research 23(3), 361–373 (2011)
Libman, A., Smyth, J.: Turn that frown up-side down: The use of smiley faces as symbolic language in self-administered surveys. Paper presented at 2012 AAPOR Annual Conference, Orlando, Florida (May 2012)
Manfreda, K.L., Batagelj, Z., Vehovar, V.: Design of web survey questionnaires: Three basic experiments. Journal of Computer-Mediated Communications 7(3) (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Walton, L., Bergstrom, J.C.R., Hawkins, D.C., Pierce, C. (2014). Eye Tracking on a Paper Survey: Implications for Design. In: Stephanidis, C., Antona, M. (eds) Universal Access in Human-Computer Interaction. Universal Access to Information and Knowledge. UAHCI 2014. Lecture Notes in Computer Science, vol 8514. Springer, Cham. https://doi.org/10.1007/978-3-319-07440-5_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-07440-5_17
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07439-9
Online ISBN: 978-3-319-07440-5
eBook Packages: Computer ScienceComputer Science (R0)