skip to main content
research-article

Shifting the focus from accuracy to recallability: A study of informal note-taking on mobile information technologies

Published:23 April 2009Publication History
Skip Abstract Section

Abstract

Mobile information technologies are theoretically well-suited to digitally accomodate informal note-taking, with the notes often recorded quickly and under less than ideal circumstances. Unfortunately, user adoption of mobile support for informal note-taking has been hindered in large part by slow text entry techniques. Building on research confirming people's ability to recognize erroneous text, this study explores two simple modifications to Graffiti-based text entry with the goal of increasing text entry speed: disabling text correction and disabling visual feedback. As expected, both modifications improved text entry speed at the cost of recognizability. To address the decrease in recognizability, a multiapproach text-enhancement algorithm is introduced with the goal of modifying the erroneous note to facilitate the process of recalling the event or activity that originally motivated the note. A study with 75 participants confirmed that the proposed approach of discouraging user-initiated error correction during note-taking, enhancing the resulting erroneous notes, and facilitating recall with enhanced alternative lists, increased note-taking speed by 47% with no negative impact on the participants' ability to recall important details about the scenarios which prompted the note-taking activities. This research highlighs the importance and efficacy of shifting the focus from accuracy to recallability when examining the overall efficacy of informal notes. The proposed modifications and adaptations produce significant benefits and have important implications for how mobile technologies are designed to support both informal note-taking and text entry in general.

References

  1. Adams, M. J. 1990. Beginning To Read: Thinking And Learning About Print. MIT Press, Cambridge, MA.Google ScholarGoogle Scholar
  2. Barnard, L., Yi, J., Jacko, J. and Sears, A. 2004. The effects of context on human performance in mobile computing. Personal Ubiquitous Comput.11, 2, 81--96. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Barnard, L., Yi, J., Jacko, J., and Sears, A. 2005. An empirical comparison of us-in-motion evaluation scenarios for mobile computing devices. Int. J. Hum.-Comput. Stud. 62, 4, 487--520. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Beech, J. R. and Mayall, K. A. 2005. The word shape hypothesis re-examined: evidence for an externalfeature advantage in visual word recognition. J. Res. Reading 28, 3, 302--319.Google ScholarGoogle ScholarCross RefCross Ref
  5. Campbell, C. S. and Maglio, P. P. 2003. Supporting notable information in office work. In Extended Abstracts on Human Factors in Computing Systems (CHI '03). 902--903. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Clawson, J., Lyons, K., Starner, T., and Clarkson, E. 2005. The impacts of limited visual feedback on mobile text entry for the Twiddler and mini-QWERTY keyboards. In Proceedings of the 9th IEEE International Symposium Wearable Computers. 170--177. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Dai, L., Lutters, W. G. and Bower, C. 2005. Why use memo for all? Restructuring mobile applications to support informal note taking. In Extended Abstracts on Human Factors in Computing Systems (CHI '05). 1320--1323. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Ebbinghaus, H. 1964, 1885. Memory: A Contribution to Experimental Psychology. Dover Publications, Mineola, NY.Google ScholarGoogle Scholar
  9. Ellis, J. 1996. Prospective memory or the realization of delayed intentions: A conceptual framework for research. In Prospective Memory: Theory and Applications, M. Brandimonte et al. Eds. Lawrence Erlbaum, Mahwah, NJ.Google ScholarGoogle Scholar
  10. Fleetwood, M. D., Byrne, M. D., and Centgraf, P. 2002. An evaluation of text-entry in palm OSGraffiti and the virtual keyboard. In Proceedings of the 46th Ergonomics Society Annual Meeting on Human Factors. 617--621.Google ScholarGoogle Scholar
  11. Girden, E. R. 1992. ANOVA: Repeated Measures. Sage, Newbury Park, CA.Google ScholarGoogle ScholarCross RefCross Ref
  12. Greenhouse, S. W. and Geisser, S. 1959. On methods in the analysis of profile data. Psychometrika 24, 95--112.Google ScholarGoogle ScholarCross RefCross Ref
  13. Goldberg, D. and Richardson, C. 1993. Touch-typing with a stylus. In Proceedings of the ACM Conference on Computer Human Interfaces (CHI '93). ACM, New York, 80--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Haber, L. R., Haber, R. N., and Furlin, K. R. 1983. Word length and word shape as sources of information in reading. Read. Resea. Quar. 18, 165--189.Google ScholarGoogle ScholarCross RefCross Ref
  15. Hart, S. G. and Staveland, L. E. 1988. Development of NASA-TLX (task load index): Results of empirical and theoretical research. In Human Mental Workload, P.A. Hancock and N. Meshkati Eds., Elsevier, Amsterdam, 139--183.Google ScholarGoogle Scholar
  16. James, C. L. and Reischel, K. M. 2001. Text input for mobile devices: Comparing model prediction to actual performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, 365--371. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Kane, S. K. and Wobbrock, J. O. 2007. Automatically correcting typing errors for people with motorimpairments. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST). ACM, New York, 59--60.Google ScholarGoogle Scholar
  18. Kjeldskov, J. and Stage, J. 2004. New techniques for usability evaluation of mobile systems. Int. J. Hum.-Comput. Stud. 60, 599--620.Google ScholarGoogle ScholarCross RefCross Ref
  19. Koltringer, T. and Grechenig, T. 2004. Comparing the immediate usability of Graffiti 2 and virtual keyboard. In Extended Abstracts on Human Factors in Computing Systems (CHI '04). 1175--1178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Kvavilashvili, L. and Ellis, J. 1996. Varieties of intention: Some distinctions and classifications. In Prospective Memory: Theory and Applications, M. Brandimonte et al. Eds., Lawrence Erlbaum, Mahwah, NJ, 23--51.Google ScholarGoogle Scholar
  21. Levenshtein, V. I. 1966. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady 10, 707--710.Google ScholarGoogle Scholar
  22. Lin, M., Lutters, W. G., and Kim, T. S. 2004. Understanding the micronote lifecycle: Improving mobile support for informal note taking. In Proceedings of the ACM Conference on Computer Human Interfaces (CHI 2004), ACM, New York, 687--694. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Lin, M., Price, K., Goldman, R., Sears, A., and Jacko, J. 2005. Tapping on the move: Fitts' law under mobile conditions. In Proceedings of Information Resources Management Association International Conference. 132--135.Google ScholarGoogle Scholar
  24. Lyons, K., Plaisted, D., and Starner, T. 2004a. Expert chording text entry on the Twiddler one-handed keyboard. In Proceedings of the 8th International Symposium on Wearable Computers (ISWC). 94--101. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Lyons, K., Starner, T., Plaisted, D., Fusia, J., Lyons, A., Drew, A., and Looney, E. W. 2004b. Twiddler typing: one-handed chording text entry for mobile phones. In Proceedings of the SIGCHI Conference on Human factors in Computing Systems. ACM, New York, 671--678. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. MacKenzie, I. S. and Chang, L. 1999. A performance comparison of two handwriting recognizers. Interact. Comput. 11, 283--297.Google ScholarGoogle ScholarCross RefCross Ref
  27. MacKenzie, I. S. and Soukoreff, R. W. 2002a. A character-level error analysis technique for evaluating text entry methods. In Proceedings of the NordiCHI, 243--246. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. MacKenzie, I. S. and Soukoreff, R. W. 2002b. Text entry for mobile computing: models and methods, theory and practice. Hum. Comput. Interact. 17, 147--198.Google ScholarGoogle ScholarCross RefCross Ref
  29. MacKenzie, I. S. and Zhang, S. 1997. The immediate usability of Graffiti. In Proceedings of Graphic Interface. Canadian Information Processing Society, 129--137. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Mankoff, J. and Abowd, G. A. 1998. Cirrin: A word-level unistroke keyboard for pen input. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, 213--214. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Mayzner, M. S. and Tresselt, M. E. 1965. Tables of single-letter and digram frequency counts for various word-length and letter-position combinations. Psychonomic Mono. Suppl. 1, 13--32.Google ScholarGoogle Scholar
  32. Mcdaniel, M. A., Waddill, P. J., and Einstein, G. O. 1988. A contextual account of the generation effect: A three-factor theory. J. Memory Lang. 27, 521--536.Google ScholarGoogle ScholarCross RefCross Ref
  33. Meacham, J. A. and Leiman, B. 1982. Remembering to perform future actions. In Memory Observed: Remembering in Natural Contexts, U. Neisser Ed., W. H. Freeman, New York, 327--336.Google ScholarGoogle Scholar
  34. Monk, A. F. and Hulme, C. 1983. Errors in proofreading: Evidence for the use of word shape in word recognition. Memory & Cognition 11, 16--23.Google ScholarGoogle Scholar
  35. Mustonen, T., Olkkonen, M., and Hakkinen, J. 2004. Examining mobile phone text legibility while walking. In Extended Abstracts on Human Factors in Computing Systems (CHI '04). 1243--1246. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Paap, K. R., Newsome, S. L., and Noel, R. W. 1984. Word shapes in poor shape for the race to the lexicon. J. Exper. Psych. Hum. Perception Perform. 10, 413--428.Google ScholarGoogle ScholarCross RefCross Ref
  37. Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., and Feinstein, A. 1996. A simulation of the number of events per variable in logistic regression analysis. J. Climical Epidemiology 99, 1373--1379.Google ScholarGoogle ScholarCross RefCross Ref
  38. Perlin, K. 1998. Quickwriting: Continuous stylus-based text entry. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology. ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Price, K., Lin, M., Feng, J., Goldman, R., Sears, A., and Jacko, J. 2006. Motion does matter: An examination of speech-based text entry on the move. Universal Access Inform. Soc. 4, 246--257. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Schomaker, L. R. B. 1994. User-interface aspects in recognizing connected-recursive handwriting. In Proceedings of the IEE Colloquium on Handwriting and Pen-Based Input. The Institute of Electrical Engineers.Google ScholarGoogle Scholar
  41. Sears, A. and Arora, R. 2002. Data entry for mobile devices: An empirical comparison of novice performance with Jot and Graffiti. Interact. Comput. 14, 413--433.Google ScholarGoogle ScholarCross RefCross Ref
  42. Sears, A. and Zha, Y. 2003. Data entry for mobile devices using soft keyboards: Understanding the effects of keyboard size and user tasks. Int. J. Hum.-Comput. Interact. 16, 2, 163--184.Google ScholarGoogle ScholarCross RefCross Ref
  43. Seidenberg, M. S. and MccLelland, J. L. 1989. A distributed, developmental model of word recognition and naming. Psych. Rev. 96, 4, 523--568.Google ScholarGoogle ScholarCross RefCross Ref
  44. Soukoreff, R. W. And MacKenzie, I. S. 2001. Measuring errors in text entry tasks: An application of the Levenshtein string distance statistic. In Extended Abstracts on Human Factors in Computing Systems (CHI '01). 319--320. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Winograd, E. 1988. Some observations on prospective remembering. In Practical Aspects of Memory: Current Research and Issues, M.M. Gruneberg et al. Eds., Wiley, 348--353.Google ScholarGoogle Scholar
  46. Wolf, C. G., Glasser, A. R., and Fujisaki, T. 1991. An evaluation of recognition accuracy for discrete and run-on writing. In Proceedings of the Human Factors Society 35th Annual Meeting. Human Factors Society Press, 359--363.Google ScholarGoogle Scholar
  47. Zhai, S. and Kristensson, P. O. 2003. Shorthand writing on stylus keyboard. In Proceedings of the Conference on Human Factors in Computing Systems. 97--104 Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Zhai, S., Kristensson, P.-O., and Smith, B. 2005. In search of effective text input interfaces for off the desktop computing. Interact. Compute. 17, 229--250.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Shifting the focus from accuracy to recallability: A study of informal note-taking on mobile information technologies

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Computer-Human Interaction
        ACM Transactions on Computer-Human Interaction  Volume 16, Issue 1
        April 2009
        199 pages
        ISSN:1073-0516
        EISSN:1557-7325
        DOI:10.1145/1502800
        Issue’s Table of Contents

        Copyright © 2009 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 23 April 2009
        • Accepted: 1 June 2008
        • Revised: 1 May 2008
        • Received: 1 August 2007
        Published in tochi Volume 16, Issue 1

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader