R. William Soukoreff
I. Scott MacKenzie
ABSTRACT
We describe and identify shortcomings in two statistics recently introduced to measure accuracy in text entry evaluations: the minimum string distance (MSD) error rate and keystrokes per character (KSPC). To overcome the weaknesses, a new framework for error analysis is developed and demonstrated. It combines the analysis of the presented text, input stream (keystrokes), and transcribed text. New statistics include a unified total error rate, combining two constituent error rates: the corrected error rate (errors committed but corrected) and the not corrected error rate (errors left in the transcribed text). The framework includes other measures including error correction efficiency, participant conscientiousness, utilised bandwidth, and wasted bandwidth. A text entry study demonstrating the new methodology is described.
- MacKenzie, I.S., Kober, H., Smith, D., Jones, T., and Skepner, E. (2001) LetterWise: Prefix-based disambiguation for mobile text entry, Proceedings of the ACM Symposium on User Interface Software and Technology - UIST 2001. New York: ACM. Google Scholar
Digital Library
- MacKenzie, I.S. (2002) KSPC (keystrokes per character) as a characteristic of text entry techniques, Proceedings of the Fourth International Symposium on Human-Computer Interaction with Mobile Devices. Heidelberg, Germany: Springer-Verlag. Google ScholarDigital Library
- MacKenzie, I.S. and Soukoreff, R.W. (2002) Text entry for mobile computing: Models and methods, theory and practice. Human-Computer Interaction, 17 (2 & 3), 147--198.Google ScholarCross Ref
- MacKenzie, I.S. and Soukoreff, R.W. (2002) A character-level error analysis technique for evaluating text entry methods, Proceedings of the Second Nordic Conference on Human-Computer Interaction - NordiCHI 2002. New York: ACM. Google ScholarDigital Library
- Matias, E., MacKenzie, I.S., and Buxton, W. (1993) Half-Qwerty: A one-handed keyboard facilitating skill transfer from Qwerty, Proceedings of the ACM Conference on Human Factors in Computing Systems - INTERCHI '93. New York, ACM. Google ScholarDigital Library
- Shannon, C.E., (1951) Prediction and entropy of printed English. Bell System Technical Journal, 30, 5164.Google ScholarCross Ref
- Soukoreff, R.W. and MacKenzie, I.S. (2001) Measuring errors in text entry tasks: An application of the Levenshtein string distance statistic, Companion Proceedings of the ACM Conference on Human Factors in Computing Systems - CHI 2001. New York: ACM. Google ScholarDigital Library
- Ward, D.J., Blackwell, A.F., and MacKay, D.J.C. (2000) Dasher: A data entry interface using continuous gestures and language models, Proceedings of the ACM Symposium on User Interface Software and Technology - UIST 2000. New York: ACM. Google ScholarDigital Library
Index Terms
- Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric
Recommendations
Error quantifying metrics for text entry systems augmented with word prediction
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human InteractionOf late, many text entry systems in users' languages with various text entry rate enhancement strategies are being proposed. To evaluate the effectiveness of such text entry systems, measuring error correction efficiency in addition to text entry rate ...
Type, Then Correct: Intelligent Text Correction Techniques for Mobile Text Entry Using Neural Networks
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and TechnologyCurrent text correction processes on mobile touch devices are laborious: users either extensively use backspace, or navigate the cursor to the error position, make a correction, and navigate back, usually by employing multiple taps or drags over small ...
Mobile text entry metrics for field studies
IASTED-HCI '07: Proceedings of the Second IASTED International Conference on Human Computer InteractionIn recent years, mobile text entry has been a flourishing research area. Typically text entry studies have been carried out in a laboratory environment where precise measurement methods and established accuracy and efficiency metrics can be applied. ...
Comments