R. William Soukoreff
I. Scott MacKenzie
ABSTRACT
We propose a new technique based on the Levenshtein minimum string distance statistic for measuring error rates in text entry research. The technique obviates the need to artificially constrain subjects to maintain synchronization with the presented text, thus affording a more natural interaction style in the evaluation. Methodological implications are discussed, including the additional need to use keystrokes per characters (KSPC) as a dependent measure to capture the overhead in correcting errors.
- Kruskal, J. B. An overview of sequence comparison, Time warps, string edits, and macromolecules: The theory and practice of sequence comparison, ed. D. Sankoff, and J. B. Kruskal. (Reading, MA: Addison-Wesley, 1983) 382.Google Scholar
- Levenshtein, V. I. Binary codes capable of correcting deletions, insertions and reversals, Soviet Physics-Doklady 10 (1966), 707-710.Google Scholar
- MacKenzie, I. S., and Zhang, S. X. The design and evaluation of a high-performance soft keyboard, Proceedings of CHI '99, 25-31. Google ScholarDigital Library
Index Terms
- Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic
Recommendations
Recent developments in text-entry error rate measurement
CHI EA '04: CHI '04 Extended Abstracts on Human Factors in Computing SystemsPreviously, we defined robust and easy-to-calculate error metrics for text entry research. Herein, we announce a software implementation of this error analysis technique. We build on previous work, by introducing two new metrics, and we extend error ...
Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe describe and identify shortcomings in two statistics recently introduced to measure accuracy in text entry evaluations: the minimum string distance (MSD) error rate and keystrokes per character (KSPC). To overcome the weaknesses, a new framework for ...
A character-level error analysis technique for evaluating text entry methods
NordiCHI '02: Proceedings of the second Nordic conference on Human-computer interactionWe describe a technique to analyse character-level errors in evaluations of text entry methods. Using an algorithm for sequence comparisons, we generate the set of optimal alignments between the presented and transcribed text. Percharacter errors, ...
Comments