Shamsi T. Iqbal
ABSTRACT
The ability to detect and differentiate breakpoints during task execution is critical for enabling defer-to-breakpoint policies within interruption management. In this work, we examine the feasibility of building statistical models that can detect and differentiate three granularities (types) of perceptually meaningful breakpoints during task execution, without having to recognize the underlying tasks. We collected ecological samples of task execution data, and asked observers to review the interaction in the collected videos and identify any perceived breakpoints and their type. Statistical methods were applied to learn models that map features of the interaction to each type of breakpoint. Results showed that the models were able to detect and differentiate breakpoints with reasonably high accuracy across tasks. Among many uses, our resulting models can enable interruption management systems to better realize defer-to-breakpoint policies for interactive, free-form tasks.
Supplemental Material
Available for Download
Slides from the presentation
Supplemental material for 'Understanding and developing models for detecting and differentiating breakpoints during interactive tasks'
- Adamczyk, P.D. and B.P. Bailey. If Not Now When? The Effects of Interruptions at Different Moments within Task Execution. CHI, 2004, 271--278. Google Scholar
Digital Library
- Altheide, D.L. Qualitative Media Analysis. Sage, Newbury Park, CA, 1996.Google Scholar
- Baeza-Yates, R.A. and B. Ribeiro-Neto Modern Information Retrieval. Addison-Wesley, Boston, 1999. Google ScholarDigital Library
- Bailey, B.P., P.D. Adamczyk, T.Y. Chang and N.A. Chilson. A Framework for Specifying and Monitoring User Tasks. Journal of Computers in Human Behavior, 22 (4), 2006, 685--708.Google ScholarCross Ref
- Bailey, B.P. and J.A. Konstan. On the Need for Attention Aware Systems: Measuring Effects of Interruption on Task Performance, Error Rate, and Affective State. Journal of Computers in Human Behavior, 22 (4), 2006, 709--732.Google ScholarCross Ref
- Card, S., T. Moran and A. Newell The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, Hillsdale, 1983. Google ScholarDigital Library
- Czerwinski, M., E. Cutrell and E. Horvitz. Instant Messaging: Effects of Relevance and Timing. People and Computers XIV: Proceedings of HCI, 2000, 71--76.Google Scholar
- Czerwinski, M., E. Horvitz and S. Wilhite. A Diary Study of Task Switching and Interruptions. CHI, 2004, 175--182. Google ScholarDigital Library
- Dragunov, A.N., T.G. Dietterich, K. Johnsrude, M. McLaughlin, L. Li and J.L. Herlocker. Tasktracer: A Desktop Environment to Support Multi-Tasking Knowledge Workers. Proc. IUI, 2005, 75--82. Google ScholarDigital Library
- Fogarty, J., S.E. Hudson and J. Lai. Examining the Robustness of Sensor-Based Statistical Models of Human Interruptibility. CHI, 2004, 207--214. Google ScholarDigital Library
- Fogarty, J., A.J. Ko, H.H. Aung, E. Golden, K.P. Tang and S.E. Hudson. Examining Task Engagement in Sensor-Based Statistical Models of Human Interruptibility. CHI, 2005, 331--340. Google ScholarDigital Library
- Gonzalez, V.M. and G. Mark. "Constant, Constant, Multi-Tasking Craziness": Managing Multiple Working Spheres. CHI, 2004, 113--120. Google ScholarDigital Library
- Hall, M.A. Correlation-Based Feature Selection for Discrete and Numeric Class Machine Learning. Proceedings of the 17th International Conference on Machine Learning, 2000, 359--366. Google ScholarDigital Library
- Hanson, C. and W. Hirst. On the Representation of Events: A Study of Orientation, Recall, and Recognition. Journal of Experimental Psychology: General, 118 (2), 1989, 136--147.Google ScholarCross Ref
- Henderson, A. and S.K. Card. Rooms: The Use of Multiple Virtual Workspaces to Reduce Space Contention in a Window-Based Graphical User Interface. ACM TOG, 5 (3), 1986, 211--243. Google ScholarDigital Library
- Ho, J. and S. Intille. Using Context--Aware Computing to Reduce the Perceived Burden of Interruptions from Mobile Devices. CHI, 2005, 909--918. Google ScholarDigital Library
- Horvitz, E., P. Koch and J. Apacible. Busybody: Creating and Fielding Personalized Models of the Cost of Interruption. CSCW, 2004, 507--510. Google ScholarDigital Library
- Iqbal, S.T. and B.P. Bailey. Investigating the Effectiveness of Mental Workload as a Predictor of Opportune Moments for Interruption. CHI, 2005, 1489--1492. Google ScholarDigital Library
- Iqbal, S.T. and B.P. Bailey. Leveraging Characteristics of Task Structure to Predict Costs of Interruption. CHI, 2006, 741--750. Google ScholarDigital Library
- John, B.E. and D.E. Kieras. The GOMS Family of User Interface Analysis Techniques: Comparison and Contrast. ACM TOCHI, 3 (4), 1996, 320--351. Google ScholarDigital Library
- Mark, G., V.M. Gonzalez and J. Harris. No Task Left Behind? Examining the Nature of Fragmented Work. CHI, 2005, 321--330. Google ScholarDigital Library
- Nair, R., S. Voida and E. Mynatt. Frequency--Based Detection of Task Switches. Proceedings of the 19th British HCI Group Annual Conference, 2005, 94--99.Google Scholar
- Newtson, D. Attribution and the Unit of Perception of Ongoing Behavior. Journal of Personality and Social Psychology, 28 (1), 1973, 28--38.Google ScholarCross Ref
- Newtson, D. and G. Engquist. The Perceptual Organization of Ongoing Behavior. Journal of Experimental Social Psychology, 12, 1976, 436--450.Google ScholarCross Ref
- Newtson, D., G. Enquist and J. Bois. The Objective Basis of Behavior Units. Journal of Personality and Social Psychology, 35 (12), 1977, 847--862.Google ScholarCross Ref
- Rizzolatti, G., L. Fadiga, V. Gallese and L. Fogassi. Premotor Cortex and the Recognition of Motor Actions. Cognitive Brain Research, 3, 1996, 131--141.Google ScholarCross Ref
- Shen, J., L. Li, T. Dietterich and J. Herlocker. A Hybrid Learning System for Recognizing User Tasks from Desktop Activities and Email Messages. Proc. IUI, 2006, 86--92. Google ScholarDigital Library
- Zacks, J., B. Tversky and G. Iyer. Perceiving, Remembering, and Communicating Structure in Events. Journal of Experimental Psychology: General, 130 (1), 2001, 29--58.Google ScholarCross Ref
- Zacks, J.M. and B. Tversky. Event Structure in Perception and Conception. Psychological Bulletin, 127, 2001, 3--21.Google ScholarCross Ref
Index Terms
- Understanding and developing models for detecting and differentiating breakpoints during interactive tasks
Recommendations
Oasis: A framework for linking notification delivery to the perceptual structure of goal-directed tasks
A notification represents the proactive delivery of information to a user and reduces the need to visually scan or repeatedly check an external information source. At the same time, notifications often interrupt user tasks at inopportune moments, ...
If not now, when?: the effects of interruption at different moments within task execution
CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsUser attention is a scarce resource, and users are susceptible to interruption overload. Systems do not reason about the effects of interrupting a user during a task sequence. In this study, we measure effects of interrupting a user at different moments ...
Self-interruption on the computer: a typology of discretionary task interleaving
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe typical information worker is interrupted every 12 minutes, and half of the time they are interrupting themselves. However, most of the research on interruption in the area of human-computer interaction has focused on understanding and managing ...
Comments