Kayur Patel
Amy J. Ko
James Landay
ABSTRACT
We present Gestalt, a development environment designed to support the process of applying machine learning. While traditional programming environments focus on source code, we explicitly support both code and data. Gestalt allows developers to implement a classification pipeline, analyze data as it moves through that pipeline, and easily transition between implementation and analysis. An experiment shows this significantly improves the ability of developers to find and fix bugs in machine learning systems. Our discussion of Gestalt and our experimental observations provide new insight into general-purpose support for the machine learning process.
Supplemental Material
- }}Ball, N. M. and Brunner, R. J. Data Mining and Machine Learning in Astronomy. 2009.Google Scholar
- }}Blume, P. A. The LabVIEW Style Book. Prentice Hall 2007.Google Scholar
- }}Candea, G. and Fox, A. Recursive Restartability: Turning the Reboot Sledgehammer into a Scalpel. HotOS 2001. Google ScholarDigital Library
- }}Card, S. K., Mackinlay, J. D., and Shneiderman, B. Readings in Information Visualization: Using Vision to Think. 1999. Google ScholarDigital Library
- }}Chen, M. Y., Accardi, A., Kiciman, E., Lloyd, J., Patterson, D., Fox, A., and Brewer, E. Path-based Failure and Evolution Management. NSDI 2004. Google ScholarDigital Library
- }}Consolvo, S., McDonald, D. W., Toscos, T., Chen, M. Y., Froehlich, J., Harrison, B., Klasnja, P., LaMarca, A., LeGrand, L., Libby, R., Smith, I., and Landay, J. A. Activity Sensing in the Wild: A Field Trial of UbiFit Garden. CHI 2008. Google ScholarDigital Library
- }}Cruz, J. A. and Wishart, D. S. Applications of Machine Learning in Cancer Prediction and Prognosis. Cancer Informatics 2, (2007).Google Scholar
- }}Fails, J. A. and Olsen, D. R. Interactive Machine Learning. CHI 2003.Google Scholar
- }}Fogarty, J., Tan, D., Kapoor, A., and Winder, S. CueFlik: Interactive Concept Learning in Image Search. CHI 2008. Google ScholarDigital Library
- }}Gil, Y., Ratnakar, V., Kim, J., Gonzalez-Calero, P. A., Groth, P., Moody, J., and Deelman, E. Wings: Intelligent Workflow-Based Design of Computational Experiments. IEEE Intelligent Systems, To Appear. Google ScholarDigital Library
- }}Hartmann, B., Abdulla, L., Mittal, M., and Klemmer, S. R. Authoring Sensor-based Interactions by Demonstration with Direct Manipulation and Pattern Recognition. CHI 2007. Google ScholarDigital Library
- }}Hodges, M. R. and Pollack, M. E. An 'Object-Use Fingerprint': The Use of Electronic Sensors for Human Identification. UbiComp 2007. Google ScholarDigital Library
- }}Juergens, E., Deissenboeck, F., Hummel, B., and Wagner, S. Do Code Clones Matter? ICSE 2009. Google ScholarDigital Library
- }}Maynes-Aminzade, D., Winograd, T., and Igarashi, T. Eyepatch: Prototyping Camera-based Interaction Through Examples. UIST 2007. Google ScholarDigital Library
- }}Pang, B., Lee, L., and Vaithyanathan, S. Thumbs Up?: Sentiment Classification Using Machine Learning Techniques. EMNLP 2002. Google ScholarDigital Library
- }}Patel, K., Fogarty, J., Landay, J. A., and Harrison, B. Investigating Statistical Machine Learning as a Tool for Software Development. CHI 2008. Google ScholarDigital Library
- }}Rubine, D. Specifying Gestures by Example. SIGGRAPH 1991. Google ScholarDigital Library
- }}Simon, I., Morris, D., and Basu, S. MySong: Automatic Accompaniment Generation for Vocal Melodies. CHI 2008. Google ScholarDigital Library
- }}Stolte, C. Visual Interfaces to Data. SIGMOD 2010. Google ScholarDigital Library
- }}Witten, I. H. and Frank, E. Data Mining: Practical Machine Learning Tools and Techniques. 2005. Google ScholarDigital Library
- }}Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures Without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes. UIST 2007. Google ScholarDigital Library
Index Terms
- Gestalt: integrated support for implementation and analysis in machine learning
Recommendations
Lowering the barrier to applying machine learning
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technologyMachine learning algorithms are key components in many cutting edge applications of computation. However, the full potential of machine learning has not been realized because using machine learning is hard, even for otherwise tech-savvy developers. This ...
Segmentation of Natural Scenes Based on Visual Attention and Gestalt Grouping Laws
SMC '13: Proceedings of the 2013 IEEE International Conference on Systems, Man, and CyberneticsDetection of salient regions in images of natural scenes can be applied as a pre-processing step for computer vision algorithms as image segmentation, content based image retrieval, object recognition or image compression. This paper presents a visual ...
An intuitive model of perceptual grouping for HCI design
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsUnderstanding and exploiting the abilities of the human visual system is an important part of the design of usable user interfaces and information visualizations. Good design enables quick, easy and veridical perception of key components of that design. ...
Comments