skip to main content
10.1145/2993901acmotherconferencesBook PagePublication PageschiConference Proceedingsconference-collections
BELIV '16: Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization
ACM2016 Proceeding
Publisher:
  • Association for Computing Machinery
  • New York
  • NY
  • United States
Conference:
BELIV '16: Novel Evaluation Methods For Visualization Baltimore MD USA 24 October 2016
ISBN:
978-1-4503-4818-8
Published:
24 October 2016
In-Cooperation:
INRIA

Bibliometrics
Skip Abstract Section
Abstract

Visualization has shown its ability to produce powerful tools for analyzing, understanding, and communicating data and making it accessible for several different tasks and purposes. Impact of visualization to everyday work and personal lives is demonstrated by many successes stories---such as the increasing prevalence of Tableau, the interactive visualizations produced by the New York Times, or toolkits like VTK/Paraview to name just a few. A large community of casual and professional users are increasingly consuming and producing both interactive and static visualizations.

Skip Table Of Content Section
SESSION: Evaluation in the Development Cycle
research-article
On Regulatory and Organizational Constraints in Visualization Design and Evaluation

Problem--based visualization research provides explicit guidance toward identifying and designing for the needs of users, but absent is more concrete guidance toward factors external to a user's needs that also have implications for visualization design ...

research-article
Public Access
Action Design Research and Visualization Design

In applied visualization research, artifacts are shaped by a series of small design decisions, many of which are evaluated quickly and informally via methods that often go unreported and unverified. Such design decisions are influenced not only by ...

research-article
Evaluation of Visualization by Critiques

In this position paper, we extend design critiques as a form of evaluation to visualization, specifically focusing on unique qualities of critiques that are different than other types of evaluation by inspection, such as heuristic evaluation, models, ...

research-article
Using Concrete and Realistic Data in Evaluating Initial Visualization Designs

We explore means of designing and evaluating initial visualization ideas, with concrete and realistic data in cases where data is not readily available. Our approach is useful in exploring new domains and avenues for visualization, and contrasts other ...

SESSION: Heuristics & Metrics
research-article
Information Visualization Heuristics in Practical Expert Evaluation

While traditional HCI heuristics can be used to find usability issues also from information visualization systems, specialized heuristics tailored for the information visualization (InfoViz) domain can be more effective and focus on the special ...

research-article
Evaluating Visualization Sets: Trade-offs Between Local Effectiveness and Global Consistency

Evaluation criteria like expressiveness and effectiveness favor optimal use of space and visual encoding channels in a single visualization. However, individually optimized views may be inconsistent with one another when presented as a set in rec-...

research-article
Information Theoretic Measures for Visual Analytics: The Silver Ticket?

In this paper, we argue that information theoretic measures may provide a robust, broadly applicable, repeatable metric to assess how a system enables people to reduce high-dimensional data into topically relevant subsets of information. Explosive ...

research-article
A Survey on Interaction Log Analysis for Evaluating Exploratory Visualizations

The trend of exploratory visualization development has driven the visual analytics (VA) community to design special evaluation methods. The main goals of these evaluations are to understand the exploration process and improve it by recording users' ...

SESSION: Eye Tracking
research-article
Supporting Exploration of Eye Tracking Data: Identifying Changing Behaviour Over Long Durations

Visual analytics of eye tracking data is a common tool for evaluation studies across diverse fields. In this position paper we propose a novel user-driven interactive data exploration tool for understanding the characteristics of eye gaze movements and ...

research-article
Measuring Cognitive Load using Eye Tracking Technology in Visual Computing

In this position paper we encourage the use of eye tracking measurements to investigate users' cognitive load while interacting with a system. We start with an overview of how eye movements can be interpreted to provide insight about cognitive processes ...

SESSION: Models
research-article
Cognitive Stages in Visual Data Exploration

Data exploration requires forming analysis goals, planning actions and evaluating results effectively, all of which are complex cognitive activities. Therefore, the data exploration and analysis process can be improved through a principled and ...

research-article
Looking at the Representations in our Mind: Measuring Mental Models of Information Visualizations

Users of information visualization systems build up internal representations of the displayed information and the system --mental models -- and constantly update them during interaction with the system. Though this theoretical approach was postulated as ...

research-article
A Nested Workflow Model for Visual Analytics Design and Validation

Characterizing the problem domain and understanding users' practices and processes are recognized as important steps in order to design and validate visualization, but are often disregarded in practice, also because of their complexity. We introduce the ...

SESSION: New Directions in Evaluation
research-article
Generative Data Models for Validation and Evaluation of Visualization Techniques

We argue that there is a need for substantially more research on the use of generative data models in the validation and evaluation of visualization techniques. For example, user studies will require the display of representative and uncon-founded ...

research-article
Evaluating Information Visualization on Mobile Devices: Gaps and Challenges in the Empirical Evaluation Design Space

With their increasingly widespread use, mobile devices have become a highly relevant target environment for Information Visualization. However, far too little attention has been paid to evaluation of interactive visualization techniques on mobile ...

research-article
Beyond Usability and Performance: A Review of User Experience-focused Evaluations in Visualization

Traditionally, studies of data visualization techniques and systems have evaluated visualizations with respect to usability goals such as effectiveness and efficiency. These studies assess performance-related metrics such as time and correctness of ...

SESSION: Reflections
research-article
Why Evaluating Uncertainty Visualization is Error Prone

Evaluating a visualization that depicts uncertainty is fraught with challenges due to the complex psychology of uncertainty. However, relatively little attention is paid to selecting and motivating a chosen interpretation or elicitation method for ...

research-article
Design Study Contributions Come in Different Guises: Seven Guiding Scenarios

Design studies are projects in which visualization researchers seek to design visualization tools that help solving challenging real-world problems faced by domain experts. While design studies have become a vital component of visualization research, ...

research-article
An Empire Built On Sand: Reexamining What We Think We Know About Visualization

If we were to design Information Visualization from scratch, we would start with the basics: understand the principles of perception, test how they apply to different data encodings, build up those encodings to see if the principles still apply, etc. ...

Contributors
  • University of Stuttgart
  • INRIA Institut National de Recherche en Informatique et en Automatique
  • Paris-Saclay University
  • University of Massachusetts Amherst
  • Google LLC

Recommendations

Acceptance Rates

Overall Acceptance Rate45of64submissions,70%
YearSubmittedAcceptedRate
BELIV '14302377%
BELIV '10181267%
BELIV '08161063%
Overall644570%