Schedule
08:30-08:50 — Introduction
08:50-09:50 — Keynote
We Should Never Stop BELIVing: Reflections on 10 Years of Workshops on the Esoteric Art of Evaluating Information Visualization
Enrico Bertini
09:50-10:10 — BELIV 2016 Impact award
Strategies for Evaluating Information Visualization Tools: Multidimensional
In-depth Long-term Case Studies (published in BELIV 2006)
Ben Shneiderman, Catherine Plaisant
BREAK 10:10 - 10:30
10:30-11:10 — Paper Session: Heuristics and Metrics
Session Chair: Michael Sedlmair
Information Visualization Heuristics in Practical Expert Evaluation
Heli Väätäjä, Jari Varsaluoma, Tomi Heimonen, Katariina Tiitinen, Jaakko Hakulinen, Markku Turunen, and Harri Nieminen
Evaluating Visualization Sets: Trade-offs Between Local Effectiveness and Global Consistency
Zening Qu and Jessica Hullman
Information Theoretic Measures for Visual Analytics: The Silver Ticket?
Laura McNamara, Travis Bauer, Laura Matzen, and Michael Haass
A Survey on Interaction Log Analysis for Evaluating Exploratory Visualizations
Omar ElTayeby and Wenwen Dou
11:10-11:45 — Paper Session: Models
Session Chair: Michael Sedlmair
Cognitive Stages in Visual Data Exploration
Adil Yalcin, Niklas Elmqvist, and Ben Bederson
Looking at the Representations in our Mind: Measuring Mental Models of Information Visualizations
Eva Mayr, Günther Schreder, Michael Smuc, and Florian Windhager
A NestedWorkflow Model for Visual Analytics Design and Validation
Paolo Federico, Albert Amor-Amoros, and Silvia Miksch
11:45-12:10 — Paper Session: Eye Tracking
Session Chair: Michael Sedlmair
Supporting Exploration of Eye Tracking Data: Identifying Changing Behavior Over Long Durations
Prithiviraj Muthumanickam, Camilla Forsell, Katerina Vrotsou, Jimmy Johansson, and Matthew Cooper
Measuring Cognitive Load using Eye Tracking Technology in Visual Computing
Johannes Zagermann, Ulrike Pfeil, and Harald Reiterer
LUNCH: 12:10 - 14:00
14:00-14:40 — Paper Session: Evaluation in the Development Cycle
Session Chair: Petra Isenberg
On Regulatory and Organizational Constraints in Visualization Design and Evaluation
Anamaria Crisan, Jennifer Gardy, and Tamara Munzner
Action Design Research and Visualization Design
Nina McCurdy, Jason Dykes, and Miriah Meyer
Evaluation of Visualization by Critiques
Richard Brath and Ebad Banissi
Using Concrete and Realistic Data in Evaluating Initial Visualization Designs
Soren Knudsen, Jeppe Gerner Pedersen, Thor Herdal, and Jakob Eg Larsen
14:40-15:10 — Paper Session: Reflections
Session Chair: Petra Isenberg
Why Evaluating Uncertainty Visualization is Error Prone
Jessica Hullman
Design Study Contributions Come in Different Guises: Seven Guiding Scenarios
Michael Sedlmair
An Empire Built On Sand: Reexamining What We Think We Know About Visualization
Robert Kosara
15:10-15:40 — Paper Session: New Directions in Evaluation
Session Chair: Petra Isenberg
Generative Data Models for Validation and Evaluation of Visualization Techniques
Christoph Schulz, Arlind Nocaj, Mennatallah El-Assady, Steffen Frey, Marcel Hlawatsch, Michael Hund, Grzegorz
Karch, Rudolf Netzel, Christin Schätzle, Miriam Butt, Daniel Keim, Thomas Ertl, Ulrik Brandes, and Daniel Weiskopf
Evaluating Information Visualization on Mobile Devices: Gaps and Challenges in the Empirical Evaluation
Design Space
Kerstin Blumenstein, Christina Niederer, Markus Wagner, Grischa Schmiedl, Alexander Rind, and Wolfgang Aigner
Beyond Usability and Performance: A Review of User Experienced-focused Evaluations in Visualization
Bahador Saket, Alex Endert, and John Stasko
BREAK: 15:40-16:15
16:15-17:30 — Panel
On the Future of Evaluation and BELIV
Panelists: Daniel Weisskopf, Laura McNamara, Mark Whiting, Niklas Elmqvist, Tamara Munzner.
17:30-17:50 — Closing Notes