Building Custom Data Visualizations (2018)

Table of Contents
Introduction

Introduction
00:00:00 - 00:05:08
Introduction
Shirley Wu introduces Building Custom Data Visualization workshop. Shirley talks about the three workshops she has created with Frontend Masters, and the order she recommends in taking those classes, as well as her thoughts while creating this course. - _https://slides.com/shirleywu/deck-10#/
Exploratory and Expository
00:05:09 - 00:14:21
Exploratory and Expository
Shirley discusses the two significant categories of custom data visualizations: exploratory and expository. It's explained why we will be using expository examples today, but that they are easily transferrable to exploratory data visualizations.
Course Agenda
00:14:22 - 00:15:25
Course Agenda
Shirley gives the roadmap for how the course is structured.

Data

Exploring the Dataset
00:15:26 - 00:18:19
Exploring the Dataset
Shirley goes through the steps that she takes when approaching a new dataset to turn into a data visualization. Observable Notebook is introduced, and a short instruction on how to use it is given. - _
_https://beta.observablehq.com/d/907b07f81f284b17
Dataset Exercise
00:18:20 - 00:20:29
Dataset Exercise
Shirley briefly goes over the different data types. To understand a dataset, students go through and writing down the data attributes and listing some data comparisons that may yield interesting results.
Dataset Solution, Part 1
00:20:30 - 00:34:51
Dataset Solution, Part 1
Shirley works through the dataset by listing the data type for each of the useful data attributes, then listens to the audience's suggestions for worthwhile questions about the data to explore.
Dataset Solution, Part 2
00:34:52 - 00:40:26
Dataset Solution, Part 2
Shirley records the potential questions from the previous section, and gathers more questions and hypotheses around that dataset that seem interesting.
Chart Types & Vega-Lite
00:40:27 - 00:45:02
Chart Types & Vega-Lite
To help figure out the best way to explore questions from the datasets, Shirley reviews common chart types that lend themselves well to the data types discussed earlier, and a tool called Vega-Lite that helps with graphing the data for exploration. - _https://vega.github.io/vega-lite/
Chart Brainstorming Exercise
00:45:03 - 00:46:32
Chart Brainstorming Exercise
In this exercise, the audience is instructed to brainstorm and sketch possible chart types that will aid in answering questions they have about the data.
Chart Brainstorming Solution, Part 1
00:46:33 - 00:52:35
Chart Brainstorming Solution, Part 1
Shirley reviews the audience's brainstorming chart sketches that explore potential ideas to visualize the data.
Chart Brainstorming Solution, Part 2
00:52:36 - 01:12:08
Chart Brainstorming Solution, Part 2
While using a chart idea from the previous exercise, Shirley demonstrates the process of generating a scatterplot visualization in Vega-Lite.
Chart Brainstorming Solution, Part 3
01:12:09 - 01:14:59
Chart Brainstorming Solution, Part 3
Shirley leads a discussion about what are some interesting aspects of the chart that, through further exploration, may lead to interesting results.
Chart Brainstorming Solution, Part 4
01:15:00 - 01:26:10
Chart Brainstorming Solution, Part 4
Shirley reviews another student's brainstorming sketch and transforms the idea into a Vega-Lite line chart.
Using Modules in Observable
01:26:11 - 01:28:36
Using Modules in Observable
Shirley introduces how to require modules in Observable, and demonstrates how the module require debugger tool works for modules that are more difficult than others. - - _https://beta.observablehq.com/@tmcw/requiring-modules-troubleshooting - _https://beta.observablehq.com/@tmcw/module-require-debugger
Using Heatmap
01:28:37 - 01:45:35
Using Heatmap
Shirley demonstrates how to generate heatmaps with Vega-Lite displaying the release date and genre of blockbuster movies.
Exploration Exercise
01:45:36 - 01:50:25
Exploration Exercise
Shirley reviews the methods that she went through to explore the data that the audience had previously done, and the thought process throughout. The audience is asked to jot down a few points they though were interesting, and things they think are important to keep in mind when exploring datasets. Further advice is given when exploring a dataset. - _https://beta.observablehq.com/@sxywu/building-custom-data-visualizations-starter

Design

Marks & Channels
01:50:26 - 02:12:29
Marks & Channels
Once a question or hypothesis is answered, or something interesting is found, Shirley suggests to build a story around that theme thinking through how to translate that story into visual encodings.In this section, the design of the visualization is also introduced. Shirley explains what marks and channels are, how they differ, and then introduces the impacts of the various channels. Within this section, Tamara Munzer's Visualization Analysis and Design is referenced as the inspiration for many of Shirley's points. - - _https://greensock.com/ - _https://riccardoscalco.it/textures/
Gestalt Laws of Grouping
02:12:30 - 02:17:14
Gestalt Laws of Grouping
Shirley covers the Gestalt principles of proximity, similarity, and exclosure that help explain how to utilize how the brain processes patterns for designing data visualizations. - _https://www.amazon.com/Functional-Art-introduction-information-visualization/dp/0321834739
Remix & Overlay
02:17:15 - 02:18:24
Remix & Overlay
Shirley urges gaining inspiration from work that has done before rather than attempting to start from scratch.
Design Exercise
02:18:25 - 02:20:23
Design Exercise
In this exercise, the audience is asked to brainstorm a complete data visualization idea, including a main message, marks, and channels.
Design Solution, Part 1
02:20:24 - 02:37:03
Design Solution, Part 1
Shirley reviews sketches from students and discusses their messages they want to convey in their designs. - - _https://en.wikipedia.org/wiki/Sankey_diagram - _http://infowetrust.com/ -
Design Solution, Part 2
02:37:04 - 02:39:17
Design Solution, Part 2
Shirley introduces the graph that will be built throughout the rest of the class.

Code

Turning Designs into Code
02:39:18 - 02:41:38
Turning Designs into Code
Shirley explains the two parts to turning designs into code, which are drawing the geometric shapes, then translation from the data into their various channels.
D3 Shapes and Layouts
02:41:39 - 03:00:19
D3 Shapes and Layouts
Shirley points out key portions of the D3 API that assist in data preparation, layout calculation, and user interactions. Applications of these concepts created by Shirley (and others) are demonstrated to help the audience understand the process of understanding in what way the data is best represented before approaching the D3 library for a solution. - - _https://github.com/d3/d3-chord - _https://pudding.cool/2017/03/hamilton/ - _http://www.datasketch.es/july/code/nadieh/
Code Exercise
03:00:20 - 03:00:53
Code Exercise
The premise of this exercise is to code a D3 chart based on sketch by Shirley using the movie dataset. - _https://codesandbox.io/s/3r5rz58xjp?module=%2Fsrc%2Fstarter.js
Code Solution, Part 1
03:00:54 - 03:28:06
Code Solution, Part 1
After explaining the distribution of the data, and introducing D3 Areas as the main method to form the visualization, Shirley live codes the chart solution.
Code Solution, Part 2
03:28:07 - 03:30:43
Code Solution, Part 2
Continuing with the previous coding solution, Shirley refines her chart by adding curves and a color scheme. - _https://github.com/d3/d3-shape#curveCatmullRom

The Finishing Touches

Readability
03:30:44 - 03:33:47
Readability
Shirley stresses the importance of readability in data visualizations. Shirley references several D3 Libraries created by Susie Lu that aid in readability by providing context in the way of axes and annotations.
Readability Exercise & Solution
03:33:48 - 03:49:21
Readability Exercise & Solution
In this exercise, Shirley demonstrates how to use the libraries mentioned in the previous video to add axes, and annotations to the movie visualization chart for improved readability. - _http://d3-annotation.susielu.com/
Adding Aesthetics
03:49:22 - 03:54:36
Adding Aesthetics
Shirley offers other ways to add aesthetics into charts with patterns, gradients, textures, SVG filters, and others. The work of Nadieh Bremer is introduced to help give context to the importance of these aspects.
Adding Aesthetics Exercise & Solution, Part 1
03:54:37 - 04:02:00
Adding Aesthetics Exercise & Solution, Part 1
In this exercise, Shirley uses the Gestalt laws to strategically add texture using the textures.js library to the movie data visualization. - _https://css-tricks.com/snippets/svg/svg-patterns/
Adding Aesthetics Exercise & Solution, Part 2
04:02:01 - 04:09:51
Adding Aesthetics Exercise & Solution, Part 2
After adding textures to the chart, Shirley instructs on how to add drop shadows to the movie titles. - - _https://developer.mozilla.org/en-US/docs/Web/SVG/Element/feDropShadow - _https://www.w3.org/TR/SVGFilter12/
Interactions
04:09:52 - 04:12:23
Interactions
Shirley introduces interactions through D3. Simple interactions can be done with D3 alone, but more complex interactions have to have React (or similar) as an aid.

Wrapping Up

Exploratory Visualizations
04:12:24 - 04:18:25
Exploratory Visualizations
The process of the creation and utilization of SVG data visualizations at Netflix outlined in this section. Shirley gives sage advice that has been gained through working with the complex problems that have been encountered.
Additional Resources
04:18:26 - 04:21:25
Additional Resources