resources
visualizations
presentations
lunch break
Distractions and amusements, with a sandwich and coffee.
data visualization + art
The data will stand out—and you will too.
BD Genomics stereoscopic art exhibit — AGBT 2017
Art is science in love.
— E.F. Weisslitz
data in new dimensions
convergence of art, genomics and bioinformatics
In genomics, insights can hinge on a difference of one. One cellular mutation to go from healthy to diseased. One cell migration from tumor to metastasis. Even subtle differences in gene expression between healthy cells shapes their form and function.
In Data in New Dimensions, we’ve created an immersive data art experience celebrating the individuality and often underestimated influence of the single cell—captured by high-throughput single cell analysis.
Using the rich data from the very tools and instruments in this room, we’ve transformed data points back into cells and, informed by their differences, allowed those cells to once again rejoin the world of the viewer in the third dimension.
How do these canvases make you think about the difference of one in your work?
difference of one expression
This piece contrasts two different blood cell states, diseased versus healthy, in such a way that the differences manifest as depth. Cells on the base plane (the closest to the wall) represent healthy control cells, while diseased cells ascend increasingly closer to the viewer based on how different they are from their healthy counterpart.
difference of one migration
This piece paints a picture of the diversity of disease, showing how the cells of a tumor and its metastasis vary in expression patterns. These differences are manifested in the piece through each cell’s position in the third dimension. Cells from the primary tumor exist on the base layer (closest to the wall). Cells from the metastatic site project into the room based on the degree of difference from the nearest primary tumor cell in their cluster.
difference of one function
This piece explores the expression differences that help determine a healthy cell’s role within an organism. Each cluster corresponds to a different cell type along the renal tubule, with that cluster’s depth mapping to its position along the tubule. Blood enters the tubule through the cells on the base layer (closest to the wall) and is filtered by the cells in the successively ascending layers. The remaining waste exits past the cells in the layer nearest to the viewer.
news + thoughts
Yearning for the Infinite — Aleph 2
Discover Cantor's transfinite numbers through my music video for the Aleph 2 track of Max Cooper's Yearning for the Infinite (album page, event page).
I discuss the math behind the video and the system I built to create the video.
Hidden Markov Models
Everything we see hides another thing, we always want to see what is hidden by what we see.
—Rene Magritte
A Hidden Markov Model extends a Markov chain to have hidden states. Hidden states are used to model aspects of the system that cannot be directly observed and themselves form a Markov chain and each state may emit one or more observed values.
Hidden states in HMMs do not have to have meaning—they can be used to account for measurement errors, compress multi-modal observational data, or to detect unobservable events.
In this column, we extend the cell growth model from our Markov Chain column to include two hidden states: normal and sedentary.
We show how to calculate forward probabilities that can predict the most likely path through the HMM given an observed sequence.
Grewal, J., Krzywinski, M. & Altman, N. (2019) Points of significance: Hidden Markov Models. Nature Methods 16:795–796.
Background reading
Altman, N. & Krzywinski, M. (2019) Points of significance: Markov Chains. Nature Methods 16:663–664.
Hola Mundo Cover
My cover design for Hola Mundo by Hannah Fry. Published by Blackie Books.
Curious how the design was created? Read the full details.
Markov Chains
You can look back there to explain things,
but the explanation disappears.
You'll never find it there.
Things are not explained by the past.
They're explained by what happens now.
—Alan Watts
A Markov chain is a probabilistic model that is used to model how a system changes over time as a series of transitions between states. Each transition is assigned a probability that defines the chance of the system changing from one state to another.
Together with the states, these transitions probabilities define a stochastic model with the Markov property: transition probabilities only depend on the current state—the future is independent of the past if the present is known.
Once the transition probabilities are defined in matrix form, it is easy to predict the distribution of future states of the system. We cover concepts of aperiodicity, irreducibility, limiting and stationary distributions and absorption.
This column is the first part of a series and pairs particularly well with Alan Watts and Blond:ish.
Grewal, J., Krzywinski, M. & Altman, N. (2019) Points of significance: Markov Chains. Nature Methods 16:663–664.
1-bit zoomable gigapixel maps of Moon, Solar System and Sky
Places to go and nobody to see.
Exquisitely detailed maps of places on the Moon, comets and asteroids in the Solar System and stars, deep-sky objects and exoplanets in the northern and southern sky. All maps are zoomable.
Quantile regression
Quantile regression robustly estimates the typical and extreme values of a response.Quantile regression explores the effect of one or more predictors on quantiles of the response. It can answer questions such as "What is the weight of 90% of individuals of a given height?"
Unlike in traditional mean regression methods, no assumptions about the distribution of the response are required, which makes it practical, robust and amenable to skewed distributions.
Quantile regression is also very useful when extremes are interesting or when the response variance varies with the predictors.
Das, K., Krzywinski, M. & Altman, N. (2019) Points of significance: Quantile regression. Nature Methods 16:451–452.
Background reading
Altman, N. & Krzywinski, M. (2015) Points of significance: Simple linear regression. Nature Methods 12:999–1000.