resources
visualizations
presentations
lunch break
Distractions and amusements, with a sandwich and coffee.
visualization + design
`\pi` Day 2014 Art Posters
On March 14th celebrate `\pi` Day. Hug `\pi`—find a way to do it.
For those who favour `\tau=2\pi` will have to postpone celebrations until July 26th. That's what you get for thinking that `\pi` is wrong. I sympathize with this position and have `\tau` day art too!
If you're not into details, you may opt to party on July 22nd, which is `\pi` approximation day (`\pi` ≈ 22/7). It's 20% more accurate that the official `\pi` day!
Finally, if you believe that `\pi = 3`, you should read why `\pi` is not equal to 3.
For the 2014 `\pi` day, two styles of posters are available: folded paths and frequency circles.
The folded paths show `\pi` on a path that maximizes adjacent prime digits and were created using a protein-folding algorithm.
The frequency circles colourfully depict the ratio of digits in groupings of 3 or 6. Oh, look, there's the Feynman Point!
frequency circles of `pi`
Some of the posters for this year's Pi Day art expand on the work from last year, which showed Pi as colored circles on a grid.
For those of you who really liked this minimalist depiction of π , I've created something slightly more complicated, but still stylish: Pi digit frequency circles. These are pretty and easy to understand. If you like random distribution of colors (and circles), these are your thing.
Briefly, each set of concentric rings corresponds to a sequence of digits in
π
, such as 3 (314 159 265 ...) or 6 (314159 265358 ...). The number of times a given digit is seen within a sequence is encoded by the thickness of the ring. Rings are ordered outward in numerical order of their digits (i.e. 0 on the inside, 9 on the outside).
For some posters, the first digit (3) is offset from the rest of the groups. Look for the high count of 9s at the end of posters showing π up to the Feynman Point (6 9s at digit 762). For posters that show more digits, try to find the Feynman Point somewhere among the groups.
The Feynman point is at an extremely interesting location. If we group the digits of
π
into groups of 6, then the first 999999 falls exactly into the 128th group. But, if we group the digits by 3s, then the two groups 999 and 999 fall exactly into groups 255 and 256 (a power of 2!), which can be arranged into a perfect square of 16 x 16 groups.
The Feynman point is a specific case of the general case in which the digit d appears n times in a row. I call this the (d=7,n=6) and provide a list of all these points in the first 1,000,000 digits. Points with a large n value will contribute significantly to the frequency distribution of the digit group they fall in. If the sequence is split across groups, its impact is lower.
news + thoughts
Markov Chains
You can look back there to explain things,
but the explanation disappears.
You'll never find it there.
Things are not explained by the past.
They're explained by what happens now.
—Alan Watts
A Markov chain is a probabilistic model that is used to model how a system changes over time as a series of transitions between states. Each transition is assigned a probability that defines the chance of the system changing from one state to another.
Together with the states, these transitions probabilities define a stochastic model with the Markov property: transition probabilities only depend on the current state—the future is independent of the past if the present is known.
Once the transition probabilities are defined in matrix form, it is easy to predict the distribution of future states of the system. We cover concepts of aperiodicity, irreducibility, limiting and stationary distributions and absorption.
This column is the first part of a series and pairs particularly well with Alan Watts and Blond:ish.
Grewal, J., Krzywinski, M. & Altman, N. (2019) Points of significance: Markov Chains. Nature Methods 16:663–664.
1-bit zoomable gigapixel maps of Moon, Solar System and Sky
Places to go and nobody to see.
Exquisitely detailed maps of places on the Moon, comets and asteroids in the Solar System and stars, deep-sky objects and exoplanets in the northern and southern sky. All maps are zoomable.
Quantile regression
Quantile regression robustly estimates the typical and extreme values of a response.Quantile regression explores the effect of one or more predictors on quantiles of the response. It can answer questions such as "What is the weight of 90% of individuals of a given height?"
Unlike in traditional mean regression methods, no assumptions about the distribution of the response are required, which makes it practical, robust and amenable to skewed distributions.
Quantile regression is also very useful when extremes are interesting or when the response variance varies with the predictors.
Das, K., Krzywinski, M. & Altman, N. (2019) Points of significance: Quantile regression. Nature Methods 16:451–452.
Background reading
Altman, N. & Krzywinski, M. (2015) Points of significance: Simple linear regression. Nature Methods 12:999–1000.
Analyzing outliers: Robust methods to the rescue
Robust regression generates more reliable estimates by detecting and downweighting outliers.Outliers can degrade the fit of linear regression models when the estimation is performed using the ordinary least squares. The impact of outliers can be mitigated with methods that provide robust inference and greater reliability in the presence of anomalous values.
We discuss MM-estimation and show how it can be used to keep your fitting sane and reliable.
Greco, L., Luta, G., Krzywinski, M. & Altman, N. (2019) Points of significance: Analyzing outliers: Robust methods to the rescue. Nature Methods 16:275–276.
Background reading
Altman, N. & Krzywinski, M. (2016) Points of significance: Analyzing outliers: Influential or nuisance. Nature Methods 13:281–282.
Two-level factorial experiments
To find which experimental factors have an effect, simultaneously examine the difference between the high and low levels of each.Two-level factorial experiments, in which all combinations of multiple factor levels are used, efficiently estimate factor effects and detect interactions—desirable statistical qualities that can provide deep insight into a system.
They offer two benefits over the widely used one-factor-at-a-time (OFAT) experiments: efficiency and ability to detect interactions.
Since the number of factor combinations can quickly increase, one approach is to model only some of the factorial effects using empirically-validated assumptions of effect sparsity and effect hierarchy. Effect sparsity tells us that in factorial experiments most of the factorial terms are likely to be unimportant. Effect hierarchy tells us that low-order terms (e.g. main effects) tend to be larger than higher-order terms (e.g. two-factor or three-factor interactions).
Smucker, B., Krzywinski, M. & Altman, N. (2019) Points of significance: Two-level factorial experiments Nature Methods 16:211–212.
Background reading
Krzywinski, M. & Altman, N. (2014) Points of significance: Designing comparative experiments.. Nature Methods 11:597–598.
Happy 2019 `\pi` Day—
Digits, internationally
Celebrate `\pi` Day (March 14th) and set out on an exploration explore accents unknown (to you)!
This year is purely typographical, with something for everyone. Hundreds of digits and hundreds of languages.
A special kids' edition merges math with color and fat fonts.
Check out art from previous years: 2013 `\pi` Day and 2014 `\pi` Day, 2015 `\pi` Day, 2016 `\pi` Day, 2017 `\pi` Day and 2018 `\pi` Day.