2023 Pi Daylatest newsbuy art
And she looks like the moon. So close and yet, so far.Future Islandsaim highmore quotes
very clickable

data visualization + art

Creating the Molecular Case Studies Cover

If your photos aren’t good enough, then you’re not close enough
— Robert Capa

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
Cover design for Apr 2018 issue of Molecular Case Studies. (zoom)

about the cover

Papillary thyroid carcinoma (PTC) cells, even though malignant, are still genetically programmed to try to be thyroid follicles and may retain their follicular growth pattern, which appear as circles on cross section. Two diagnostic features of papillary thyroid carcinoma are nuclear clearing and intranuclear cytoplasmic inclusions. The black-and-white image is an artistic treatment of a PTC microscopy image (40×) from one of the Personalized Oncogenomics Program study participants at the BC Cancer Research Center. Superimposed is a Circos plot of 17 genomic fusions involving 17 chromosomes identified in the sample by whole-genome sequencing. Showing through the Circos plot is an enhanced color version of the microscopy image. The original image is from Application of genomics to identify therapeutic targets in recurrent pediatric papillary thyroid carcinoma by Ronsley et al. in the April 2018 issue.


The theme of the April issue of Molecular Case Studies is precision oncogenomics. We have three papers in the issue based on work done in our Personalized Oncogenomics Program (POG).

...this special issue provide[s] a glimpse into current cancer precision medicine efforts, reflecting only a microcosm of ... genomics in this bustling space of clinical translation.
John C. Carpten & Elaine R. Mardis
The era of precision oncogenomics
Mol. Case Stud. (2018) 4(2).

I've previously created art based on POG data—posters to celebrate the program's 5-year anniversary.

input materials

The covers of Molecular Case Studies typically show microscopy images, with some shown in a more abstract fashion. There's also the occasional Circos plot.

I've previously taken a more fine-art approach to cover design, such for those of Nature, Genome Research and Trends in Genetics. I've used microscopy images to create a cover for PNAS—the one that made biology look like astrophysics—and thought that this is kind of material I'd start with for the MCS cover.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
A few of the microscopy slides submitted to me for the cover design. Courtesy of Anna Lee (Dept Pathology and Laboratory Medicine, UBC).

When I look at these kind of images, I have basically no idea what I'm looking at. Sure, I know this is life at tiny scale but I am not a pathologist. This helps me greatly.

Instead, I see color, shapes, and contrast. I hunt for patterns that would make for an interesting visual, without necessarily trying to communicate any of the science behind that—the paper does a much better job at this than I ever could. It's largely a process driven by intuition and my desire to see distinct visual patterns at different length scales with some symmetry, ideally broken in a pleasing way. Vague, I know.

Images of different regions of the same slide, at the same magnification, can have very different levels of visual engagement (for the non-specialist). Just compare the two images below.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
Same magnification, same slide. The image on the right is interesting. The one on the left is not, artistically speaking. Courtesy of Anna Lee (Dept Pathology and Laboratory Medicine, UBC).

The slide on the left really caught my eye. It had the right proportion of tiny, small, medium and large things.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
I see a heart, a face and lava flow among faces. Obviously, faces everywhere—humans are good at those kinds of Type I errors. The panels below are 100% crops of the 40× slide of papillary thyroid carcinoma shown above them. Courtesy of Anna Lee (Dept Pathology and Laboratory Medicine, UBC).

black and white version

The black-and-white version was obtained by solarizing the image. There are both color and black-and-white options for solarization, a method in which various tones of the image are remapped in brightness.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
(A) The original slide (B) A black-and-white composition using Nik Color Efex 4 filters applied in succession to the slide: dark contrast, tonal contrast, white neutralizer and solarization.
Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
Compounding effects of each of the filters on the image above.

And here's the first black-and-white take.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
The initial black-and-white composition after applying Nik filters.

This looked good but a bit dark. I handled this by lightening the tone, differently depending on the element in the image. I also wanted to bring out more details in the internal structure of the cells. This was achieved by applying an otherwise aggressive sharpening mask.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
The effect of additional sharpening and tone remaps, applied differently to intracellular and extracellular regions.

I was quite happy with this result. The combination of solarization and sharpening created a large variety of patterns inside the cells. My brain fought hard to see faces in them.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
100% crops of regions of the above black-and-white image. I see a heart (this is the same heart region shown in the color crop above), then a some kind of dog/cat chimera, in the last panel, a suprrised or scared camel. If you look very carefully, you can see a grumpy cat coming out of the heart.

Because I had slides at different magnifications, I created a design in which three slides at 10, 20 and 40 × were composited together so that from left to right the magnification increased across the image. The effect is subtle—you can easily miss it, which is the point.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
A seamless stitch of black-and-white treatments of 10, 20 and 40 × slides. As you go from left to right, the magnification increases.

I had pretty high hopes for these black-and-white versions. Previous covers in MCS have been colorful, though, so I thought to provide a color option.

color version

For the color version, I wanted to give the colors more punch. For sure.

I also wanted to emphasize the details, like for the black-and-white image.

The first process step of the color slide was done using 5 Nik filters, applied in succession: dark contrast, tonal contrast, sunlight, polarization and detail extractor. The effects of the stack of these filters is shown on the original image below. The whole image is shown and in each strip the filters are stacked.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
The effect of stacking 5 Nik filters on the original image.

Here's the full image with the 5 Nik filters applied.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
A seamless stitch of black-and-white treatments of 10, 20 and 40 × slides. As you go from left to right, the magnification increases.

Not there yet, though. I added more sharpening (more than I've ever used before, so I felt a little weird, but got over it quickly). The colors were punched up too—I wanted more contrast between the blue and red areas and transform the reds a little into oranges.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
A seamless stitch of black-and-white treatments of 10, 20 and 40 × slides. As you go from left to right, the magnification increases.

If it looks like the blue areas are popping out of the image, that's the effect of the emboss filter.

final composition

The editors asked me to encorporate a Circos image in the final design. This was tricky—I had spent a lot of time up to now fiddling with extracting patterns and textures from the images.

Something as geometrical and rational as a data graphic would alter the personality of the design. But, the goal of artistic collaboration is always to find a way, so I took some gene fusions that were found in the sample with our structural variant pipeline and created a bare-bones Circos image out of them.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
A seamless stitch of black-and-white treatments of 10, 20 and 40 × slides. As you go from left to right, the magnification increases.

This was then superimposed on the image and emphasized by using the color design inside the circle and black-and-white design outside.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
The final composition for the cover combines both black-and-white and color treatments. The colored pattern stands out above the black-and-white background.

It's always fun to invert images and see what happens.

Molecualar Case Studies - Creating the April 2018 cover / Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
Inverse of the above. Notice how the pattern inside the circle appears to be sitting below the plane, making the circle more of a window to a scene. .
news + thoughts

Neural network primer

Mon 06-02-2023

Nature is often hidden, sometimes overcome, seldom extinguished. —Francis Bacon

In the first of a series of columns about neural networks, we introduce them with an intuitive approach that draws from our discussion about logistic regression.

Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
Nature Methods Points of Significance column: Neural network primer. (read)

Simple neural networks are just a chain of linear regressions. And, although neural network models can get very complicated, their essence can be understood in terms of relatively basic principles.

We show how neural network components (neurons) can be arranged in the network and discuss the ideas of hidden layers. Using a simple data set we show how even a 3-neuron neural network can already model relatively complicated data patterns.

Derry, A., Krzywinski, M & Altman, N. (2023) Points of significance: Neural network primer. Nature Methods 20.

Background reading

Lever, J., Krzywinski, M. & Altman, N. (2016) Points of significance: Logistic regression. Nature Methods 13:541–542.

Cell Genomics cover

Mon 16-01-2023

Our cover on the 11 January 2023 Cell Genomics issue depicts the process of determining the parent-of-origin using differential methylation of alleles at imprinted regions (iDMRs) is imagined as a circuit.

Designed in collaboration with with Carlos Urzua.

Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
Our Cell Genomics cover depicts parent-of-origin assignment as a circuit (volume 3, issue 1, 11 January 2023). (more)

Akbari, V. et al. Parent-of-origin detection and chromosome-scale haplotyping using long-read DNA methylation sequencing and Strand-seq (2023) Cell Genomics 3(1).

Browse my gallery of cover designs.

Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
A catalogue of my journal and magazine cover designs. (more)

Science Advances cover

Thu 05-01-2023

My cover design on the 6 January 2023 Science Advances issue depicts DNA sequencing read translation in high-dimensional space. The image showss 672 bases of sequencing barcodes generated by three different single-cell RNA sequencing platforms were encoded as oriented triangles on the faces of three 7-dimensional cubes.

More details about the design.

Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
My Science Advances cover that encodes sequence onto hypercubes (volume 9, issue 1, 6 January 2023). (more)

Kijima, Y. et al. A universal sequencing read interpreter (2023) Science Advances 9.

Browse my gallery of cover designs.

Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
A catalogue of my journal and magazine cover designs. (more)

Regression modeling of time-to-event data with censoring

Mon 21-11-2022

If you sit on the sofa for your entire life, you’re running a higher risk of getting heart disease and cancer. —Alex Honnold, American rock climber

In a follow-up to our Survival analysis — time-to-event data and censoring article, we look at how regression can be used to account for additional risk factors in survival analysis.

We explore accelerated failure time regression (AFTR) and the Cox Proportional Hazards model (Cox PH).

Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
Nature Methods Points of Significance column: Regression modeling of time-to-event data with censoring. (read)

Dey, T., Lipsitz, S.R., Cooper, Z., Trinh, Q., Krzywinski, M & Altman, N. (2022) Points of significance: Regression modeling of time-to-event data with censoring. Nature Methods 19.

Music video for Max Cooper's Ascent

Tue 25-10-2022

My 5-dimensional animation sets the visual stage for Max Cooper's Ascent from the album Unspoken Words. I have previously collaborated with Max on telling a story about infinity for his Yearning for the Infinite album.

I provide a walkthrough the video, describe the animation system I created to generate the frames, and show you all the keyframes

Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
Frame 4897 from the music video of Max Cooper's Asent.

The video recently premiered on YouTube.

Renders of the full scene are available as NFTs.

Gene Cultures exhibit — art at the MIT Museum

Tue 25-10-2022

I am more than my genome and my genome is more than me.

The MIT Museum reopened at its new location on 2nd October 2022. The new Gene Cultures exhibit featured my visualization of the human genome, which walks through the size and organization of the genome and some of the important structures.

Martin Krzywinski @MKrzywinski mkweb.bcgsc.ca
My art at the MIT Museum Gene Cultures exhibit tells shows the scale and structure of the human genome. Pay no attention to the pink chicken.

© 1999–2023 Martin Krzywinski | contact | Canada's Michael Smith Genome Sciences CentreBC Cancer Research CenterBC CancerPHSA