Master's Research Project
A Visual Literacy Module on Subcellular Scale
Visual literacy is the ability to glean useful information and form mental models from visualizations, however it is not explicitly taught, so students are expected to develop those skills on their own. This leads students to form misconceptions based on the way information is visually presented — one common example is a skewed sense of organelle size due to the way cells are often simplified in diagrams.
This misconception will be addressed in a web-based module aimed at first-year undergraduate biology students using the BioLEAP (Biology Learning Engagement and Assessment Platform) in conjunction with the first-year biology curriculum at the University of Toronto Mississauga.
The project was two short animations for the module. Part I: A Primer on Subcellular Scale provides a frame of reference for organelle size by magnifying a cell to the size of a person, and Part II: Interpreting Scale in Visualizations examines strategies for thinking critically about how scale is visually represented.
BMC Faculty Supervisors:
Dr. Jodie Jenkinson (Primary)
Prof. Michael Corrin
Prof. Marc Dryer
Content Advisor:
Dr. Fiona Rawle, Department of Biology, University of Toronto Mississauga
PART I: A Primer on Subcellular Scale
&
Questions:
How big is a cell?
How big are organelles relative to one another?
We can read about measurements in the micrometre scale, but those numbers don't mean much without a frame of reference. This animation magnifies a cell to the person scale so that we can relate organelle size to familiar everyday objects.
PART II: Interpreting Scale in Visualizations
Questions:
Why is scale sometimes misrepresented in visualizations?
When does it matter whether a cell is accurately represented?
Visualizations aim to explain things clearly, but sometimes emphasizing details for clarity comes at a cost of accuracy. This animation deconstructs visualizations of cells to explain why we need to think critically about how information is visually presented.
Process Work
crop.jpg)
hehebg.jpg)
Scripts & Storyboards
After researching the content, scripts were written and then visualized into storyboards for the purpose of getting feedback before working on the animation. Further changes to the script continued to be made after the storyboard stage.
Animatics
The storyboards were turned into rough animations to work out timing and tone. I ended up making two iterations of each part after feedback. Below are the most recent iterations of each part.
Animatic PART I:
A Primer on Subcellular Scale
Animatic PART II:
Interpreting Scale in Visualizations
Production
3D assets were sculpted in Maya and/or ZBrush, and brought into Maya for rigging, animation, and rendering. Then the rendered frames were brought into After Effects. Each component had its own challenges, which I've broken up below.
I kept a Google Doc of notes for the problems I've encountered and solved on my MRP journey, because what's the point in solving a problem if you can't remember how you did it? My hope is that it will help any current students or artists visiting this page that are looking for tips in Maya, ZBrush, or After Effects. Sorry if it's messy!
Blobert, Rigging, and Object Tracking
Our main character, nicknamed Blobert, was modeled from scratch in Maya with help from James Taylor tutorials. He was rigged with control shapes at his hands, feet, and pelvis. His hands were programmed with set driven keys to control finger flexion/extension, thumb abduction/adduction, wrist flexion/extension, pronation/supination, and ulnar/radial flexion.
The complex rigging was worth it to be able to control all of Blobert's little nuanced movements.
Blobert's face was animated and tracked onto his head in After Effects.
Resources:
-
Taylor, James. 2014. Maya bodybuilder CHARACTER MODELING tutorial. https://www.youtube.com/watch?v=spi4lGxnMZg
-
Taylor, James. 2013. Maya Character modeling tutorial, part 2 - Hands and Feet. https://www.youtube.com/watch?v=qxx6QCbL7dQ
-
Dryer, Marc. 2018. Using Set Driven Keys in Maya. https://www.youtube.com/watch?v=WsFbhpiVIXk
-
Al-Rahmawi, Ammar. 2014. Set Driven Key/ SDK Mirror and Copy Script Autodesk Maya. https://www.youtube.com/watch?v=FVEgvHWCKRE
-
TipTut. 2017. How to Loop Compositions | After Effects Tutorial. https://www.youtube.com/watch?v=AJ_3yZBhXDc&feature=youtu.be
Sculpting Subcellular Structures
.png)
.png)
.png)
.png)
I sculpted ZBrush models of the rough ER (endoplasmic reticulum) without added ribosomes, smooth ER, a cross-sectional view, and separated layers of the golgi apparatus. After bringing these into Maya, the mesh had to be cleaned up quite a bit due to the thinness of the shapes causing faces to intersect with themselves.
Here I brought the models into Maya and tested the transmission settings to make sure the nucleus is visible through all the layers of the rough ER. This is before the cleanup so some edges are still jagged.
Ribosomes were added to the rough ER using MASH distribution on mesh. There are about 6,000,000 ribosomes in a real mouse fibroblast (1) but only about 200,000 are simulated for this project.
Resources:
-
(1) Bionumbers.org: BNID 113783 - Yewdell JW, Reits E, Neefjes J. Making sense of mass destruction: quantitating MHC class I antigen presentation. Nat Rev Immunol. 2003 Dec3(12):952-61. DOI: 10.1038/nri1250
The set of ER models were cut with booleans in ZBrush for this cross section. There are 2,000 nuclear pore complexes simulated here, a realistic number (2). The depth of field in the right image was done in After Effects using Frischluft Lenscare. The size and shape of the golgi was changed after feedback to better reflect an animal cell (right).
Resources:
-
(2) Bionumbers.org: BNID 111130 - Adam SA. The nuclear pore complex. Genome Biol. 2001 2(9):REVIEWS0007
Golgi Apparatus and nParticles
-golgi.png)
I experimented with animating the budding and merging of the golgi using MASH-distributed nParticles. Originally I had hoped to show a cross-section of vesicles passing between cisternae, but that ended up being unnecessary, so we only see a static outer view in the final animation.
The nParticles in each cistern and bud were controlled with deform clusters. I tried several different amounts of particles, but at 90,000 nParticles, the simulation became very heavy and slow to work with, so even though some parts of the mesh still look holey, it wasn't feasible to increase the density of particles further. I was advised that the buds and stacks (left) were too thick, so the final animation uses a finer static model instead (right).
Resources:
-
Maya Guy. 2015. Maya Tutorial Nparticles to Mesh (pulling geometry apart). https://www.youtube.com/watch?v=J8e_6Ha43kU
Newspaper Texture, nCloth, & MASH
To get Blobert's main newspaper to fold and flap, I used an nCloth plane with the edges and centre constrained to a rig. This way, I was able to control the translation and folding of the newspaper while retaining the more subtle warping movements (left).
The falling and wrapping newspapers were accomplished using MASH reproMesh (highlighted in green, below) and a merge node. Originally I had planned to use nCloths, but MASH ended up being much easier to control. There was some clipping within the geometry, so I manually animated three newspapers to block most of the problem areas (highlighted in white, below).
crop.jpg)
Resources:
-
Autodesk Help. 2016. Create nCloth Point to Surface constraints. https://knowledge.autodesk.com/support/maya/learn-explore/caas/CloudHelp/cloudhelp/2016/ENU/Maya/files/GUID-E63DA358-F904-4FD9-B45C-4046AB0D97EB-htm.html
-
Ian Waters. 2016. Maya 2016 Ext 2 - 'Particle Goals' with the Merge node. https://www.youtube.com/watch?v=cIHJycS345c
For the newspaper print, I knew I wanted to design it myself and include references to my classmates' projects. Above (middle) is the first experiment with mapping an image made in Photoshop onto the newspaper plane (left). On the (right) is one of the final shots with newspapers wrapped around Blobert.
Below are the final outside and inside spreads that were mapped onto each side of the plane, made in InDesign and Photoshop. The headings and subheadings are in reference to my classmates' projects. For the images used within the newspaper, I quickly threw them together in Maya based on shots from those respective projects. The body text is taken from my project proposal.
Click each of the articles to view that artist's website!
Resources:
-
Autodesk Help. 2016. Create double-sided shaded surfaces. https://knowledge.autodesk.com/support/maya/learn-explore/caas/CloudHelp/cloudhelp/2016/ENU/Maya/files/GUID-E4CA98D6-ACF8-4B97-BE9D-4E69A2275A37-htm.html
Sandwiches & MASH Dynamics
-ncloth.png)
For the sandwiches, I started out by sculpting and assembling the individual ingredients. I initially tried to animate them with nCloth so I could get the deli meats to fold dynamically, but I ran into too many problems with objects clipping through each other (top left), and the simulation times began to rack up. So I decided to switch to MASH dynamics, which calculates much faster at the cost of the ingredients remaining stiff.
Resources:
-
Ian Waters. 2017. MASH Dynamics No 2. Collide Two MASH Networks. https://www.youtube.com/watch?v=w5KQcduVtlQ
-
Autodesk Help. 2016. Caching MASH networks for rendering. https://knowledge.autodesk.com/support/maya/learn-explore/caas/CloudHelp/cloudhelp/2016/ENU/Maya/files/GUID-9DB5EBE8-8514-492A-B74E-6F87CFDFE220-htm.html
Post-Production
After all of the frames were rendered out of Maya, I composited them together in After Effects. Here I applied colour correction, motion tracking, text, sound, time remapping, 3D camera, depth of field, and I used masks to fix animation errors. Below is an example of the layers of renders and effects that went into a single frame of the final animation.
Bloopers
To thank you for scrolling all the way to the bottom, here is a blooper reel of many of the mistakes I managed to record during the production of this project. Many other mistakes were made, of course, but they were not as visually entertaining. Enjoy!
Thanks for reading!