Volume rendering
Prerequisites
Before starting this lesson, you should be familiar with:
Learning Objectives
After completing this lesson, learners should be able to:
Understand the concepts and some methods of 3-D rendering.
Appreciate that 3-D rendering can be challenging for some data.
Perform basic volume rendering using a software tool.
Motivation
Intuitively grasping 3-D shapes requires visualisation of the whole object. This is not possible when just looking at one or several slices of a 3-D data set. Thus is it important about different volume rendering techniques that can create a 3-D appearance of the whole image. This is especially useful for sparse data, where individual 2-D slices only contain a small subset of the relevant information.
Concept map
graph TD
D("3-D image data") --> R("Volume rendering")
R --> A("2-D image with 3-D appearance")
R -->|"Virtual Reality"| AA("Two 2-D images (one per eye)")
R ---|has| M("Many methods and settings...")
Figure
Activities
Volume rendering
- Open a volume viewer with one of the below example images.
- Explore different volume rendering modes, such as
- Maximum projection
- Explore different camera positions
- Volume rendering
- Explore various transparency (alpha) mappings.
- Interesting for 3-D FIB-SEM
- Explore various transparency (alpha) mappings.
- Iso-surface rendering
- Explore various surface thresholds
- Explore changing the light position
- Maximum projection
- Save a snapshot.
- Create and save a custom animation, e.g. rotating the image.
Example data
- 3-D+t Chromosome congression
- Useful to see in 3-D rendering (as it is very hard to see what is going on in 2-D slices)
- 3-D EM and segmentation
- EM data is difficult to render in 3-D but for the segmentation channel it is very useful
- Note that the segmentation channel does not look good in a max-projection; actual volume rendering is much better.
- 3-D MRI head
- Good to compare various rendering modes
- 3-D Organoid nuclei
- Challenge: Outer nuclei occulde inner nuclei
- 3-D FIB-SEM
- Challenge: Dense signal, background is bright
- 3-D Tissue segmentation label mask
- Challenge: Epithelial tissue occludes inside
Show activity for:
ImageJ 3D Viewer
- Open Fiji
- Open a 3D image of choice (see above for a list of example images)
Plugins > 3D Viewer
- Explore rendering modes
Edit > Display as
- Volume: Volume rendering
Edit > Transfer function
- Transparency: Channel: Alpha
- Iso-Surface: Surface
Edit > Adjust threshold
Edit > Change color
skimage napari
napari standalone app
- Install
napari standalone app
as described in tools installation- Open
napari
- Load an image using
File > Open File(s)...
or pressCtrl+O
. One can alsodrag and drop
an image into the GUI area to open it- Change viewer from 2D to 3D
- zoom in and out (mouse scroll)
- rotate the volume (pressing and holding left-click of mouse)
- pan (Shift + pressing and holding left-click of mouse)
- Add axes by clicking on
View > Axes > Axes Visible
- Add scale bar by clicking on
View > Scale Bar > Scale Bar Visible
- Open the same image in Fiji and note down the calibration given in
Image > Properties...
- Add the scale by opening a console within
napari
GUI and type this:
viewer.layers[viewer.layers[0].name].scale = [z, y, x]
- where,
x
,y
andz
are scaling factors in their respective dimensions. Set this according to the metadata (i.e. the calibration noted down in the previous step) of the image.- Note(IMPORTANT): the above command
viewer.layers[0].name
only works if you have loaded just one image innapari
- Try different
rendering
modes:mip
,iso
,attenuated_mip
Assessment
True or False
- Surface rendering and volume rendering are identical words for the same 3-D visualisation method.
- Volume rendering is particularly useful for data containing very dense 3-D information such as very many cells or nuclei in an organ of a biological specimen.
- Volume rendering is a simple algorithm that can easily be used without expert knowledge.
- Volume rendering is very useful to get an impression of the morphology and spatial distribution of objects.
Solution
- False. Although both methods are used for 3-D rendering they are different. In surface rendering one needs to define “the shell” of an object and only this will be visible. In volume rendering the intensity of all voxels can be represented such as in a maximum intensity projection based volume rendering.
- False. If the data is very dense, there is a high probabilty that no matter from which angle you look there will be objects hidden behind other objects. Thus, sparse data can be more suited to 3-D rendering than very dense data.
- False. In fact, volume rendering is very complex and there are many things to learn to master it (see for example this website.
- True. If the sample is not too dense, volume rendering allows one to get a quick overview of the whole 3-D specimen and its morphology.
Explanations
Volume rendering software
Software | Multi-Channel | Time-lapse | Max-Projection | Volume | Iso-Surface | … | … | … | … |
---|---|---|---|---|---|---|---|---|---|
Blender | |||||||||
Drishti | |||||||||
ImageJ 3Dscript | |||||||||
ImageJ 3D viewer | N | N | N | Y | Y | ||||
ImageJ ClearVolume (Upate Site) | Y | Y | Y | N | N | ||||
ImageJ Volume Viewer | N | N | Y | Y | N | ||||
Napari |
Follow-up material
Recommended follow-up modules:
Learn more: