PUBLICATION

Three-dimensional fluorescence microscopy through virtual refocusing using a recursive light propagation network

Authors
Shin, C., Ryu, H., Cho, E.S., Han, S., Lee, K.H., Kim, C.H., Yoon, Y.G.
ID
ZDB-PUB-220920-37
Date
2022
Source
Medical image analysis   82: 102600 (Journal)
Registered Authors
Kim, Cheol-Hee
Keywords
3-D volume estimation, Fluorescence microscopy, Recursive inference, Recursive neural network, Virtual refocusing
MeSH Terms
  • Animals
  • Microscopy, Fluorescence/methods
  • Neural Networks, Computer
  • Neurons
  • Software*
  • Zebrafish*
PubMed
36116298 Full text @ Med. Image Anal.
Abstract
Three-dimensional fluorescence microscopy has an intrinsic performance limit set by the number of photons that can be collected from the sample in a given time interval. Here, we extend our earlier work - a recursive light propagation network (RLP-Net) - which is a computational microscopy technique that overcomes such limitations through virtual refocusing that enables volume reconstruction from two adjacent 2-D wide-field fluorescence images. RLP-Net employs a recursive inference scheme in which the network progressively predicts the subsequent planes along the axial direction. This recursive inference scheme reflects that the law of physics for the light propagation remains spatially invariant and therefore a fixed function (i.e., a neural network) for a short distance light propagation can be recursively applied for a longer distance light propagation. In addition, we employ a self-supervised denoising method to enable accurate virtual light propagation over a long distance. We demonstrate the capability of our method through high-speed volumetric imaging of neuronal activity of a live zebrafish brain. The source code used in the paper is available at https://github.com/NICALab/rlpnet.
Genes / Markers
Figures
Show all Figures
Expression
Phenotype
Mutations / Transgenics
Human Disease / Model
Sequence Targeting Reagents
Fish
Antibodies
Orthology
Engineered Foreign Genes
Mapping