Spatial and temporal super-resolution for fluorescence microscopy by a recurrent neural network

Jinyang Li, Geng Tong, Yining Pan, Yiting Yu

Research output: Contribution to journalArticlepeer-review

9 Scopus citations

Abstract

A novel spatial and temporal super-resolution (SR) framework based on a recurrent neural network (RNN) is demonstrated. In this work, we learn the complex yet useful features from the temporal data by taking advantage of structural characteristics of RNN and a skip connection. The usage of supervision mechanism is not only making full use of the intermediate output of each recurrent layer to recover the final output, but also alleviating vanishing/exploding gradients during the back-propagation. The proposed scheme achieves excellent reconstruction results, improving both the spatial and temporal resolution of fluorescence images including the simulated and real tubulin datasets. Besides, robustness against various critical metrics, such as the full-width at half-maximum (FWHM) and molecular density, can also be incorporated. In the validation, the performance can be increased by more than 20% for intensity profile, and 8% for FWHM, and the running time can be saved at least 40% compared with the classic Deep-STORM method, a high-performance net which is popularly used for comparison.

Original languageEnglish
Pages (from-to)15747-15763
Number of pages17
JournalOptics Express
Volume29
Issue number10
DOIs
StatePublished - 10 May 2021

Fingerprint

Dive into the research topics of 'Spatial and temporal super-resolution for fluorescence microscopy by a recurrent neural network'. Together they form a unique fingerprint.

Cite this