2 results
Search Results
Now showing 1 - 2 of 2
- ItemLooking for a perfect match: multimodal combinations of Raman spectroscopy for biomedical applications(Bellingham, Wash. : SPIE, 2021) Schie, Iwan; Stiebing, Clara; Popp, JürgenRaman spectroscopy has shown very promising results in medical diagnostics by providing label-free and highly specific molecular information of pathological tissue ex vivo and in vivo. Nevertheless, the high specificity of Raman spectroscopy comes at a price, i.e., low acquisition rate, no direct access to depth information, and limited sampling areas. However, a similar case regarding advantages and disadvantages can also be made for other highly regarded optical modalities, such as optical coherence tomography, autofluorescence imaging and fluorescence spectroscopy, fluorescence lifetime microscopy, second-harmonic generation, and others. While in these modalities the acquisition speed is significantly higher, they have no or only limited molecular specificity and are only sensitive to a small group of molecules. It can be safely stated that a single modality provides only a limited view on a specific aspect of a biological specimen and cannot assess the entire complexity of a sample. To solve this issue, multimodal optical systems, which combine different optical modalities tailored to a particular need, become more and more common in translational research and will be indispensable diagnostic tools in clinical pathology in the near future. These systems can assess different and partially complementary aspects of a sample and provide a distinct set of independent biomarkers. Here, we want to give an overview on the development of multimodal systems that use RS in combination with other optical modalities to improve the diagnostic performance.
- ItemComputational tissue staining of non-linear multimodal imaging using supervised and unsupervised deep learning(Washington, DC : OSA, 2021) Pradhan, Pranita; Meyer, Tobias; Vieth, Michael; Stallmach, Andreas; Waldner, Maximilian; Schmitt, Michael; Popp, Juergen; Bocklitz, ThomasHematoxylin and Eosin (H&E) staining is the 'gold-standard' method in histopathology. However, standard H&E staining of high-quality tissue sections requires long sample preparation times including sample embedding, which restricts its application for 'real-time' disease diagnosis. Due to this reason, a label-free alternative technique like non-linear multimodal (NLM) imaging, which is the combination of three non-linear optical modalities including coherent anti-Stokes Raman scattering, two-photon excitation fluorescence and second-harmonic generation, is proposed in this work. To correlate the information of the NLM images with H&E images, this work proposes computational staining of NLM images using deep learning models in a supervised and an unsupervised approach. In the supervised and the unsupervised approach, conditional generative adversarial networks (CGANs) and cycle conditional generative adversarial networks (cycle CGANs) are used, respectively. Both CGAN and cycle CGAN models generate pseudo H&E images, which are quantitatively analyzed based on mean squared error, structure similarity index and color shading similarity index. The mean of the three metrics calculated for the computationally generated H&E images indicate significant performance. Thus, utilizing CGAN and cycle CGAN models for computational staining is beneficial for diagnostic applications without performing a laboratory-based staining procedure. To the author's best knowledge, it is the first time that NLM images are computationally stained to H&E images using GANs in an unsupervised manner.