Search Results

Now showing 1 - 6 of 6
  • Item
    FLIM data analysis based on Laguerre polynomial decomposition and machine-learning
    (Bellingham, Wash. : SPIE, 2021) Guo, Shuxia; Silge, Anja; Bae, Hyeonsoo; Tolstik, Tatiana; Meyer, Tobias; Matziolis, Georg; Schmitt, Michael; Popp, Jürgen; Bocklitz, Thomas
    Significance: The potential of fluorescence lifetime imaging microscopy (FLIM) is recently being recognized, especially in biological studies. However, FLIM does not directly measure the lifetimes, rather it records the fluorescence decay traces. The lifetimes and/or abundances have to be estimated from these traces during the phase of data processing. To precisely estimate these parameters is challenging and requires a well-designed computer program. Conventionally employed methods, which are based on curve fitting, are computationally expensive and limited in performance especially for highly noisy FLIM data. The graphical analysis, while free of fit, requires calibration samples for a quantitative analysis. Aim: We propose to extract the lifetimes and abundances directly from the decay traces through machine learning (ML). Approach: The ML-based approach was verified with simulated testing data in which the lifetimes and abundances were known exactly. Thereafter, we compared its performance with the commercial software SPCImage based on datasets measured from biological samples on a time-correlated single photon counting system. We reconstructed the decay traces using the lifetime and abundance values estimated by ML and SPCImage methods and utilized the root-mean-squared-error (RMSE) as marker. Results: The RMSE, which represents the difference between the reconstructed and measured decay traces, was observed to be lower for ML than for SPCImage. In addition, we could demonstrate with a three-component analysis the high potential and flexibility of the ML method to deal with more than two lifetime components.
  • Item
    Multimodal Nonlinear Microscopy for Therapy Monitoring of Cold Atmospheric Plasma Treatment
    (Basel : MDPI, 2019) Meyer, Tobias; Bae, Hyeonsoo; Hasse, Sybille; Winter, Jörn; von Woedtke, Thomas; Schmitt, Michael; Weltmann, Klaus-Dieter; Popp, Jürgen
    Here we report on a non-linear spectroscopic method for visualization of cold atmospheric plasma (CAP)-induced changes in tissue for reaching a new quality level of CAP application in medicine via online monitoring of wound or cancer treatment. A combination of coherent anti-Stokes Raman scattering (CARS), two-photon fluorescence lifetime imaging (2P-FLIM) and second harmonic generation (SHG) microscopy has been used for non-invasive and label-free detection of CAP-induced changes on human skin and mucosa samples. By correlation with histochemical staining, the observed local increase in fluorescence could be assigned to melanin. CARS and SHG prove the integrity of the tissue structure, visualize tissue morphology and composition. The influence of plasma effects by variation of plasma parameters e.g., duration of treatment, gas composition and plasma source has been evaluated. Overall quantitative spectroscopic markers could be identified for a direct monitoring of CAP-treated tissue areas, which is very important for translating CAPs into clinical routine.
  • Item
    Semantic segmentation of non-linear multimodal images for disease grading of inflammatory bowel disease: A segnet-based application
    ([Sétubal] : SCITEPRESS - Science and Technology Publications Lda., 2019) Pradhan, Pranita; Meyer, Tobias; Vieth, Michael; Stallmach, Andreas; Waldner, Maximilian; Schmitt, Michael; Popp, Juergen; Bocklitz, Thomas; De Marsico, Maria; Sanniti di Baja, Gabriella; Fred, Ana
    Non-linear multimodal imaging, the combination of coherent anti-stokes Raman scattering (CARS), two-photon excited fluorescence (TPEF) and second harmonic generation (SHG), has shown its potential to assist the diagnosis of different inflammatory bowel diseases (IBDs). This label-free imaging technique can support the ‘gold-standard’ techniques such as colonoscopy and histopathology to ensure an IBD diagnosis in clinical environment. Moreover, non-linear multimodal imaging can measure biomolecular changes in different tissue regions such as crypt and mucosa region, which serve as a predictive marker for IBD severity. To achieve a real-time assessment of IBD severity, an automatic segmentation of the crypt and mucosa regions is needed. In this paper, we semantically segment the crypt and mucosa region using a deep neural network. We utilized the SegNet architecture (Badrinarayanan et al., 2015) and compared its results with a classical machine learning approach. Our trained SegNet mod el achieved an overall F1 score of 0.75. This model outperformed the classical machine learning approach for the segmentation of the crypt and mucosa region in our study.
  • Item
    A rigid coherent anti-Stokes Raman scattering endoscope with high resolution and a large field of view
    (College Park : American Institute of Physics, 2018) Zirak, P.; Matz, Gregor; Messerschmidt, Bernhard; Meyer, Tobias; Schmitt, Michael; Popp, Jürgen; Uckermann, Ortrud; Galli, R.; Kirsch, Matthias; Winterhalder, M.J.; Zumbusch, A.
    Nonlinear optical endoscopy is an attractive technique for biomedical imaging since it promises to give access to high resolution imaging in vivo. Among the various techniques used for endoscopic contrast generation, coherent anti-Stokes Raman scattering (CARS) is especially interesting. CARS endoscopy allows molecule specific imaging of unlabeled samples. In this contribution, we describe the design, implementation, and experimental characterization of a rigid, compact CARS endoscope with a spatial resolution of 750 nm over a field of view of roughly 250 μm. Omission of the relay optics and use of a gradient index lens specifically designed for this application allow one to realize these specifications in an endoscopic unit which is 2.2 mm wide over a length of 187 mm, making clinical applications during surgical interventions possible. Multimodal use of the endoscope is demonstrated with images of samples with neurosurgical relevance.Nonlinear optical endoscopy is an attractive technique for biomedical imaging since it promises to give access to high resolution imaging in vivo. Among the various techniques used for endoscopic contrast generation, coherent anti-Stokes Raman scattering (CARS) is especially interesting. CARS endoscopy allows molecule specific imaging of unlabeled samples. In this contribution, we describe the design, implementation, and experimental characterization of a rigid, compact CARS endoscope with a spatial resolution of 750 nm over a field of view of roughly 250 μm. Omission of the relay optics and use of a gradient index lens specifically designed for this application allow one to realize these specifications in an endoscopic unit which is 2.2 mm wide over a length of 187 mm, making clinical applications during surgical interventions possible. Multimodal use of the endoscope is demonstrated with images of samples with neurosurgical relevance.
  • Item
    Comparison of hyperspectral coherent Raman scattering microscopies for biomedical applications
    (College Park : American Institute of Physics, 2018) Bocklitz, Thomas W.; Meyer, Tobias; Schmitt, Michael; Rimke, Ingo; Hoffmann, Franziska; von Eggeling, Ferdinand; Ernst, G.; Guntinas-Lichius, Orlando; Popp, Jürgen
    Raman scattering based imaging represents a very powerful optical tool for biomedical diagnostics. Different Raman signatures obtained by distinct tissue structures and disease induced changes provoke sophisticated analysis of the hyperspectral Raman datasets. While the analysis of linear Raman spectroscopic tissue data is quite established, the evaluation of hyperspectral nonlinear Raman data has not yet been evaluated in great detail. The two most common nonlinear Raman methods are CARS (coherent anti-Stokes Raman scattering) and SRS (stimulated Raman scattering) spectroscopy. Specifically the linear concentration dependence of SRS as compared to the quadratic dependence of CARS has fostered the application of SRS tissue imaging. Here, we applied spectral processing to hyperspectral SRS and CARS data for tissue characterization. We could demonstrate for the first time that similar cluster distributions can be obtained for multispectral CARS and SRS data but that clustering is based on different spectral features due to interference effects in CARS and the different concentration dependence of CARS and SRS. It is shown that a direct combination of CARS and SRS data does not improve the clustering results.
  • Item
    Computational tissue staining of non-linear multimodal imaging using supervised and unsupervised deep learning
    (Washington, DC : OSA, 2021) Pradhan, Pranita; Meyer, Tobias; Vieth, Michael; Stallmach, Andreas; Waldner, Maximilian; Schmitt, Michael; Popp, Juergen; Bocklitz, Thomas
    Hematoxylin and Eosin (H&E) staining is the 'gold-standard' method in histopathology. However, standard H&E staining of high-quality tissue sections requires long sample preparation times including sample embedding, which restricts its application for 'real-time' disease diagnosis. Due to this reason, a label-free alternative technique like non-linear multimodal (NLM) imaging, which is the combination of three non-linear optical modalities including coherent anti-Stokes Raman scattering, two-photon excitation fluorescence and second-harmonic generation, is proposed in this work. To correlate the information of the NLM images with H&E images, this work proposes computational staining of NLM images using deep learning models in a supervised and an unsupervised approach. In the supervised and the unsupervised approach, conditional generative adversarial networks (CGANs) and cycle conditional generative adversarial networks (cycle CGANs) are used, respectively. Both CGAN and cycle CGAN models generate pseudo H&E images, which are quantitatively analyzed based on mean squared error, structure similarity index and color shading similarity index. The mean of the three metrics calculated for the computationally generated H&E images indicate significant performance. Thus, utilizing CGAN and cycle CGAN models for computational staining is beneficial for diagnostic applications without performing a laboratory-based staining procedure. To the author's best knowledge, it is the first time that NLM images are computationally stained to H&E images using GANs in an unsupervised manner.