Search Results

Now showing 1 - 3 of 3
  • Item
    Semantic segmentation of non-linear multimodal images for disease grading of inflammatory bowel disease: A segnet-based application
    ([Sétubal] : SCITEPRESS - Science and Technology Publications Lda., 2019) Pradhan, Pranita; Meyer, Tobias; Vieth, Michael; Stallmach, Andreas; Waldner, Maximilian; Schmitt, Michael; Popp, Juergen; Bocklitz, Thomas; De Marsico, Maria; Sanniti di Baja, Gabriella; Fred, Ana
    Non-linear multimodal imaging, the combination of coherent anti-stokes Raman scattering (CARS), two-photon excited fluorescence (TPEF) and second harmonic generation (SHG), has shown its potential to assist the diagnosis of different inflammatory bowel diseases (IBDs). This label-free imaging technique can support the ‘gold-standard’ techniques such as colonoscopy and histopathology to ensure an IBD diagnosis in clinical environment. Moreover, non-linear multimodal imaging can measure biomolecular changes in different tissue regions such as crypt and mucosa region, which serve as a predictive marker for IBD severity. To achieve a real-time assessment of IBD severity, an automatic segmentation of the crypt and mucosa regions is needed. In this paper, we semantically segment the crypt and mucosa region using a deep neural network. We utilized the SegNet architecture (Badrinarayanan et al., 2015) and compared its results with a classical machine learning approach. Our trained SegNet mod el achieved an overall F1 score of 0.75. This model outperformed the classical machine learning approach for the segmentation of the crypt and mucosa region in our study.
  • Item
    Computational tissue staining of non-linear multimodal imaging using supervised and unsupervised deep learning
    (Washington, DC : OSA, 2021) Pradhan, Pranita; Meyer, Tobias; Vieth, Michael; Stallmach, Andreas; Waldner, Maximilian; Schmitt, Michael; Popp, Juergen; Bocklitz, Thomas
    Hematoxylin and Eosin (H&E) staining is the 'gold-standard' method in histopathology. However, standard H&E staining of high-quality tissue sections requires long sample preparation times including sample embedding, which restricts its application for 'real-time' disease diagnosis. Due to this reason, a label-free alternative technique like non-linear multimodal (NLM) imaging, which is the combination of three non-linear optical modalities including coherent anti-Stokes Raman scattering, two-photon excitation fluorescence and second-harmonic generation, is proposed in this work. To correlate the information of the NLM images with H&E images, this work proposes computational staining of NLM images using deep learning models in a supervised and an unsupervised approach. In the supervised and the unsupervised approach, conditional generative adversarial networks (CGANs) and cycle conditional generative adversarial networks (cycle CGANs) are used, respectively. Both CGAN and cycle CGAN models generate pseudo H&E images, which are quantitatively analyzed based on mean squared error, structure similarity index and color shading similarity index. The mean of the three metrics calculated for the computationally generated H&E images indicate significant performance. Thus, utilizing CGAN and cycle CGAN models for computational staining is beneficial for diagnostic applications without performing a laboratory-based staining procedure. To the author's best knowledge, it is the first time that NLM images are computationally stained to H&E images using GANs in an unsupervised manner.
  • Item
    Intestinal epithelial barrier integrity investigated by label-free techniques in ulcerative colitis patients
    ([London] : Macmillan Publishers Limited, part of Springer Nature, 2023) Quansah, Elsie; Gardey, Elena; Ramoji, Anuradha; Meyer-Zedler, Tobias; Goehrig, Bianca; Heutelbeck, Astrid; Hoeppener, Stephanie; Schmitt, Michael; Waldner, Maximillian; Stallmach, Andreas; Popp, Jürgen
    The intestinal epithelial barrier, among other compartments such as the mucosal immune system, contributes to the maintenance of intestinal homeostasis. Therefore, any disturbance within the epithelial layer could lead to intestinal permeability and promote mucosal inflammation. Considering that disintegration of the intestinal epithelial barrier is a key element in the etiology of ulcerative colitis, further assessment of barrier integrity could contribute to a better understanding of the role of epithelial barrier defects in ulcerative colitis (UC), one major form of chronic inflammatory bowel disease. Herein, we employ fast, non-destructive, and label-free non-linear methods, namely coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG), two-photon excited fluorescence (TPEF), and two-photon fluorescence lifetime imaging (2P-FLIM), to assess the morpho-chemical contributions leading to the dysfunction of the epithelial barrier. For the first time, the formation of epithelial barrier gaps was directly visualized, without sophisticated data analysis procedures, by the 3D analysis of the colonic mucosa from severely inflamed UC patients. The results were compared with histopathological and immunofluorescence images and validated using transmission electron microscopy (TEM) to indicate structural alterations of the apical junction complex as the underlying cause for the formation of the epithelial barrier gaps. Our findings suggest the potential advantage of non-linear multimodal imaging is to give precise, detailed, and direct visualization of the epithelial barrier in the gastrointestinal tract, which can be combined with a fiber probe for future endomicroscopy measurements during real-time in vivo imaging.