Search Results
Semantic segmentation of non-linear multimodal images for disease grading of inflammatory bowel disease: A segnet-based application
Non-linear multimodal imaging, the combination of coherent anti-stokes Raman scattering (CARS), two-photon excited fluorescence (TPEF) and second harmonic generation (SHG), has shown its potential to assist the diagnosis of different inflammatory bowel diseases (IBDs). This label-free imaging technique can support the ‘gold-standard’ techniques such as colonoscopy and histopathology to ensure an IBD diagnosis in clinical environment. Moreover, non-linear multimodal imaging can measure biomolecular changes in different tissue regions such as crypt and mucosa region, which serve as a predictive marker for IBD severity. To achieve a real-time assessment of IBD severity, an automatic segmentation of the crypt and mucosa regions is needed. In this paper, we semantically segment the crypt and mucosa region using a deep neural network. We utilized the SegNet architecture (Badrinarayanan et al., 2015) and compared its results with a classical machine learning approach. Our trained SegNet mod el achieved an overall F1 score of 0.75. This model outperformed the classical machine learning approach for the segmentation of the crypt and mucosa region in our study.
A Review on Data Fusion of Multidimensional Medical and Biomedical Data
Data fusion aims to provide a more accurate description of a sample than any one source of data alone. At the same time, data fusion minimizes the uncertainty of the results by combining data from multiple sources. Both aim to improve the characterization of samples and might improve clinical diagnosis and prognosis. In this paper, we present an overview of the advances achieved over the last decades in data fusion approaches in the context of the medical and biomedical fields. We collected approaches for interpreting multiple sources of data in different combinations: image to image, image to biomarker, spectra to image, spectra to spectra, spectra to biomarker, and others. We found that the most prevalent combination is the image-to-image fusion and that most data fusion approaches were applied together with deep learning or machine learning methods.
Vibrational Spectroscopic Investigation of Blood Plasma and Serum by Drop Coating Deposition for Clinical Application
In recent decades, vibrational spectroscopic methods such as Raman and FT-IR spectroscopy are widely applied to investigate plasma and serum samples. These methods are combined with drop coating deposition techniques to pre-concentrate the biomolecules in the dried droplet to improve the detected vibrational signal. However, most often encountered challenge is the inhomogeneous redistribution of biomolecules due to the coffee-ring effect. In this study, the variation in biomolecule distribution within the dried-sample droplet has been investigated using Raman and FT-IR spectroscopy and fluorescence lifetime imaging method. The plasma-sample from healthy donors were investigated to show the spectral differences between the inner and outer-ring region of the dried-sample droplet. Further, the preferred location of deposition of the most abundant protein albumin in the blood during the drying process of the plasma has been illustrated by using deuterated albumin. Subsequently, two patients with different cardiac-related diseases were investigated exemplarily to illustrate the variation in the pattern of plasma and serum biomolecule distribution during the drying process and its impact on patient-stratification. The study shows that a uniform sampling position of the droplet, both at the inner and the outer ring, is necessary for thorough clinical characterization of the patient’s plasma and serum sample using vibrational spectroscopy.
Spatial resolution of tip-enhanced Raman spectroscopy – DFT assessment of the chemical effect
Experimental evidence of extremely high spatial resolution of tip-enhanced Raman scattering (TERS) has been recently demonstrated. Here, we present a full quantum chemical description (at the density functional level of theory) of the non-resonant chemical effects on the Raman spectrum of an adenine molecule mapped by a tip, modeled as a single silver atom or a small silver cluster. We show pronounced changes in the Raman pattern and its intensities depending on the conformation of the nanoparticle–substrate system, concluding that the spatial resolution of the chemical contribution of TERS can be in the sub-nm range.
WE-ASCA: The Weighted-Effect ASCA for Analyzing Unbalanced Multifactorial Designs-A Raman Spectra-Based Example
Analyses of multifactorial experimental designs are used as an explorative technique describing hypothesized multifactorial effects based on their variation. The procedure of analyzing multifactorial designs is well established for univariate data, and it is known as analysis of variance (ANOVA) tests, whereas only a few methods have been developed for multivariate data. In this work, we present the weighted-effect ASCA, named WE-ASCA, as an enhanced version of ANOVA-simultaneous component analysis (ASCA) to deal with multivariate data in unbalanced multifactorial designs. The core of our work is to use general linear models (GLMs) in decomposing the response matrix into a design matrix and a parameter matrix, while the main improvement in WE-ASCA is to implement the weighted-effect (WE) coding in the design matrix. This WE-coding introduces a unique solution to solve GLMs and satisfies a constrain in which the sum of all level effects of a categorical variable equal to zero. To assess the WE-ASCA performance, two applications were demonstrated using a biomedical Raman spectral data set consisting of mice colorectal tissue. The results revealed that WE-ASCA is ideally suitable for analyzing unbalanced designs. Furthermore, if WE-ASCA is applied as a preprocessing tool, the classification performance and its reproducibility can significantly improve.
In situ spectroelectrochemical and theoretical study on the oxidation of a 4H-imidazole-ruthenium dye adsorbed on nanocrystalline TiO2 thin film electrodes
Terpyridine 4H-imidazole-ruthenium(II) complexes are considered promising candidates for use as sensitizers in dye sensitized solar cells (DSSCs) by displaying broad absorption in the visible range, where the dominant absorption features are due to metal-to-ligand charge transfer (MLCT) transitions. The ruthenium(III) intermediates resulting from photoinduced MLCT transitions are essential intermediates in the photoredox-cycle of the DSSC. However, their photophysics is much less studied compared to the ruthenium(II) parent systems. To this end, the structural alterations accompanying one-electron oxidation of the RuIm dye series (including a non-carboxylic RuIm precursor, and, carboxylic RuImCOO in solution and anchored to a nanocrystalline TiO2 film) are investigated via in situ experimental and theoretical UV-Vis absorption and resonance Raman (RR) spectroelectrochemistry. The excellent agreement between the experimental and the TDDFT spectra derived in this work allows for an in-depth assignment of UV-Vis and RR spectral features of the dyes. A concordant pronounced wavelength dependence with respect to the charge transfer character has been observed for the model system RuIm, and both RuImCOO in solution and attached on the TiO2 surface. Excitation at long wavelengths leads to the population of ligand-to-metal charge transfer states, i.e. photoreduction of the central ruthenium(III) ion, while high-energy excitation features an intra-ligand charge transfer state localized on the 4H-imidazole moiety. Therefore, these 4H-imidazole ruthenium complexes investigated here are potential multi-photoelectron donors. One electron is donated from MLCT states, and additionally, the 4H-imidazole ligand reveals electron-donating character with a significant contribution to the excited states of the ruthenium(III) complexes upon blue-light irradiation.
Modified PCA and PLS: Towards a better classification in Raman spectroscopy–based biological applications
Raman spectra of biological samples often exhibit variations originating from changes of spectrometers, measurement conditions, and cultivation conditions. Such unwanted variations make a classification extremely challenging, especially if they are more significant compared with the differences between groups to be separated. A classifier is prone to such unwanted variations (ie, intragroup variations) and can fail to learn the patterns that can help separate different groups (ie, intergroup differences). This often leads to a poor generalization performance and a degraded transferability of the trained model. A natural solution is to separate the intragroup variations from the intergroup differences and build the classifier based on merely the latter information, for example, by a well-designed feature extraction. This forms the idea of this contribution. Herein, we modified two commonly applied feature extraction approaches, principal component analysis (PCA) and partial least squares (PLS), in order to extract merely the features representing the intergroup differences. Both of the methods were verified with two Raman spectral datasets measured from bacterial cultures and colon tissues of mice, respectively. In comparison to ordinary PCA and PLS, the modified PCA was able to improve the prediction on the testing data that bears significant difference to the training data, while the modified PLS could help avoid overfitting and lead to a more stable classification. © 2019 The Authors. Journal of Chemometrics published by John Wiley & Sons Ltd
A Machine Learning-Based Raman Spectroscopic Assay for the Identification of Burkholderia mallei and Related Species
Burkholderia (B.) mallei, the causative agent of glanders, and B. pseudomallei, the causative agent of melioidosis in humans and animals, are genetically closely related. The high infectious potential of both organisms, their serological cross-reactivity, and similar clinical symptoms in human and animals make the differentiation from each other and other Burkholderia species challenging. The increased resistance against many antibiotics implies the need for fast and robust identification methods. The use of Raman microspectroscopy in microbial diagnostic has the potential for rapid and reliable identification. Single bacterial cells are directly probed and a broad range of phenotypic information is recorded, which is subsequently analyzed by machine learning methods. Burkholderia were handled under biosafety level 1 (BSL 1) conditions after heat inactivation. The clusters of the spectral phenotypes and the diagnostic relevance of the Burkholderia spp. were considered for an advanced hierarchical machine learning approach. The strain panel for training involved 12 B. mallei, 13 B. pseudomallei and 11 other Burkholderia spp. type strains. The combination of top- and sub-level classifier identified the mallei-complex with high sensitivities (>95%). The reliable identification of unknown B. mallei and B. pseudomallei strains highlighted the robustness of the machine learning-based Raman spectroscopic assay. © 2019 by the authors
Biochemical Analysis of Leukocytes after In Vitro and In Vivo Activation with Bacterial and Fungal Pathogens Using Raman Spectroscopy
Biochemical information from activated leukocytes provide valuable diagnostic information. In this study, Raman spectroscopy was applied as a label-free analytical technique to characterize the activation pattern of leukocyte subpopulations in an in vitro infection model. Neutrophils, monocytes, and lymphocytes were isolated from healthy volunteers and stimulated with heat-inactivated clinical isolates of Candida albicans, Staphylococcus aureus, and Klebsiella pneumoniae. Binary classification models could identify the presence of infection for monocytes and lymphocytes, classify the type of infection as bacterial or fungal for neutrophils, monocytes, and lymphocytes and distinguish the cause of infection as Gram-negative or Gram-positive bacteria in the monocyte subpopulation. Changes in single-cell Raman spectra, upon leukocyte stimulation, can be explained with biochemical changes due to the leukocyte’s specific reaction to each type of pathogen. Raman spectra of leukocytes from the in vitro infection model were compared with spectra from leukocytes of patients with infection (DRKS-ID: DRKS00006265) with the same pathogen groups, and a good agreement was revealed. Our study elucidates the potential of Raman spectroscopy-based single-cell analysis for the differentiation of circulating leukocyte subtypes and identification of the infection by probing the molecular phenotype of those cells.
FLIM data analysis based on Laguerre polynomial decomposition and machine-learning
Significance: The potential of fluorescence lifetime imaging microscopy (FLIM) is recently being recognized, especially in biological studies. However, FLIM does not directly measure the lifetimes, rather it records the fluorescence decay traces. The lifetimes and/or abundances have to be estimated from these traces during the phase of data processing. To precisely estimate these parameters is challenging and requires a well-designed computer program. Conventionally employed methods, which are based on curve fitting, are computationally expensive and limited in performance especially for highly noisy FLIM data. The graphical analysis, while free of fit, requires calibration samples for a quantitative analysis. Aim: We propose to extract the lifetimes and abundances directly from the decay traces through machine learning (ML). Approach: The ML-based approach was verified with simulated testing data in which the lifetimes and abundances were known exactly. Thereafter, we compared its performance with the commercial software SPCImage based on datasets measured from biological samples on a time-correlated single photon counting system. We reconstructed the decay traces using the lifetime and abundance values estimated by ML and SPCImage methods and utilized the root-mean-squared-error (RMSE) as marker. Results: The RMSE, which represents the difference between the reconstructed and measured decay traces, was observed to be lower for ML than for SPCImage. In addition, we could demonstrate with a three-component analysis the high potential and flexibility of the ML method to deal with more than two lifetime components.