Search Results
Semantic segmentation of non-linear multimodal images for disease grading of inflammatory bowel disease: A segnet-based application
Non-linear multimodal imaging, the combination of coherent anti-stokes Raman scattering (CARS), two-photon excited fluorescence (TPEF) and second harmonic generation (SHG), has shown its potential to assist the diagnosis of different inflammatory bowel diseases (IBDs). This label-free imaging technique can support the ‘gold-standard’ techniques such as colonoscopy and histopathology to ensure an IBD diagnosis in clinical environment. Moreover, non-linear multimodal imaging can measure biomolecular changes in different tissue regions such as crypt and mucosa region, which serve as a predictive marker for IBD severity. To achieve a real-time assessment of IBD severity, an automatic segmentation of the crypt and mucosa regions is needed. In this paper, we semantically segment the crypt and mucosa region using a deep neural network. We utilized the SegNet architecture (Badrinarayanan et al., 2015) and compared its results with a classical machine learning approach. Our trained SegNet mod el achieved an overall F1 score of 0.75. This model outperformed the classical machine learning approach for the segmentation of the crypt and mucosa region in our study.
Predictive Modeling of Antibiotic Susceptibility in E. Coli Strains Using the U-Net Network and One-Class Classification
The antibiotic resistance of bacterial pathogens has become one of the most serious global health issues due to misusing and overusing of antibiotics. Recently, different technologies were developed to determine bacteria susceptibility towards antibiotics; however, each of these technologies has its advantages and limitations in clinical applications. In this contribution, we aim to assess and automate the detection of bacterial susceptibilities towards three antibiotics; i.e. ciprofloxacin, cefotaxime and piperacillin using a combination of image processing and machine learning algorithms. Therein, microscopic images were collected from different E. coli strains, then the convolutional neural network U-Net was implemented to segment the areas showing bacteria. Subsequently, the encoder part of the trained U-Net was utilized as a feature extractor, and the U-Net bottleneck features were utilized to predict the antibiotic susceptibility of E. coli strains using a one-class support vector machine (OCSVM). This one-class model was always trained on images of untreated controls of each bacterial strain while the image labels of treated bacteria were predicted as control or non-control images. If an image of treated bacteria is predicted as control, we assume that these bacteria resist this antibiotic. In contrast, the sensitive bacteria show different morphology of the control bacteria; therefore, images collected from these treated bacteria are expected to be classified as non-control. Our results showed 83% area under the receiver operating characteristic (ROC) curve when OCSVM models were built using the U-Net bottleneck features of control bacteria images only. Additionally, the mean sensitivities of these one-class models are 91.67% and 86.61% for cefotaxime and piperacillin; respectively. The mean sensitivity for the prediction of ciprofloxacin is only 59.72% as the bacteria morphology was not fully detected by the proposed method.