15 results
Search Results
Now showing 1 - 10 of 15
- ItemEarth system data cubes unravel global multivariate dynamics(Göttingen : Copernicus Publ., 2020) Mahecha, Miguel D.; Gans, Fabian; Brandt, Gunnar; Christiansen, Rune; Cornell, Sarah E.; Fomferra, Normann; Kraemer, Guido; Peters, Jonas; Bodesheim, Paul; Camps-Valls, Gustau; Donges, Jonathan F.; Dorigo, Wouter; Estupinan-Suarez, Lina M.; Gutierrez-Velez, Victor H.; Gutwin, Martin; Jung, Martin; Londoño, Maria C.; Miralles, Diego G.; Papastefanou, Phillip; Reichstein, MarkusUnderstanding Earth system dynamics in light of ongoing human intervention and dependency remains a major scientific challenge. The unprecedented availability of data streams describing different facets of the Earth now offers fundamentally new avenues to address this quest. However, several practical hurdles, especially the lack of data interoperability, limit the joint potential of these data streams. Today, many initiatives within and beyond the Earth system sciences are exploring new approaches to overcome these hurdles and meet the growing interdisciplinary need for data-intensive research; using data cubes is one promising avenue. Here, we introduce the concept of Earth system data cubes and how to operate on them in a formal way. The idea is that treating multiple data dimensions, such as spatial, temporal, variable, frequency, and other grids alike, allows effective application of user-defined functions to co-interpret Earth observations and/or model-data integration. An implementation of this concept combines analysis-ready data cubes with a suitable analytic interface. In three case studies, we demonstrate how the concept and its implementation facilitate the execution of complex workflows for research across multiple variables, and spatial and temporal scales: (1) summary statistics for ecosystem and climate dynamics; (2) intrinsic dimensionality analysis on multiple timescales; and (3) model-data integration. We discuss the emerging perspectives for investigating global interacting and coupled phenomena in observed or simulated data. In particular, we see many emerging perspectives of this approach for interpreting large-scale model ensembles. The latest developments in machine learning, causal inference, and model-data integration can be seamlessly implemented in the proposed framework, supporting rapid progress in data-intensive research across disciplinary boundaries. © 2020 Institute of Electrical and Electronics Engineers Inc.. All rights reserved.
- ItemA Review on Data Fusion of Multidimensional Medical and Biomedical Data(Basel : MDPI, 2022) Azam, Kazi Sultana Farhana; Ryabchykov, Oleg; Bocklitz, ThomasData fusion aims to provide a more accurate description of a sample than any one source of data alone. At the same time, data fusion minimizes the uncertainty of the results by combining data from multiple sources. Both aim to improve the characterization of samples and might improve clinical diagnosis and prognosis. In this paper, we present an overview of the advances achieved over the last decades in data fusion approaches in the context of the medical and biomedical fields. We collected approaches for interpreting multiple sources of data in different combinations: image to image, image to biomarker, spectra to image, spectra to spectra, spectra to biomarker, and others. We found that the most prevalent combination is the image-to-image fusion and that most data fusion approaches were applied together with deep learning or machine learning methods.
- ItemFLIM data analysis based on Laguerre polynomial decomposition and machine-learning(Bellingham, Wash. : SPIE, 2021) Guo, Shuxia; Silge, Anja; Bae, Hyeonsoo; Tolstik, Tatiana; Meyer, Tobias; Matziolis, Georg; Schmitt, Michael; Popp, Jürgen; Bocklitz, ThomasSignificance: The potential of fluorescence lifetime imaging microscopy (FLIM) is recently being recognized, especially in biological studies. However, FLIM does not directly measure the lifetimes, rather it records the fluorescence decay traces. The lifetimes and/or abundances have to be estimated from these traces during the phase of data processing. To precisely estimate these parameters is challenging and requires a well-designed computer program. Conventionally employed methods, which are based on curve fitting, are computationally expensive and limited in performance especially for highly noisy FLIM data. The graphical analysis, while free of fit, requires calibration samples for a quantitative analysis. Aim: We propose to extract the lifetimes and abundances directly from the decay traces through machine learning (ML). Approach: The ML-based approach was verified with simulated testing data in which the lifetimes and abundances were known exactly. Thereafter, we compared its performance with the commercial software SPCImage based on datasets measured from biological samples on a time-correlated single photon counting system. We reconstructed the decay traces using the lifetime and abundance values estimated by ML and SPCImage methods and utilized the root-mean-squared-error (RMSE) as marker. Results: The RMSE, which represents the difference between the reconstructed and measured decay traces, was observed to be lower for ML than for SPCImage. In addition, we could demonstrate with a three-component analysis the high potential and flexibility of the ML method to deal with more than two lifetime components.
- ItemUnderstanding image-text relations and news values for multimodal news analysis(Lausanne : Frontiers Media, 2023) Cheema, Gullal S.; Hakimov, Sherzod; Müller-Budack, Eric; Otto, Christian; Bateman, John A.; Ewerth, RalphThe analysis of news dissemination is of utmost importance since the credibility of information and the identification of disinformation and misinformation affect society as a whole. Given the large amounts of news data published daily on the Web, the empirical analysis of news with regard to research questions and the detection of problematic news content on the Web require computational methods that work at scale. Today's online news are typically disseminated in a multimodal form, including various presentation modalities such as text, image, audio, and video. Recent developments in multimodal machine learning now make it possible to capture basic “descriptive” relations between modalities–such as correspondences between words and phrases, on the one hand, and corresponding visual depictions of the verbally expressed information on the other. Although such advances have enabled tremendous progress in tasks like image captioning, text-to-image generation and visual question answering, in domains such as news dissemination, there is a need to go further. In this paper, we introduce a novel framework for the computational analysis of multimodal news. We motivate a set of more complex image-text relations as well as multimodal news values based on real examples of news reports and consider their realization by computational approaches. To this end, we provide (a) an overview of existing literature from semiotics where detailed proposals have been made for taxonomies covering diverse image-text relations generalisable to any domain; (b) an overview of computational work that derives models of image-text relations from data; and (c) an overview of a particular class of news-centric attributes developed in journalism studies called news values. The result is a novel framework for multimodal news analysis that closes existing gaps in previous work while maintaining and combining the strengths of those accounts. We assess and discuss the elements of the framework with real-world examples and use cases, setting out research directions at the intersection of multimodal learning, multimodal analytics and computational social sciences that can benefit from our approach.
- ItemComputational tissue staining of non-linear multimodal imaging using supervised and unsupervised deep learning(Washington, DC : OSA, 2021) Pradhan, Pranita; Meyer, Tobias; Vieth, Michael; Stallmach, Andreas; Waldner, Maximilian; Schmitt, Michael; Popp, Juergen; Bocklitz, ThomasHematoxylin and Eosin (H&E) staining is the 'gold-standard' method in histopathology. However, standard H&E staining of high-quality tissue sections requires long sample preparation times including sample embedding, which restricts its application for 'real-time' disease diagnosis. Due to this reason, a label-free alternative technique like non-linear multimodal (NLM) imaging, which is the combination of three non-linear optical modalities including coherent anti-Stokes Raman scattering, two-photon excitation fluorescence and second-harmonic generation, is proposed in this work. To correlate the information of the NLM images with H&E images, this work proposes computational staining of NLM images using deep learning models in a supervised and an unsupervised approach. In the supervised and the unsupervised approach, conditional generative adversarial networks (CGANs) and cycle conditional generative adversarial networks (cycle CGANs) are used, respectively. Both CGAN and cycle CGAN models generate pseudo H&E images, which are quantitatively analyzed based on mean squared error, structure similarity index and color shading similarity index. The mean of the three metrics calculated for the computationally generated H&E images indicate significant performance. Thus, utilizing CGAN and cycle CGAN models for computational staining is beneficial for diagnostic applications without performing a laboratory-based staining procedure. To the author's best knowledge, it is the first time that NLM images are computationally stained to H&E images using GANs in an unsupervised manner.
- ItemPotential for Early Forecast of Moroccan Wheat Yields Based on Climatic Drivers(Hoboken, NJ [u.a.] : Wiley, 2020) Lehmann, J.; Kretschmer, M.; Schauberger, B.; Wechsung, F.Wheat production plays an important role in Morocco. Current wheat forecast systems use weather and vegetation data during the crop growing phase, thus limiting the earliest possible release date to early spring. However, Morocco's wheat production is mostly rainfed and thus strongly tied to fluctuations in rainfall, which in turn depend on slowly evolving climate dynamics. This offers a source of predictability at longer time scales. Using physically guided causal discovery algorithms, we extract climate precursors for wheat yield variability from gridded fields of geopotential height and sea surface temperatures which show potential for accurate yield forecasts already in December, with around 50% explained variance in an out-of-sample cross validation. The detected interactions are physically meaningful and consistent with documented ocean-atmosphere feedbacks. Reliable yield forecasts at such long lead times could provide farmers and policy makers with necessary information for early action and strategic adaptation measurements to support food security. ©2020. The Authors.
- ItemThe effects of climate extremes on global agricultural yields(Bristol : IOP Publ., 2019) Vogel, Elisabeth; Donat, Markus G.; Alexander, Lisa V.; Meinshausen, Malte; Ray, Deepak K.; Karoly, David; Meinshausen, Nicolai; Frieler, KatjaClimate extremes, such as droughts or heat waves, can lead to harvest failures and threaten the livelihoods of agricultural producers and the food security of communities worldwide. Improving our understanding of their impacts on crop yields is crucial to enhance the resilience of the global food system. This study analyses, to our knowledge for the first time, the impacts of climate extremes on yield anomalies of maize, soybeans, rice and spring wheat at the global scale using sub-national yield data and applying a machine-learning algorithm. We find that growing season climate factors—including mean climate as well as climate extremes—explain 20%–49% of the variance of yield anomalies (the range describes the differences between crop types), with 18%–43% of the explained variance attributable to climate extremes, depending on crop type. Temperature-related extremes show a stronger association with yield anomalies than precipitation-related factors, while irrigation partly mitigates negative effects of high temperature extremes. We developed a composite indicator to identify hotspot regions that are critical for global production and particularly susceptible to the effects of climate extremes. These regions include North America for maize, spring wheat and soy production, Asia in the case of maize and rice production as well as Europe for spring wheat production. Our study highlights the importance of considering climate extremes for agricultural predictions and adaptation planning and provides an overview of critical regions that are most susceptible to variations in growing season climate and climate extremes.
- ItemTowards the automatic detection of social biomarkers in autism spectrum disorder: introducing the simulated interaction task (SIT)([Basingstoke] : Macmillan, 2020) Drimalla, Hanna; Scheffer, Tobias; Landwehr, Niels; Baskow, Irina; Roepke, Stefan; Behnia, Behnoush; Dziobek, IsabelSocial interaction deficits are evident in many psychiatric conditions and specifically in autism spectrum disorder (ASD), but hard to assess objectively. We present a digital tool to automatically quantify biomarkers of social interaction deficits: the simulated interaction task (SIT), which entails a standardized 7-min simulated dialog via video and the automated analysis of facial expressions, gaze behavior, and voice characteristics. In a study with 37 adults with ASD without intellectual disability and 43 healthy controls, we show the potential of the tool as a diagnostic instrument and for better description of ASD-associated social phenotypes. Using machine-learning tools, we detected individuals with ASD with an accuracy of 73%, sensitivity of 67%, and specificity of 79%, based on their facial expressions and vocal characteristics alone. Especially reduced social smiling and facial mimicry as well as a higher voice fundamental frequency and harmony-to-noise-ratio were characteristic for individuals with ASD. The time-effective and cost-effective computer-based analysis outperformed a majority vote and performed equal to clinical expert ratings. © 2020, The Author(s).
- ItemNeural partial differential equations for chaotic systems([London] : IOP, 2021) Gelbrecht, Maximilian; Boers, Niklas; Kurths, JürgenWhen predicting complex systems one typically relies on differential equation which can often be incomplete, missing unknown influences or higher order effects. By augmenting the equations with artificial neural networks we can compensate these deficiencies. We show that this can be used to predict paradigmatic, high-dimensional chaotic partial differential equations even when only short and incomplete datasets are available. The forecast horizon for these high dimensional systems is about an order of magnitude larger than the length of the training data.
- ItemImpacts of climate change on agro-climatic suitability of major food crops in Ghana(San Francisco, California, US : PLOS, 2020) Chemura, Abel; Schauberger, Bernhard; Gornott, ChristophClimate change is projected to impact food production stability in many tropical countries through impacts on crop potential. However, without quantitative assessments of where, by how much and to what extent crop production is possible now and under future climatic conditions, efforts to design and implement adaptation strategies under Nationally Determined Contributions (NDCs) and National Action Plans (NAP) are unsystematic. In this study, we used extreme gradient boosting, a machine learning approach to model the current climatic suitability for maize, sorghum, cassava and groundnut in Ghana using yield data and agronomically important variables. We then used multi-model future climate projections for the 2050s and two greenhouse gas emissions scenarios (RCP 2.6 and RCP 8.5) to predict changes in the suitability range of these crops. We achieved a good model fit in determining suitability classes for all crops (AUC = 0.81–0.87). Precipitation-based factors are suggested as most important in determining crop suitability, though the importance is crop-specific. Under projected climatic conditions, optimal suitability areas will decrease for all crops except for groundnuts under RCP8.5 (no change: 0%), with greatest losses for maize (12% under RCP2.6 and 14% under RCP8.5). Under current climatic conditions, 18% of Ghana has optimal suitability for two crops, 2% for three crops with no area having optimal suitability for all the four crops. Under projected climatic conditions, areas with optimal suitability for two and three crops will decrease by 12% as areas having moderate and marginal conditions for multiple crops increase. We also found that although the distribution of multiple crop suitability is spatially distinct, cassava and groundnut will be more simultaneously suitable for the south while groundnut and sorghum will be more suitable for the northern parts of Ghana under projected climatic conditions.