Advancing earth observation and climate research through self-supervised learning: from land monitoring to cloud modelling

  • * Register (or log in) to the Neural Network to add this session to your agenda or watch the replay

  • Date
    29 January 2025
    Timeframe
    17:00 - 18:30
    Duration
    90 minutes (including 30 minutes networking)
    Share this session

    Earth Observation (EO) satellites generate petabytes of data annually to monitor environmental changes, from land surface dynamics to atmospheric processes. While raw satellite data is increasingly accessible, expert annotations needed to derive insights are much more sparse, limiting the potential of supervised machine learning approaches. Self-supervised learning (SSL) addresses this challenge by first learning meaningful features from unlabeled data, after which models can be adapted to specific tasks using only a small number of labeled examples.  

    Our research demonstrates SSL’s versatility in two critical domains: land monitoring and cloud modeling. For land monitoring, we develop models that are pre-trained on Sentinel-1 Synthetic Aperture Radar (SAR) or Sentinel-2 optical imagery, and later fine-tuned for tasks like vegetation prediction, biomass estimation, and land cover mapping. We compare different state-of-the-art SSL techniques based on spatial masking and feature matching, and show that SSL strongly reduces the requirements for labeled examples. 


    For our second application, we extend this approach to 3D cloud modeling – crucial for reducing uncertainties in climate models. We first learn cloud features through SSL on geostationary satellite imagery, and fine-tune our models on limited radar measurements of atmospheric profiles. By explicitly encoding space and time, we create geospatially-aware models that can generate large-scale 3D cloud maps with low regional biases. With this, we demonstrate the potential of SSL to advance Earth System understanding, and maximally leverage the wealth of information in EO data. 

    Share this session
    • Days
      Hours
      Min
      Sec
    Discover more from programme stream
    Causality in Dynamical Systems

    Causality in Dynamical Systems

    27 January 2025 - 16:00 to 17:00

    Advancing earth observation and climate research through self-supervised learning: from...

    Advancing earth observation and climate research through self-supervised learning: from...

    29 January 2025 - 17:00 to 18:30

    Remote Sensing and Machine Learning for Environmental Monitoring: Opportunities and...

    Remote Sensing and Machine Learning for Environmental Monitoring: Opportunities and...

    26 February 2025 - 17:00 to 18:00