remotesensing-logo

Journal Browser

Journal Browser

AI for Multi-Modal Remote Sensing Time Series Analysis

A special issue of Remote Sensing (ISSN 2072-4292). This special issue belongs to the section "AI Remote Sensing".

Deadline for manuscript submissions: closed (15 January 2022) | Viewed by 6058

Special Issue Editors


E-Mail Website
Guest Editor
EPITA Research and Development Laboratory (LRDE), 94270 Le Kremlin-Bicêtre, France
Interests: his research interests lie in the fields of mathematical morphology (especially the use of hierarchical representations), statistical signal processing and machine/deep learning, with applications in (mostly) remote sensing (and particularly hyperspectral image processing), astronomy and (a bit of) medical imagery

E-Mail Website
Guest Editor
IMT Atlantique, Lab-STICC, Brest, France
Interests: airborne and satellite imagery; inverse problems in remote sensing; signal processing; mathematical optimization methods; machine learning and sparse methods

E-Mail Website
Guest Editor
GIPSA-Lab, Grenoble Institute of Technology, 38402 Saint Martin d'Hères, France
Interests: remote sensing; image processing; signal processing; machine learning; mathematical morphology; data fusion; multivariate data analysis; hyperspectral imaging; pansharpening
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

Thanks to the variety of missions with a large array of scientific applications, satellite remote sensing data has now become abundant. The low temporal revisit of orbiting satellites makes it possible to acquire data over a given zone with a sampling rate of a few days, allowing to capture quick variations in the scene content. However, making the most of these rich time series data is a promising but still relatively under-explored research direction because of the complexity of processing and analyzing this additional temporal information jointly with the spatial (and potentially spectral if the used sensor provides multichannel images) content of the scene. In this special issue, we aim at collecting papers developing original methods to process and analyze multimodal remote sensing time series, with a strong emphasis on data driven or artifical intelligence based approaches. By multimodal, we mean here that the information within the time series data may not be restricted to a single sensor type. Submissions of deep learning based approaches for remote sensing time series processing are warmly welcomed, but contributions featuring traditional machine learning or signal processing techniques are also encouraged.  Applications can range from land cover and land use changes, environmental monitoring to disaster management and data interpolation or forecasting, among others.

Dr. Guillaume Tochon
Dr. Lucas Drumetz
Dr. Mauro Dalla Mura
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Remote Sensing is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2700 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • time series data
  • remote sensing
  • multimodal data
  • artificial intelligence
  • machine/deep learning

Published Papers (1 paper)

Order results
Result details
Select all
Export citation of selected articles as:

Research

17 pages, 3564 KiB  
Article
Crop Type Mapping from Optical and Radar Time Series Using Attention-Based Deep Learning
by Stella Ofori-Ampofo, Charlotte Pelletier and Stefan Lang
Remote Sens. 2021, 13(22), 4668; https://0-doi-org.brum.beds.ac.uk/10.3390/rs13224668 - 19 Nov 2021
Cited by 34 | Viewed by 5189
Abstract
Crop maps are key inputs for crop inventory production and yield estimation and can inform the implementation of effective farm management practices. Producing these maps at detailed scales requires exhaustive field surveys that can be laborious, time-consuming, and expensive to replicate. With a [...] Read more.
Crop maps are key inputs for crop inventory production and yield estimation and can inform the implementation of effective farm management practices. Producing these maps at detailed scales requires exhaustive field surveys that can be laborious, time-consuming, and expensive to replicate. With a growing archive of remote sensing data, there are enormous opportunities to exploit dense satellite image time series (SITS), temporal sequences of images over the same area. Generally, crop type mapping relies on single-sensor inputs and is solved with the help of traditional learning algorithms such as random forests or support vector machines. Nowadays, deep learning techniques have brought significant improvements by leveraging information in both spatial and temporal dimensions, which are relevant in crop studies. The concurrent availability of Sentinel-1 (synthetic aperture radar) and Sentinel-2 (optical) data offers a great opportunity to utilize them jointly; however, optimizing their synergy has been understudied with deep learning techniques. In this work, we analyze and compare three fusion strategies (input, layer, and decision levels) to identify the best strategy that optimizes optical-radar classification performance. They are applied to a recent architecture, notably, the pixel-set encoder–temporal attention encoder (PSE-TAE) developed specifically for object-based classification of SITS and based on self-attention mechanisms. Experiments are carried out in Brittany, in the northwest of France, with Sentinel-1 and Sentinel-2 time series. Input and layer-level fusion competitively achieved the best overall F-score surpassing decision-level fusion by 2%. On a per-class basis, decision-level fusion increased the accuracy of dominant classes, whereas layer-level fusion improves up to 13% for minority classes. Against single-sensor baseline, multi-sensor fusion strategies identified crop types more accurately: for example, input-level outperformed Sentinel-2 and Sentinel-1 by 3% and 9% in F-score, respectively. We have also conducted experiments that showed the importance of fusion for early time series classification and under high cloud cover condition. Full article
(This article belongs to the Special Issue AI for Multi-Modal Remote Sensing Time Series Analysis)
Show Figures

Figure 1

Back to TopTop