USE CASE 1 - Intelligent screening of large amount of satellite data

USE CASE 1 - Intelligent screening of large amount of satellite data


use case 1 iconEnvironmental satellite data are gradually becoming key in helping build an understanding of the changing environment and a new engine of scientific discovery.

PHIDIAS has set up a data area testing case in "Intelligent screening of a large amount of satellite data for detection and identification of anomalous atmospheric composition events". The intelligent screening of a large amount of satellite data is associated with the Earth sciences, data-derived and integrated from Earth observation, as well as terrestrial, oceanic and atmospheric data, together with data on human activity, obtained from ground sensor networks and other sources.

The corresponding activities are mainly led by SPASCIA, together with its partners such as ICARE (Sentinel 5 Precursor, Data access, data provider, formatting ad architecture), HYGEOS (Level 1 data processing for extreme events), and SRON (Expertise on S5P data and products, Scientific pilot user). SPASCIA is bringing to the PHIDIAS project the thematic of atmosphere in order to provide information related to extreme events on climate or pollution impact.

 

Challenges

Environmental satellite data are gradually becoming key in helping build an understanding of the changing environment and a new engine of scientific discovery. The intelligent screening of a large amount of satellite data is associated with the Earth sciences, data-derived and integrated from Earth observation, as well as terrestrial, oceanic and atmospheric data, together with data on human activity, obtained from ground sensor networks and other sources.

“The challenge is to be able to use a huge quantity of data to extract the correct information to the users for the pollution events and climate issues.” - Pascal Prunet, SPASCIA, Use case 1 leader

 

Solutions

The use case on “Intelligent screening of a large amount of satellite data for detection and identification of anomalous atmospheric composition events” aims to use HPC and high-performance data management services for the development of intelligent screening approaches for the exploitation of large amounts of satellite atmospheric data in an operational context, implementing a prototype service on the already available Sentinel 5 Precursor (S5P) European atmospheric sounding mission.

Work has been initiated by SPASCIA, in coordination with ICARE, to select and obtain a sample of the S5P L2 product, and to start the analysis of the corresponding images.

This allows the preparation of necessary inputs or test data for the development of the processing algorithm of the L2 S5P products (2nd L2 intelligent screening approach of S5P data, for the detection and characterisation of pollutant plumes). ICARE has implemented and is processing the archiving of S5P data and products on the ICARE facilities for PHIDIAS. Several exchanges between SPASCIA and ICARE have allowed the organisation of a complementary relationship between scientific and IT actions in Use Case 1 and setting up the basis for data exchanges and computing resources.

An algorithm for detection of NO2 hotspots of pollution sources has been implemented and evaluated (previous work already presented) and has been passed to ICARE team, who is embedded the processing software into a framework adapted to PHIDIAS objectives, for portability, robustness and optimized processing on HPC facilities. SPASCIA is adapting the source detection algorithm to another pollutant provided by S5P level 2 (L2) product : the CO. This is challenging because the detection of pollution hotspots of this gas is less evident (less contrast between pollution plume and atmospheric background concentrations), and the quality and maturity of the product is not the same as NO2.

ICARE is performing tests and preparing the implementation of this first WP4 processing on CINES infrastructure.

SPASCIA and HYGEOS are developing and debugging the second axe of our WP4 S5P data processing, aiming at performing extreme event detection directly from raw measurements of S5P/TROPOMI (the so-called Level 1 (L1) spectra). We are facing difficulties for a proper use of the L1 data, and we are working hard (with support from SRON) to deal with several issues on our use of the data for their processing by our detection algorithm. This is ongoing.

 

Learn more about the PHIDIAS use case 1 "Intelligent screening of large amount of satellite data"

Events/Webinars:

News: 

Funded by

disclaimer
The PHIDIAS project has received funding from the European Union’s Connecting Europe Facility under grant agreement n° INEA/CEF/ICT/ A2018/1810854.
READ MORE...

news

Final PHIDIAS Impact Webinar: The path toward new services to increase HPC and Data capacities

The PHIDIAS’s final impact webinar took place last 12 July which aimed at presenting the tangible outputs achieved by the PHIDIAS HPC initiative at the service of the European HPC and Research community, including main features, concrete impact, and prospective advantages for Research & HPC ecosphere. Here are the brief key takeaways from the event: • A simple web access to a world-class supercomputer, yet with a kind of magic • From 5% of data analysis to 45% for scientists (data access and computing) on the road to 80% • Two portals to find and access the available data • Already available results for Earth Science Systems (detection of extreme events, pollution, nutrients or ocean oxygen measures, etc.) • Security by design is key in creating such an infrastructure (Security Committee) • PHIDIAS is also a prototype to evaluate costs • Metadata is a key point.

Events

Get in touch with us

The 30-months project NGIatlantic.eu will push the Next Generation Internet a step further by providing cascade funding to EU-based researchers and innovators in carrying out Next Generation Internet related experiments in collaboration with US research teams.




contact action add button