Speaker
Description
For several years now, the Space Weather (SWE) Data Centre has been forming the backbone of ESA’s Space Weather data systems. Providing direct access to ESA’s Space Weather datasets from both space-based and ground-based sensors it is a fundamental part of ESA’s Space Weather activities. To keep the data systems secure and to make the data centre ready for future demands and developments, ESA has started the modernisation of the SWE Data Centre, extending it further to natively support payload data processing, secure data access, and easy data dissemination.
The new system under development, the Space Weather Payload Data Centre (SWE PDC), is being designed with a modern cloud-native architecture following a microservices-based approach to ensure scalability, flexibility, and resilience. The SWE PDC consists of several subsystems that work together to ingest, process, store, and disseminate space weather sensor data, including the following:
- Data Hub
- Data Processing Framework (DPF)
- Monitoring & Control system (M&C)
The M&C system will observe the overall system health and functionality giving operators the ability to act on this information and to control the entire SWE PDC. The DPF will process raw and L0 data from space weather sensors and stores generated L1 products into the Data Hub which will form the foundational element within the SWE PDC. The Data Hub will operate as a comprehensive data warehousing solution to store and manage all SWE payload-related information, encompassing a broad spectrum of data types. The Data Hub will also include all ESA space weather data currently available through the SWE Data Browser and provide access through a redesigned and modern user interface as well as through well-defined APIs.
While data access is a key functionality of the Data Hub, additional tools are being developed to facilitate common visualisation and access to ESA Space Weather Network data products which are typically hosted at federated sites operated by network participants. In this case, the Data Hub is foreseen to act as a proxy to the federated data products while still allowing seamless access and integration via API. Additionally, the Data Hub will provide ingestion APIs to allow external partners (e.g. for industry-operated ESA missions) to feed data products directly into the Data Hub.
Another core functionality of the Data Hub will be the alerting service. While simple notifications based on single datasets and thresholds can already be created today, ESA is striving to provide the capability to define more complex alerts based on all data and products available through the Data Hub. Pre-defined alert definitions will be available to which users can subscribe to, but also custom alerts on data can be created by the users themselves. To find a meaningful balance between customisability, maintainability, and security, ESA would like to invite the community to provide their view as well as their needs towards an alerting service based on ESA SWE Data.
| Do you plan to attend in-person or online? | In-person |
|---|
