The Exploration of Space Weather at NASA FDL with kdb+

4 Dec 2018 | , , , ,
Share on:

By Deanna Morgan

As part of Kx’s continuing relationship with the NASA Frontier Development Lab (FDL), I recently had the opportunity to work as a visiting data scientist at the NASA FDL, in Mountain View, California. The lab is an applied artificial intelligence (AI) research accelerator, hosted by the Search for Extraterrestrial Intelligence Institute (SETI), in partnership with the NASA Ames Research Center. The program brings commercial and private partners together with researchers to solve challenges facing the space science community using new AI technologies.

NASA FDL 2018 focused on four areas of research – Astrobiology, Exoplanets, Space Resources and Space Weather – each with their own separate challenges. I worked with the Space Weather 1 team on the first of the Space Weather challenges, which aimed to forecast Global Navigation Satellite System (GNSS) disruptions.

A GNSS is a network of satellites providing geospatial positioning with global coverage. The most famous example is the United States’ Global Positioning System (GPS). Such a network relies upon radio communications between satellites and ground-based receivers, which can be subject to interruptions in the presence of extreme space weather events.

Space weather refers to changes in radiation emitted by the Sun, leading to fluctuations in the Earth’s ionosphere. Changes to the electron density in the ionosphere cause fluctuations in the amplitude and phase of radio signals, referred to as phase scintillation. Radio signals propagating between GNSS satellites and ground-based receivers are affected by these scintillation events and can become inaccurate or even lost.

In a society that has become dependent on GNSS services for navigation in everyday life, it is critically important to know when signal disruptions might occur. Given that space weather events occurring between the Sun and the Earth have a nonlinear relationship, physical models have struggled to predict scintillation events. One method for making more accurate predictions is to use machine learning (ML) techniques.

Throughout the project, we examined how to to train ML models to predict scintillation events. We showed how to harness the power of the kdb+/q time-series database platform when performing data analytics and additionally, how to use embedPy for importing the necessary Python ML libraries. Publicly available historical GNSS data was used throughout.

The full paper and JupyterQ notebooks explaining the data origins, data pre-processing, feature engineering and the ML models used can be found here on the Kx Developer’s site.

Additional information about Kx at NASA FDL is below:

Case study: Kdb+ Used at NASA Frontier Development Lab in Predictive AI tool

The Exploration of Solar Storm Data Using JupyterQ

VIDEO: The Exploration of Solar Storms at NASA FDL

 

Deanna and Kx gratefully acknowledge the FDL Space Weather 1 team, Danny Kumar, Karthik Venkataramani, Kibrom Ebuy Abraha and Laura Hayes, for their contributions and support.

SUGGESTED ARTICLES

Kx extends relationship with NASA Frontier Development Lab and the SETI Institute

Detection of Exoplanets at NASA FDL with kdb+

13 Dec 2018 | , , , ,

Kx data scientist Espe Aguilera explains a NASA FDL mission to improve the accuracy of finding new exoplanets using machine learning models. The data for the project will come from the Transiting Exoplanet Survey Satellite (TESS), which was launched in April 2018, with the objective of discovering new exoplanets in orbit around the brightest stars in the solar neighborhood.

Kx Product Insights: Inter-Trading Alert

5 Dec 2018 | , , ,

by Aidan O’Neill Kx has a broad list of products and solutions built on the time-series database platform kdb+ that capitalize on its high-performance capabilities when analyzing very large datasets. Kx for Surveillance is a robust platform widely used by financial institutions for monitoring trades for regulatory compliance. The Surveillance platform instantly detects known trading […]