Kx for Earth Observation and Astronomy Big Data challenges

11 Oct 2017 | , ,
Share on:

By Robert Hill

The aerospace industry is increasingly becoming aligned with companies that can take advantage of high-value geospatial and global Earth observation data. In the current era of Big Data and IoT analytics, businesses in industries ranging from energy to civil engineering to facilities management that can commercially exploit non-traditional sources of data, such as data from satellites, can gain a critical edge. Kx technology has already been adopted in a number of such initiatives.

Airbus Defence and Space

In March, Kx began a collaboration with Airbus Defence and Space to develop an innovative approach for large-scale processing of geospatial data using Kx technology. Under the agreement, Airbus is contributing historic and future satellite imagery which Kx technology will process, interpret and manage.

“There are many valuable applications of satellite imagery across a range of industries, many of which are time sensitive and require powerful analytic processing. By combining our data and Kx technology we expect to be able to provide new and existing customers with unique and valuable insights,” said Dr. Anthony Denniss, Head of Solutions & Imagery Portfolio at Airbus Defence and Space, commented at the time of the March announcement.

NASA Frontier Development Lab and Observational Astronomy

The technological advancements that have made new astrophysical research projects like the Large Synoptic Survey Telescope (LSST) in northern Chile and the Square Kilometer Array (SKA) in South Africa possible are causing a paradigm shift due to the scale of data they are able to collect. Scientists are concerned about their ability to make sense of this newly available data, purely due to its sheer size.

In June Kx joined with Lockheed Martin, IBM and other technology leaders to support space research at the NASA Frontier Development Lab. This year the lab’s teams tackled planetary defense, space resources and space weather. Kx supported the Solar Team, which explored whether machine learning and sophisticated data processing with kdb+ could be useful in predicting and defending our planet from asteroids and solar weather. A Kx data scientist working at the lab was able to load and analyze an extremely large dataset from the USGS Geomagnetism Program and run an analysis in nanoseconds to start getting real insights into the trends and patterns behind solar storms.

The global market for Earth observation data and value-added services is expected to grow to $43 billion in the next ten years according to Northern Sky Research. The need for innovative ways to capture, analyze, store and disseminate data as a meaningful information source will rapidly increase.

In the field of astronomy, Kx believes that due to the amount of data collected for astronomical research, including observational astronomy data, across the entire electromagnetic spectrum, coupled with other forms of data, there is a compelling need for Kx technology because of its time series nature, and its powerful real-time and historical based analytics.


Using kdb+ with satellite imagery data at 3DEO

13 Apr 2018 | , ,

Last year Earth observation specialist 3DEO selected Kx technology to provide rapid analysis of data from satellites, aerial platforms and Unmanned Air Vehicles for multiple commercial markets. Their plan was to use Kx’s time-series database system kdb+ for the real-time capture, processing and visualization of vast quantities of imagery data.

Kx and Airbus developing satellite data analytics platform

14 Mar 2017 | , , , , ,

Kx parent First Derivatives today announced a collaboration agreement with Airbus Defence and Space to develop an innovative approach for the large-scale processing of geospatial Earth Observation data using Kx technology.
Satellite data manipulation and information provisioning, stemming from increased volumes of Earth Observation data, provide significant commercial potential. Together, Kx and Airbus Defence and Space are striving to take the lead in this emerging market.