Using kdb+ with satellite imagery data at 3DEO

13 Apr 2018 | , ,
Share on:

By Sarah Gibson

Last year Earth observation specialist 3DEO selected Kx technology to provide rapid analysis of data from satellites, aerial platforms and Unmanned Air Vehicles for multiple commercial markets. Their plan was to use Kx’s time-series database system kdb+ for the real-time capture, processing and visualization of vast quantities of imagery data.

When announcing the deal, 3DEO CEO Andrew MacPherson said: “Detailed, accurate and current 3D Earth observation imagery has the potential to transform a wide variety of industries. To do so requires an analytics platform capable of dealing with large volumes of data very quickly, and Kx technology is ideal for this purpose. Combine this with the support of [Kx parent] FD and we are making real progress towards building a significant presence in this developing, high value market.”

3DEO’s implementation of kdb+ for data analytics involves working with vast amounts of unstructured data from satellites. Kdb+ has been widely used for 20 years by the financial services industry for analyzing structured market data. As new industries, like manufacturing, telco and space research begin to use kdb+, they are increasingly using it to solve new kinds of problems with different types of data. At 3DEO, the data comes from multispectral satellite images, such as Landsat imagery, that take multiple ‘raster’ bands of a single area.

Kdb+ can import these bands and run extensive analytics on them, with many of these analytics using combinations of the near-infrared and infrared bands.  In addition kdb+ is being used to ingest and structure elevation data, which can come in many different formats. Some examples collected by 3DEO include remote sensing and sonar data. Integrating satellite images with the corresponding structured elevation data creates high-resolution 3D worlds.

By combining technologies from immersive 3D, data analytics and Earth observation, 3DEO have developed a new approach to the interaction with, and presentation of, diverse data sets. They believe 3D reveals more than can be seen from traditional perspectives, and that their solutions have widespread applications including satellite imagery, estate management, defence and disaster risk management.

SUGGESTED ARTICLES

Components of a Cyber Solution with Kx

12 Jun 2018 | , , ,

The Kx for Cyber platform is a unique combination of traditional SIEM and Security Orchestration, Automation/Analysis and Remediation (SOAR). This blog focuses on tools designed to aid and augment the security team throughout the typical cybersecurity workflow, including the extraction, transformation and loading of data as well as the analysis and visualization.

Kx Partner Companies Recognized for Excellence and Innovation

26 Jan 2018 | , , , , , ,

Over the last few months a number of startups using Kx technology have been recognized for excellence and innovation in their industries, including BrainWaveBank, 3DEO and RxDataScience (RxDS).
RxDS, is at the forefront of new types of interactive data science software applications for the pharmaceutical and healthcare industries. It uses Kx technology to power the Big Data analytics engine in its apps. Silicon Review noted RxDS’ rapid growth in revenue and customer acquisition in naming RxDS as one of the 30 Fastest Growing Private Companies to Watch.

Satellite Earth Observation Data with kdb+

Kx for Earth Observation and Astronomy Big Data challenges

11 Oct 2017 | , ,

The aerospace industry is increasingly becoming aligned with companies that can take advantage of high-value geospatial and global Earth observation data. In the current era of Big Data and IoT analytics, businesses in industries ranging from energy to civil engineering to facilities management that can commercially exploit non-traditional sources of data, such as data from satellites, can gain a critical edge. Kx technology has already been adopted in a number of such initiatives.