Out-of-this-World Processing, using Kx for Space Tech

9 Feb 2017 | , , ,
Share on:

By Rob Hill

Kx has always been known for its stellar performance in comparison to other technologies. The dramatic developments in satellite technology now provide the opportunity to make that literally as well as figuratively true. Rob Hill from Kx, and Director of the Northern Ireland Space office, explores the possibilities.

The global space market is expected to grow to be worth $400bn by 2030. The exploration of space, the development of satellite communication and navigation solutions, and the ability to remotely observe our planet from orbit have greatly changed the way we live our lives.

The space sector, and engagement with space, is changing rapidly. A decade ago, satellites were mainly developed by the incumbent national governments or international organizations and institutions at astronomical costs. Now, however, private companies and entrepreneurial individuals are making space more commercially accessible in what is being dubbed “NewSpace”. Innovations in technology, the development of small lower-cost satellites and new launch capabilities are driving down the cost of entry into the space sector, providing opportunities for new stakeholders to engage with space.

There are currently over 3,000 active satellites in orbit around the Earth. The NewSpace era will see that number grow dramatically with over 400 new Earth Observation satellites being launched in the next 10 years. According to reports from Euroconsult, there will be a 165% increase in commercial satellites launched between 2011 and 2020 compared to 2001 to 2010. This new era of space will generate ever increasing amounts of data, and will require ultra-high-speed processing, the likes of which Kx has provided for years in the capital markets.

The next generation of satellites, with new sensor technologies and imaging solutions, will be able to observe the entire planet to sub meter resolution, generating over a Petabyte of information daily on some platforms. The integration of Earth Observation data with satellite navigation and communication data will create new products and services that could not have been envisaged 10 years ago, and Kx is on a mission to become the “go-to” software provider for the space sector.

The satellites themselves will require new innovative solutions to process and compress information, stemming from sensor technology, in-orbit before sending the data back to the ground stations. Kx, with its expertise in  processing  real-time, streaming and historical data, offers the ability to fuse historic information and real-time data provided by satellites and multiple ground, air borne and ocean based sensors, to revolutionize an already ground-breaking industry.

The range of applications that can be developed using new satellite technologies is staggering and Kx has the ability to unleash the data within reach. There are global initiatives for monitoring the Earth as one system relating to Meteorology, Climate Modelling, Land Monitoring, Oceanography and Global Natural Resource management.

Considering all of the above, and without even touching on the wider satellite application possibilities in communications and navigation or the astronomy and astrophysics communities, there are real and numerous opportunities for Kx technology to be deployed in space, either on the ground or in orbit.

Kx has the ability to process massive datasets at a rapid rate, and can handle millions of records per second, which equates to billions of records per day and trillions in a historical database. The technology enables the analysis of voluminous and varying datasets to make more informed decisions, aiding quality assurance and control procedures. A particular advantage of Kx in space, and indeed in many other widely distributed environments, is its in-built capacity for “edge computing” stemming from its very small footprint – less than 600kb in its latest version. Its application in this case, for in-orbit pre-processing and compression of data within satellites and rockets, offers literally out-of-this-world processing that competing technologies simply cannot provide.

SUGGESTED ARTICLES

Kx and kdb+ for speed in analytics

Kx Porsche sponsorship highlights speed and precision engineering

14 Jun 2017 | , , , , , , , ,

Inspired by our corporate mission of excellence in engineering, Kx is sponsoring a Porsche Supercup car and driver for the second year in a row. This year, the car is a new 2017 Porsche 911 GT3 Cup Car and the driver, again, is Paul Rees. “Porsche is a brand that we associate with speed, power, elegance, simplicity and great engineering,” said Kx Chief Revenue Officer Pat Brazel at the recent unveiling of the car at Porsche Centre Mayfair London ahead of the 2017 Porsche Mobil 1 Supercup season. “These are all things that we aspire to, and values that we share in the products that we build.”

kdb+ to detect card counting in gambling

Streaming Analytics with kdb+: Detecting card counters in Blackjack

17 May 2017 | , , , , , , , ,

With the growth and acceleration of the Internet of Things (IoT), data collection is increasingly being performed by sensors and smart devices. Consuming and analyzing the massive amounts of data transmitted from sensing devices is considered the next Big Data challenge. A key problem in processing large quantities of data in real-time is the detection of event patterns, and this is why streaming analytics, also known as Event Stream Processing (ESP), is becoming a mainstream solution in IoT. Kx engineers Caolan Rafferty and Krishan Subherwal recently wrote a technical paper that highlights the use case of kdb+ with ESP.

Kx and Airbus developing satellite data analytics platform

14 Mar 2017 | , , , , , ,

Kx parent First Derivatives today announced a collaboration agreement with Airbus Defence and Space to develop an innovative approach for the large-scale processing of geospatial Earth Observation data using Kx technology.
Satellite data manipulation and information provisioning, stemming from increased volumes of Earth Observation data, provide significant commercial potential. Together, Kx and Airbus Defence and Space are striving to take the lead in this emerging market.