Out-of-this-World Processing, using Kx for Space Tech

9 Feb 2017 | , , , ,
Share on:

By Rob Hill

Kx has always been known for its stellar performance in comparison to other technologies. The dramatic developments in satellite technology now provide the opportunity to make that literally as well as figuratively true. Rob Hill from Kx, and Director of the Northern Ireland Space office, explores the possibilities.

The global space market is expected to grow to be worth $400bn by 2030. The exploration of space, the development of satellite communication and navigation solutions, and the ability to remotely observe our planet from orbit have greatly changed the way we live our lives.

The space sector, and engagement with space, is changing rapidly. A decade ago, satellites were mainly developed by the incumbent national governments or international organizations and institutions at astronomical costs. Now, however, private companies and entrepreneurial individuals are making space more commercially accessible in what is being dubbed “NewSpace”. Innovations in technology, the development of small lower-cost satellites and new launch capabilities are driving down the cost of entry into the space sector, providing opportunities for new stakeholders to engage with space.

There are currently over 3,000 active satellites in orbit around the Earth. The NewSpace era will see that number grow dramatically with over 400 new Earth Observation satellites being launched in the next 10 years. According to reports from Euroconsult, there will be a 165% increase in commercial satellites launched between 2011 and 2020 compared to 2001 to 2010. This new era of space will generate ever increasing amounts of data, and will require ultra-high-speed processing, the likes of which Kx has provided for years in the capital markets.

The next generation of satellites, with new sensor technologies and imaging solutions, will be able to observe the entire planet to sub meter resolution, generating over a Petabyte of information daily on some platforms. The integration of Earth Observation data with satellite navigation and communication data will create new products and services that could not have been envisaged 10 years ago, and Kx is on a mission to become the “go-to” software provider for the space sector.

The satellites themselves will require new innovative solutions to process and compress information, stemming from sensor technology, in-orbit before sending the data back to the ground stations. Kx, with its expertise in  processing  real-time, streaming and historical data, offers the ability to fuse historic information and real-time data provided by satellites and multiple ground, air borne and ocean based sensors, to revolutionize an already ground-breaking industry.

The range of applications that can be developed using new satellite technologies is staggering and Kx has the ability to unleash the data within reach. There are global initiatives for monitoring the Earth as one system relating to Meteorology, Climate Modelling, Land Monitoring, Oceanography and Global Natural Resource management.

Considering all of the above, and without even touching on the wider satellite application possibilities in communications and navigation or the astronomy and astrophysics communities, there are real and numerous opportunities for Kx technology to be deployed in space, either on the ground or in orbit.

Kx has the ability to process massive datasets at a rapid rate, and can handle millions of records per second, which equates to billions of records per day and trillions in a historical database. The technology enables the analysis of voluminous and varying datasets to make more informed decisions, aiding quality assurance and control procedures. A particular advantage of Kx in space, and indeed in many other widely distributed environments, is its in-built capacity for “edge computing” stemming from its very small footprint – less than 600kb in its latest version. Its application in this case, for in-orbit pre-processing and compression of data within satellites and rockets, offers literally out-of-this-world processing that competing technologies simply cannot provide.

© 2017 Kx Systems
Kx® and kdb+ are registered trademarks of Kx Systems, Inc., a subsidiary of First Derivatives plc.


kdb+ for sensor analytics

Kx Insights: Benefits of Utility Predictive Maintenance Analytics

17 Oct 2017 | , , ,

Utilities are going through significant modernization, with the adoption of smart grid technologies such as advanced metering, advanced distribution management, outage management, customer engagement and analytics. This modernization is creating a wealth of diverse data about assets, operations, and customers. At the same time the job of utilities is becoming more challenging with pressure to reduce costs, competition from new forms of technologies and energy providers as well as the need to integrate renewable energy resources. These new challenges, competition and pressures are leading to innovation and transformation in the utilities industry.

Satellite Earth Observation Data with kdb+

Kx for Earth Observation and Astronomy Big Data challenges

11 Oct 2017 | , , , ,

The aerospace industry is increasingly becoming aligned with companies that can take advantage of high-value geospatial and global Earth observation data. In the current era of Big Data and IoT analytics, businesses in industries ranging from energy to civil engineering to facilities management that can commercially exploit non-traditional sources of data, such as data from satellites, can gain a critical edge. Kx technology has already been adopted in a number of such initiatives.

Bitcoin derivatives exchange with kdb+

Use Case: Kdb+ integral to BitMEX Bitcoin derivatives exchange growth strategy

27 Sep 2017 | , , , , ,

The Bitcoin Mercantile Exchange, or BitMEX, was launched in 2014 as one of the first Bitcoin derivatives exchanges. The founders of BitMEX, experienced securities traders and engineers, understood that investing in the right technology at the start would be key to their success. Anticipating fast growth, their trading infrastructure needed to be robust, flexible and scalable. That’s why BitMEX built their trading system in kdb+. Today, BitMEX is the world’s most advanced Bitcoin derivatives exchange and API. After three years BitMEX’s monthly trading volume exceeds US$4,000,000,000 of derivatives products, and continues to expand at a high rate. They anticipate $1 billion average daily volume by the end of their fourth year of operations.