Real-time Insights and Decision Making with Kx and Gartner Research

8 Nov 2016 | , , , ,
Share on:

By Dave Thomas

 

Businesses are processing exponentially more data from clicks, swipes, micropayments, cyber packets, social feeds and meter readings today. The financial services industry has been doing this on a large scale for the past two decades.

They have coped with steadily increasing data volumes using a simple scalable data architecture composed of a real-time database (RDB) and a historical database (HDB). One of the major benefits of this architecture is that it is easy to scale up or out simply by adding additional RDBs and HDBs.

The in-memory RDB addresses real-time business needs while the HDB is an immutable record of all past transactions. By querying both the RDB and the HDB one can always get a consistent view of the world and the state of the business. Increasingly, RDBs are being placed in huge non-volatile memory and HDBs are being stored on fast SSDs. Working smartly with today’s memory solutions enables businesses to query all their data in near real-time providing a consistent picture directly assembled from the raw transactional data as required.

This widely used RDB/HDB architecture has lately been re-discovered by the Big Data community. Variations on the model have been described as Lambda Architecture, Gartner’s Hybrid Transaction/Analytical Processing (HTAP) and Forrester’s Translytical DB and Event Sourcing.

To read more Gartner research on HTAP and a cybersecurity use case with Kx technology, download
the report Real-Time Insights and Decision Making using Hybrid Streaming, In-Memory Computing Analytics and Transaction Processing.

SUGGESTED ARTICLES

Rust, meet q

24 Aug 2018 | , , ,

by Rahul Powar Red Sift is a Kx Technology Fund partner that provides a data analysis platform that is purpose-built for the challenges of cybersecurity. By leveraging the elegance of kdb+ and the power of Rust to create data applications, Red Sift can process data at the rate of tens of GB/second on consumer grade […]

Components of a Cyber Solution with Kx

12 Jun 2018 | , ,

by Tim Thornton and Doug Talbott At Kx25, the international kdb+ user conference held May 18th in New York City, Kx’s Mike Thomas presented the Kx for Cyber platform. You can see his presentation here on the Kx Youtube channel.  Introduction The Kx for Cyber platform is a unique combination of traditional SIEM and Security Orchestration, […]