Built on top of kdb+, the world’s fastest time-series database, the KX Delta Platform enables enterprises to design, build and deploy, highly performant data capture & processing systems that meets today’s demanding security standards. With out of the box LDAP authorization, data encryption and permission control, the KX Delta platform is also subjected to regular code security review and remediation. Our latest update includes several new innovations, including integration of kdb+ 4.1, object storage as an option for the Historical Database (HDB), our Python interface (PyKX) and SQL.
Let’s explore.
The KX Delta Platform consists of the following key components.
| Dashboards | An easy-to-use, drag and drop visualization tool. |
| Analyst | An enterprise grade visual environment with identity and access management to manage, manipulate and explore massive datasets in real-time. |
| Control & Stream | A client-server application to design, build, deploy and manage data capture/streaming systems. Including access control, entitlement, and encryption. |
| kdb+ | A time-series vector database (TSDB) with in-memory (IMDB) capabilities to provide data scientists and developers with a centralized high-performance solution for real-time and multi-petabyte datasets. |
The latest updates to kdb+ (v4.1) include significant advancements in performance, security, and usability, empowering developers to turbo charge workloads, fortify transmissions and improve storage efficiency.
Updates include:
- Peach/Parallel Processing with work-stealing to ensure that idle processors intelligently acquire tasks from busy ones.
- Multithreaded Data Loading to reduce large dataset ingestion by up to 50%
- Enhanced TLS and OpenSSL to safeguard sensitive real-time data exchanges, IPC and HTTP multithreaded input queues.
- Enhanced at rest compression to ensure storage efficiency without compromising data access speed.
To find out more: please read out blog: Discover kdb+’s New Features on staging.kx.com
PyKX and SQL Integration
For Python developers, the integration of PyKX into the Delta Platform unlocks the speed and power of kdb+ for data processing and storage. It empowers Python developers (e.g. Data Scientists) to apply analytics (using PyKX library functions) against vast amounts of data, both in memory and on disk in a fraction of the time when compared to standard Python environments. Similarly, for q developers, the integration of PyKX opens the door to a wealth of new data science workloads and Python based analytics.
ANSI SQL introduces a full relational database management system (RDBMS) for end users not proficient in q. Support is included for Operators, Functions, Data and Literals, Select Statements, Table Creation, Modification and Deletion.
To find out more or enrol on one of our PyKX/SQL courses, please visit the KX Learning Hub
Persisting the HDB to object storage
In a typical kdb+ architecture, end of day data is persisted to the Historical Database (HDB) to free system memory. Over time the size of the HDB and its associated storage can be significant. To help manage costs, the KX Delta Platform can now offer object storage as an option, providing a new modality for inexpensive, durable, long-term storage strategies. This offers the benefits of highly available and infinitely scalable cloud-based solutions and ensures that enterprise customers can still retrieve long-term historical datasets.
Typical Use Cases
The KX Delta Platform supports the rapid development of kdb+ powered solutions with the hardening needed in a secure, on-prem platform.
- Data integration and fusion: Integrate and analyze data from multiple intelligence sources to create a comprehensive data landscape of subversive activities and networks.
- Real-time intelligence and analysis: Process and analyze data in real time using multiple data streams to identify threats and respond quickly.
- Pattern recognition and anomaly detection: Analyze historical and current data to identify patterns, trends, and anomalies.
To find out more contact sales@kx.com
