Dovetailing Software – kdb+ and Spark
9 Jan 2020
Hugh Hyndman outlines how the storage capabilities of kdb+ and the distributed clustering capabilities of Apache Spark can be cleverly combined, using their shared columnar design, to achieve higher throughput and performance than via a row-based JDBC intermediary.
Kx Whitepaper – Mass ingestion through data loaders
12 Dec 2019
This whitepaper outlines a framework for how mass ingestion of data can be done quickly and efficiently through kdb+. The framework aims to optimize I/O, reduce time and memory consumption from re-sorting and maintaining on disk attributes.
PostgreSQL to kdb+ Extension
3 Dec 2019
Hugh Hyndman outlines a PostgreSQL extension that allows a Postgres process to access kdb+ data via an SQL interface thereby enabling the two technologies to combine their respective strengths
Transferring data between BigQuery and kdb+
25 Nov 2019
In this article, you will learn how to transfer data in both directions between kdb+ and BigQuery on Google Cloud Platform (GCP).
Kdb+/q Insights: Database Maintenance with q
15 Oct 2019
In this blog we will expand upon the concepts discussed in a previous blog, Kdb+/q Insights: Scripting with q, and explore some concepts on how we might set up a framework for running maintenance against tables stored in a partitioned database.
Kdb+/q Insights: Parsing JSON files
27 Jun 2019
Tips and guidance on how to ingest the more complex structures that JSON, in contrast to simpler formats, may contain.