Kdb+ on Anaconda and Google Cloud

12 Jun 2018 | , , ,
Share on:

By Fintan Quill

At Kx25, the international kdb+ user conference held in New York City on May 18th, we made a number of announcements about new ways to access kdb+ and interconnect with it. (You can watch my presentation, called “Snakes on a Plane” on the Kx YouTube channel.)

A significant announcement for Python and kdb+ users was the addition of kdb+ to the Anaconda Python distribution platform. Anaconda has become the de facto platform for Python developers, and by extension data scientists and machine learning engineers.

There are three packages that you will be able to install: kdb, embedpy and jupyterq. Check out the Kx packages at https://anaconda.org/kx. At present, it is available for Linux and OSX. Windows support will be added in time. It will install the non-commercial personal edition of kdb+ on demand (the kdb package) — which requires an open internet connection. The second package you can install is embedpy, the kdb+/Python library, which forms the base of our machine learning initiative. The final package you can install is jupyterq, the Jupyter kernel for kdb+. The way the dependency tree works, if you install jupyterq it will automatically install the embedpy package and the kdb package.

Keep checking back to Anaconda for further kdb+ developments. We will be adding more of our existing libraries as well as new machine learning libraries as and when they become available.

The second significant announcement made at Kx25 is that kdb+ is now available on the Google Cloud Launcher. To access it, go to https://console.cloud.google.com/launcher to find the kdb+ on demand version via Google Cloud Platform (GCP). This enables users to configure and spin up an instance on Google Compute Engine with kdb+ on-demand version pre-installed within a manner of seconds. All billing is handled by Google Cloud Platform.

Going forward, we will be doing further work with containerization and Kubernetes in the context of GCP. We have successfully tested Kubernetes deployments of kdb+ with several customers on Google Kubernetes Engine (GKE). We will also be adding our machine learning libraries to the platform for ease of deployment into your ML ecosystem to use popular platforms like TensorFlow, native to GCP.

More information and documentation for the kdb+ Google Cloud Launcher and the Anaconda distribution is available on code.kx.com.


kdb+ and NAG library with PyQ

Using the NAG Library for Python with kdb+ and PyQ

25 Jun 2019 | , ,

This paper provides detailed instructions on how to use the Numerical Algorithms Group (NAG) Library for Python with kdb+ and PyQ. The NAG Library contains more than 1,800 mathematical and statistical routines, and is accessible by numerous programming languages (including Python, C++, Java, Fortran, etc.).

A comparison of Python and q for data problem solving

8 May 2019 |

This article takes a simple, real-life problem and analyzes different solutions in Python and q. The problem leads us to discover nice areas of both programming languages, including vector operations, Einstein summation, adverbs and functional form of select statements. Each solution has lessons that deepen our IT knowledge, especially when we consider performance.

Web Scraping – A Kdb+ Use case

24 Jan 2019 | , ,

By Abin Saju Web scraping is a method through which human readable content is extracted from a web page using an automated system. The system can be implemented using a bot/web crawler which traverses through domains or through a web browser which mimics human interaction with a page. There are many use cases for the […]