Kdb+ for Factom Blockchain application

Kdb+ and Factom: Securing data on the blockchain with qfactom

13 Sep 2017 | , , , ,
Share on:

By Jeremy Lucid

Blockchain applications are proliferating in the financial services industry and Kx technology is increasingly being used in these systems to provide high-speed data analytics, like by the Bitcoin Mercantile Exchange (BitMEX) and by financial technology firm Cobalt DL.

One such blockchain application, which kdb+ can readily integrate with for the purpose of securing data records, is Factom.  Factom (protocol) is an open-source project, developed by the Factom Foundation, which allows anyone to publish data to the Factom blockchain. In doing so, users can create their own immutable ledgers to store arbitrary records, thus extending the technology beyond the domain of digital currencies. To date, use cases include ledgers to store land entitlement records, mortgage records, IoT data and health records.

All data entries made to Factom are ordered into chains and time stamped by the Factom Network. Every ten minutes  these entries are combined to form a Merkle Tree, whose root is then published to the Bitcoin blockchain. By storing the Merkle Root within Bitcoin (see anchoring), Factom leverages the security of Bitcoin to render its own chain entries immutable. With this approach, Factom creates a scalable data layer solution on top of Bitcoin without bloating the blockchain, see whitepaper.

By combining the speed and scalability of kdb+, with the security and scalability of Factom, millions of records can be secured and validated quickly and safely.

qfactom, is a kdb+ wrapper library designed to interact with the Factom blockchain via its client and wallet applications.

The library provides convenient functions to create, publish data to, and read data from, Factom chains for the purpose of creating immutable audit trails and validating data.

This wiki pages demonstrate all major functionality.  Examples include: (1) a mock IoT device which creates a Factom chain to secure all the data records it publishes; (2) a q process which extracts the IoT chain entries for data validation, and (3) a demonstration of how to extract market price data from existing Factom chains.

© 2017 Kx Systems
Kx® and kdb+ are registered trademarks of Kx Systems, Inc., a subsidiary of First Derivatives plc.

SUGGESTED ARTICLES

Kx collaborating with Fintech startup chartiq

Collaboration: The Dominant Trend in Finance

13 Dec 2017 | , , , ,

In December we are re-blogging some of our favorite content from Kx partners and affiliated companies, starting with this article on the ChartIQ blog. ChartIQ is an agile FinTech company that sells an advanced HTML5 charting library used in technical data analysis, trading configurations and for charting in the capital markets industry. Kx offers a ChartIQ integration as an addition to our Dashboards. In Collaboration: The Dominant Trend in Finance, ChartIQ’s Hanni Chehak writes about the rise of FinTech companies, and the role collaboration plays as FinTech companies are increasingly disrupting the traditional banking sector.

Water system workers with kdb+ historical database

Kdb+ Use Case: Machine Learning Water System Maintenance Application

6 Dec 2017 | , , , ,

Kdb+ is being used much more widely in machine learning applications today. Its ability to quickly ingest and process data, particularly large, fragmented datasets, is one way that developers are adding kdb+ to their technology stack of artificial intelligence and machine learning tools.
For Australian kdb+ developer Sherief Khorshid, who also develops machine learning systems, incorporating kdb+ into a predictive maintenance application gave him the edge in a hackathon win that landed him a cash prize and a contract with the Water Corporation of Western Australia.

kdb+ FFI

Kdb+ FFI: Access external libraries more easily from q

22 Nov 2017 | , , ,

Following on from the hugely popular Python library and interface embedPy and PyQ, Kx has released an FFI as part of the Fusion for kdb+ interfaces. As with embedPy and PyQ, this FFI is open-sourced under the Apache 2 license.
The kdb+ FFI is a foreign function interface library for loading and calling dynamic libraries from q code. It has been adapted and expanded upon from a library originally written by Alex Belopolsky of Enlightenment Research. With the kdb+ FFI you can now call your favorite C/C++ libraries directly from q without the overhead of having to compile shared objects and load into q using the 2: command.