Kdb+ and Factom: Securing data on the blockchain with qfactom

13 Sep 2017 | , , , ,
Share on:

By Jeremy Lucid

Blockchain applications are proliferating in the financial services industry and Kx technology is increasingly being used in these systems to provide high-speed data analytics, like by the Bitcoin Mercantile Exchange (BitMEX) and by financial technology firm Cobalt DL.

One such blockchain application, which kdb+ can readily integrate with for the purpose of securing data records, is Factom.  Factom (protocol) is an open-source project, developed by the Factom Foundation, which allows anyone to publish data to the Factom blockchain. In doing so, users can create their own immutable ledgers to store arbitrary records, thus extending the technology beyond the domain of digital currencies. To date, use cases include ledgers to store land entitlement records, mortgage records, IoT data and health records.

All data entries made to Factom are ordered into chains and time stamped by the Factom Network. Every ten minutes  these entries are combined to form a Merkle Tree, whose root is then published to the Bitcoin blockchain. By storing the Merkle Root within Bitcoin (see anchoring), Factom leverages the security of Bitcoin to render its own chain entries immutable. With this approach, Factom creates a scalable data layer solution on top of Bitcoin without bloating the blockchain, see whitepaper.

By combining the speed and scalability of kdb+, with the security and scalability of Factom, millions of records can be secured and validated quickly and safely.

qfactom, is a kdb+ wrapper library designed to interact with the Factom blockchain via its client and wallet applications.

The library provides convenient functions to create, publish data to, and read data from, Factom chains for the purpose of creating immutable audit trails and validating data.

This wiki pages demonstrate all major functionality.  Examples include: (1) a mock IoT device which creates a Factom chain to secure all the data records it publishes; (2) a q process which extracts the IoT chain entries for data validation, and (3) a demonstration of how to extract market price data from existing Factom chains.

SUGGESTED ARTICLES

kdb+ and Bitcoin Node API

Securing digital assets – a Bitcoin full node API for kdb+

31 Oct 2018 | , , , , , , , ,

By Jeremy Lucid In this article Kx engineer Jeremy Lucid describes the qbitcoind library that he has created and shared on GitHub. The library allows individual users or applications to communicate with the Bitcoin Core full node and wallet implementation, facilitating direct bitcoin transactions. Jeremy is also the author of an earlier Kx blog on Bitcoin, Kdb+ and […]

Kx Insights: Machine learning subject matter experts in semiconductor manufacturing

9 Jul 2018 | , ,

Subject matter experts are needed for ML projects since generalist data scientists cannot be expected to be fully conversant with the context, details, and specifics of problems across all industries. The challenges are often domain-specific and require considerable industry background to fully contextualize and address. For that reason, successful projects are typically those that adopt a teamwork approach bringing together the strengths of data scientists and subject matter experts. Where data scientists bring generic analytics and coding capabilities, Subject matter experts provide specialized insights in three crucial areas: identifying the right problem, using the right data, and getting the right answers.