Kdb+ storing and exploring the Bitcoin blockchain

6 Dec 2018 | , , ,
Share on:

In the latest kdb+ technical white paper Jeremy Lucid and Daniel Irwin look at blockchain explorer technology, which provides a convenient means for users to monitor their cryptocurrency transactions and funds, and can be used to provide broader insightful metrics on the overall state of a network, such as the number of transactions occurring per block, the number of unique/active addresses, the volumes of currency being transacted and the mining hash rate, to mention a few.

Their paper gives a brief overview of the blockchain database structure and the steps required to install and run a Bitcoin full node, with examples. It also looks at how a simple blockchain explorer can be constructed using kdb+ to efficiently store and query over nine years’ worth of Bitcoin transactions, consisting of over half a million validated blocks, while making use of native performance enhancing techniques such as partitioned databases, splayed tables, intraday write downs, in-memory table joins, on-disk and in-memory attributes, and optimally structured queries.

If you would like to read more, the full article is on the Kx Developer’s site here.

If you would like to read more articles by Jeremy Lucid, follow the links below:

Jeremy Lucid is a kdb+ consultant based in Belfast. He has worked on real-time best execution projects for a major multinational banking institution, and on a Kx for Surveillance implementation at a leading options and futures exchange.

Daniel Irwin is a kdb+ consultant based in Singapore. He worked on a global cross asset Kx for Surveillance implementation for a major international banking group before moving to one of Asia’s largest sovereign wealth funds to develop a solution for best execution and transaction cost analysis.

SUGGESTED ARTICLES

kdb+ and Bitcoin Node API

Securing digital assets – a Bitcoin full node API for kdb+

31 Oct 2018 | , , , , , , , ,

By Jeremy Lucid In this article Kx engineer Jeremy Lucid describes the qbitcoind library that he has created and shared on GitHub. The library allows individual users or applications to communicate with the Bitcoin Core full node and wallet implementation, facilitating direct bitcoin transactions. Jeremy is also the author of an earlier Kx blog on Bitcoin, Kdb+ and […]

cryptocurrency microstructure with kdb+

Combining high-frequency cryptocurrency venue data using kdb+

19 Sep 2018 | , , , ,

By Eduard Silantyev   Eduard Silantyev is an electronic trading systems developer and a cryptocurrency market microstructure specialist based in London. Follow Eduard on LinkedIn or Medium to read more of his blogs about cryptocurrencies. The original title of this blog is “Cryptocurrency Market Microstructure Data Collection Using CryptoFeed, Arctic, kdb+ and AWS EC2 | Handling […]

Kx tech fund - new ideas

Kx Ventures: UK Trends

15 Aug 2018 | , , ,

Kx Ventures is a strategic technology partner for entrepreneurs and companies seeking to build or grow disruptive technologies. Shannon Jones is based in London and is part of the Kx Ventures team which is actively evaluating candidate start-ups and other types of companies for partnerships with Kx and its parent, First Derivatives plc (FD) globally. In this blog Shannon shares current insights from the investors’ point of view about the who, what and why behind technology innovation in the marketplace today.