kdb+ at IESO

Kx powers Data Mart for Ontario’s Smart Meter Data

23 Aug 2017 | , , , , , , , ,
Share on:

By Przemek Tomczak

Ontario’s electricity system is overseen by a semi-governmental entity called the Independent Electricity System Operator (IESO). The IESO’s responsibilities include ensuring that there is enough power to meet the province’s energy needs and to plan for future needs. As part of that mission, a Smart Meter Entity within the IESO administers the data generated by Ontario’s four million smart meters.

The volume of data generated by the province exceeds 250 billion smart meter reads, and grows by 100 million meter reads per day. The administrator of this data is required to provide it to the utilities in the province in a timely manner and has set up a meter data management system (MDM/R) to do so.

However, the existing transaction and relational database systems within the MDM/R were not originally designed to handle the increasing requirements of the fast growing database. That’s where Kx came in with its high-performance database system kdb+, and the suite of powerful visualization tools built on top of it.

The IESO chose Kx after thoroughly testing a number of other technologies. They found that kdb+ delivered very high levels of performance at the lowest total cost of ownership. The IESO conducting over 25 tests on five years of data from five million meters, and proved that kdb+ outperformed any of its competitors.

To read more about the IESO case study please click here.

© 2018 Kx Systems
Kx® and kdb+ are registered trademarks of Kx Systems, Inc., a subsidiary of First Derivatives plc.


Head of Products, Solutions and Innovation at Kx on Product Design and the Vision for the Future

16 Mar 2018 | , , ,

As the SVP of Products, Solutions and Innovation at Kx Systems, James Corcoran is part of a new chapter in software development at Kx. Since joining Kx parent First Derivatives as a financial engineer in 2009, James has worked around the world building enterprise systems at top global investment banks before moving to the Kx product team in London. James sat down with us recently to discuss his perspective on product design and our technology strategy for the future.

Kx featured on 2018 IoT Landscape Map

7 Mar 2018 | , ,

First Mark Capital’s Matt Turck has been talking about the growth of both the Big Data and the Internet of Things ecosystems for several years in his blog and elsewhere. An outgrowth of this interest has been graphic “maps” of both the Big Data landscape and the Internet of Things landscape that portray all of the significant players in those markets in a particular year. Subsequent versions of Matt’s maps, which are published annually, show the speed of change of IoT technologies and approaches, especially for managing and analyzing large datasets generated by IoT devices. 

Kdb+ Utilities: Essential utility for identifying performance problems

28 Feb 2018 | ,

If you are a kdb+/q developer, you will find the utilities created by Kx Managing Director and Senior Solution Architect Leslie Goldsmith to be a valuable resource. The “Kdb+ Utilities” series of blog posts gives a quick introduction to the utilities, available at Leslie Goldsmith’s GitHub. In this third part of the series we look at Leslie’s qprof, which allows a programmer to drill down into q functions or applications to inspect performance and CPU usage in a fine-grained fashion.