Kx and IoT

22 Feb 2016 | , , ,
Share on:

It makes sense that Kx technology would be a perfect fit for IoT data, given its decades of high performance analytics with streaming, real time and historical tick data in the financial services industry.

Przemek Tomczak, Global Head of Fast Data Solutions for First Derivatives, spoke with us last week about how Kx technology is a good fit for utilities.

He said: “With the deployment of smart meters and power line sensors, utilities are having to process and store increasing amounts of data, some handling hundreds of millions  to billions of measurements per day. Accessing and analyzing this information is a challenge. Many utilities have dealt with these challenges by only analyzing a sub-set of the information or not at all. For example, using traditional relational and Hadoop technologies to analyze a few hundred million measurements has taken weeks to many hours using large clusters of servers. Performing similar analytics using Kx technology on very modest infrastructure is performed in milliseconds to seconds, enabling utilities to analyze all of their data more cost-effectively to identify anomalies and improve their forecasts and predictions.”

Przemek recently attended the largest North America conference that covers the utility industry from end-to-end. Check out his take-aways on the 2016 utility industry trends, particularly for sensors here.


Signal processing in kdb+

Signal processing with kdb+

6 Sep 2018 | , ,

In the latest in our ongoing series of kdb+ technical white papers published on the Kx Developer’s site, Kx engineer Callum Biggs examines how kdb+/q can be used instead of popular software-based signal processing solutions. Signal processing is used for analyzing observable events, such as IoT sensor data, sounds, images and other types of pulses […]

Kx Insights: Machine learning subject matter experts in semiconductor manufacturing

9 Jul 2018 | , ,

Subject matter experts are needed for ML projects since generalist data scientists cannot be expected to be fully conversant with the context, details, and specifics of problems across all industries. The challenges are often domain-specific and require considerable industry background to fully contextualize and address. For that reason, successful projects are typically those that adopt a teamwork approach bringing together the strengths of data scientists and subject matter experts. Where data scientists bring generic analytics and coding capabilities, Subject matter experts provide specialized insights in three crucial areas: identifying the right problem, using the right data, and getting the right answers.