Using q in Machine Learning with Neural Network and Clustering Examples

4 Apr 2017 | , , ,
Share on:


Expert kdb+ programmer, and algorithmic quantitative analyst, Mark Lefevre, who is based in Tokyo, recently gave a couple of talks about using high-performance machine learning with kdb+ at the Kx Community Tokyo Meetup.

His first talk was called  “Using Q to Read Japanese.” It focused on utilizing neural networks and how supervised learning can be used in q to teach a machine to recognize Japanese characters from handwritten images. Neural networks are used in a variety of real-world applications including character recognition, object recognition, image compression, asset path prediction, medicine and self-driving vehicles.

Here is Mark’s presentation onUsing Q to Read Japanese:”  Machine Learning in q

His second and most recent talk, “Kx for Wine Tasting,”  focused on utilizing the k-means clustering algorithm and how unsupervised learning can be used in q to teach a machine to appreciate, well, at least recognize, different types of wine! K-means clustering enjoys broad applications in computer vision, vector quantization, marketing, finance and as a pre-processing step for subsequent machine learning algorithms.

Here is Mark’s presentation on “Kx for Wine Tasting: Kx for Wine Tasting


Kx Insights: Machine learning and the value of historical data

2 Aug 2018 | , , ,

Data is being generated at a faster rate now than ever before. IDC has predicted that in 2025, there will be 163 zettabytes of data generated each year—a massive increase from the 16.1 zettabytes created in 2016. These high rates of data generation are partially an outcome of the multitude of sensors found on Internet of Things (IoT) devices, the majority of which are capable of recording data many times per second. IHS estimates that the number of IoT devices in use will increase from 15.4 billion devices in 2015 to 75.4 billion in 2025, indicating that these immense rates of data generation will continue to grow even higher in the years to come.

SEMICON 2018 Snapshot: Data and the Era of AI

24 Jul 2018 | ,

By Bill Pierson The future of the semiconductor industry is looking bright judging by the breadth of new developments, initiatives and innovations on display at SEMICON West in San Francisco this July. Industry leading companies presented the latest technical and business insights into today’s opportunities and challenges, particularly in the areas of smart manufacturing and […]