Using q in Machine Learning with Neural Network and Clustering Examples

4 Apr 2017 | , , ,
Share on:

 

Expert kdb+ programmer, and algorithmic quantitative analyst, Mark Lefevre, who is based in Tokyo, recently gave a couple of talks about using high-performance machine learning with kdb+ at the Kx Community Tokyo Meetup.

His first talk was called  “Using Q to Read Japanese.” It focused on utilizing neural networks and how supervised learning can be used in q to teach a machine to recognize Japanese characters from handwritten images. Neural networks are used in a variety of real-world applications including character recognition, object recognition, image compression, asset path prediction, medicine and self-driving vehicles.

Here is Mark’s presentation onUsing Q to Read Japanese:”  Machine Learning in q

His second and most recent talk, “Kx for Wine Tasting,”  focused on utilizing the k-means clustering algorithm and how unsupervised learning can be used in q to teach a machine to appreciate, well, at least recognize, different types of wine! K-means clustering enjoys broad applications in computer vision, vector quantization, marketing, finance and as a pre-processing step for subsequent machine learning algorithms.

Here is Mark’s presentation on “Kx for Wine Tasting: Kx for Wine Tasting

SUGGESTED ARTICLES

Kx Insights: Machine learning and the value of historical data

2 Aug 2018 | , , ,

Data is being generated at a faster rate now than ever before. IDC has predicted that in 2025, there will be 163 zettabytes of data generated each year—a massive increase from the 16.1 zettabytes created in 2016. These high rates of data generation are partially an outcome of the multitude of sensors found on Internet of Things (IoT) devices, the majority of which are capable of recording data many times per second. IHS estimates that the number of IoT devices in use will increase from 15.4 billion devices in 2015 to 75.4 billion in 2025, indicating that these immense rates of data generation will continue to grow even higher in the years to come.