Using q in Machine Learning with Neural Network and Clustering Examples

4 Apr 2017 | , , ,
Share on:

 

Expert kdb+ programmer, and algorithmic quantitative analyst, Mark Lefevre, who is based in Tokyo, recently gave a couple of talks about using high-performance machine learning with kdb+ at the Kx Community Tokyo Meetup.

His first talk was called  “Using Q to Read Japanese.” It focused on utilizing neural networks and how supervised learning can be used in q to teach a machine to recognize Japanese characters from handwritten images. Neural networks are used in a variety of real-world applications including character recognition, object recognition, image compression, asset path prediction, medicine and self-driving vehicles.

Here is Mark’s presentation onUsing Q to Read Japanese:”  Machine Learning in q

His second and most recent talk, “Kx for Wine Tasting,”  focused on utilizing the k-means clustering algorithm and how unsupervised learning can be used in q to teach a machine to appreciate, well, at least recognize, different types of wine! K-means clustering enjoys broad applications in computer vision, vector quantization, marketing, finance and as a pre-processing step for subsequent machine learning algorithms.

Here is Mark’s presentation on “Kx for Wine Tasting: Kx for Wine Tasting

SUGGESTED ARTICLES

Machine Learning with kdb+ blog

Dimensionality Reduction in kdb+

14 Jun 2018 | , , , ,

Dimensionality reduction methods have been the focus of much interest within the statistics and machine learning communities for a range of applications. These techniques have a long history as being methods for data pre-processing. Dimensionality reduction is the mapping of data to a lower dimensional space such that uninformative variance in the data is discarded. By doing this we hope to retain only that data that is meaningful to our machine learning problem. In addition, by finding a lower-dimensional representation of a dataset we hope we can improve the efficiency and accuracy of machine learning models.

kdb+ Neural Network

Neural Networks in kdb+

7 Jun 2018 | , , , , ,

As part of Kx25, the international kdb+ user conference held May 18th, a series of seven JuypterQ notebooks were released and are now available on https://code.kx.com/q/ml/. Each notebook demonstrates how to implement different machine learning techniques in kdb+, primarily using embedPy, to solve all kinds of machine learning problems, from feature extraction to fitting and testing a model. These notebooks act as a foundation to our users, allowing them to manipulate the code and get access to the exciting world of machine learning within Kx.

NLP with kdb+

Natural Language Processing in kdb+

30 May 2018 | , , , , , ,

As part of Kx25, the international kdb+ user conference held May 18th, a series of seven JuypterQ notebooks were released and are now available on https://code.kx.com/q/ml/. Each notebook demonstrates how to implement different machine learning techniques in kdb+, primarily using embedPy, to solve all kinds of machine learning problems, from feature extraction to fitting and testing a model. These notebooks act as a foundation to our users, allowing them to manipulate the code and get access to the exciting world of machine learning within Kx.