Machine learning functions
The machine learning plugin provides machine learning functionality as an aggregation function. It enables you to train Support Vector Machine (SVM) based classifiers and regressors for the supervised learning problems.
The machine learning functions are not optimized for distributed processing. The capability to train large data sets is limited by this execution of the final training on a single instance.
Feature vector
To solve a problem with the machine learning technique, especially as a supervised learning problem, it is necessary to represent the data set with the sequence of pairs of labels and feature vector. A label is a target value you want to predict from the unseen feature and a feature is a A N-dimensional vector whose elements are numerical values. In Trino, a feature vector is represented as a map-type value, whose key is an index of each feature, so that it can express a sparse vector. Since classifiers and regressors can recognize the map-type feature vector, there is a function to construct the feature from the existing numerical values, features():
SELECT features(1.0, 2.0, 3.0) AS features;
features
-----------------------
{0=1.0, 1=2.0, 2=3.0}
The output from features() can be directly passed to ML functions.
Classification
Classification is a type of supervised learning problem to predict the distinct label from the given feature vector. The interface looks similar to the construction of the SVM model from the sequence of pairs of labels and features implemented in Teradata Aster or BigQuery ML. The function to train a classification model looks like as follows:
SELECT
learn_classifier(
species,
features(sepal_length, sepal_width, petal_length, petal_width)
) AS model
FROM
iris
It returns the trained model in a serialized format.
model
-------------------------------------------------
3c 43 6c 61 73 73 69 66 69 65 72 28 76 61 72 63
68 61 72 29 3e
classify() returns the predicted label by using the trained model. The trained model can not be saved natively, and needs to be passed in the format of a nested query:
SELECT
classify(features(5.9, 3, 5.1, 1.8), model) AS predicted_label
FROM (
SELECT
learn_classifier(species, features(sepal_length, sepal_width, petal_length, petal_width)) AS model
FROM
iris
) t
predicted_label
-----------------
Iris-virginica
As a result you need to run the training process at the same time when predicting values. Internally, the model is trained by libsvm. You can use learn_libsvm_classifier() to control the internal parameters of the model.
Regression
Regression is another type of supervised learning problem, predicting continuous
value, unlike the classification problem. The target must be numerical values that can
be described as double
.
The following code shows the creation of the model predicting sepal_length
from the other 3 features:
SELECT
learn_regressor(sepal_length, features(sepal_width, petal_length, petal_width)) AS model
FROM
iris
The way to use the model is similar to the classification case:
SELECT
regress(features(3, 5.1, 1.8), model) AS predicted_target
FROM (
SELECT
learn_regressor(sepal_length, features(sepal_width, petal_length, petal_width)) AS model
FROM iris
) t;
predicted_target
-------------------
6.407376822560477
Internally, the model is trained by libsvm. learn_libsvm_regressor() provides you a way to control the training process.
Machine learning functions
features
features(double, ...) -> map(bigint, double)
Returns the map representing the feature vector.
learn_classifier
learn_classifier(label, features) -> Classifier
Returns an SVM-based classifier model, trained with the given label and feature data sets.
learn_libsvm_classifier
learn_libsvm_classifier(label, features, params) -> Classifier
Returns an SVM-based classifier model, trained with the given label and feature data sets. You can control the training process by libsvm parameters.
classify
classify(features, model) -> label
Returns a label predicted by the given classifier SVM model.
learn_regressor
learn_regressor(target, features) -> Regressor
Returns an SVM-based regressor model, trained with the given target and feature data sets.
learn_libsvm_regressor
learn_libsvm_regressor(target, features, params) -> Regressor
Returns an SVM-based regressor model, trained with the given target and feature data sets. You can control the training process by libsvm parameters.
regress
regress(features, model) -> target
Returns a predicted target value by the given regressor SVM model.