sparklightautoml.ml_algo

Models used for machine learning pipelines.

Base Classes

SparkTabularMLAlgo

Machine learning algorithms that accepts numpy arrays as input.

AveragingTransformer

Transformer that gets one or more columns and produce column with average values.

Available Models

linear_pyspark.SparkLinearLBFGS

LBFGS L2 regression based on Spark MLlib.

boost_lgbm.SparkBoostLGBM

Gradient boosting on decision trees from LightGBM library.

Utilities

boost_lgbm.LightGBMModelWrapper

Simple wrapper for synapse.ml.lightgbm.[LightGBMRegressionModel|LightGBMClassificationModel] to fix issue with loading model from saved composite pipeline.

boost_lgbm.ONNXModelWrapper

Simple wrapper for ONNXModel to fix issue with loading model from saved composite pipeline.