SparkLightAutoML
latest

Python API

  • sparklightautoml.automl
  • sparklightautoml.dataset
  • sparklightautoml.ml_algo
  • sparklightautoml.pipelines
  • sparklightautoml.pipelines.selection
  • sparklightautoml.pipelines.features
  • sparklightautoml.pipelines.ml
  • sparklightautoml.reader
  • sparklightautoml.report
  • sparklightautoml.tasks
  • sparklightautoml.transformers
  • sparklightautoml.validation

Running on YARN Cluster with spark-submit

  • Running spark lama app on Spark YARN with spark_submit

Running on YARN Cluster (from source)

  • Running spark lama app on Spark YARN

Running on Spark Standalone Cluster (from source)

  • Running spark lama app on standalone cluster

Deploy on Minikube (from source)

  • Deploy on Minikube
  • Environment setup
  • Run examples in minikube

Running on Kubernetes Cluster (from source)

  • Running spark lama app on Kubernetes cluster
SparkLightAutoML
  • Overview: module code

All modules for which code is available

  • sparklightautoml.automl.base
  • sparklightautoml.automl.blend
  • sparklightautoml.automl.presets.base
  • sparklightautoml.automl.presets.tabular_presets
  • sparklightautoml.dataset.base
  • sparklightautoml.dataset.persistence
  • sparklightautoml.dataset.roles
  • sparklightautoml.ml_algo.base
  • sparklightautoml.ml_algo.boost_lgbm
  • sparklightautoml.ml_algo.linear_pyspark
  • sparklightautoml.pipelines.features.base
  • sparklightautoml.pipelines.features.lgb_pipeline
  • sparklightautoml.pipelines.features.linear_pipeline
  • sparklightautoml.pipelines.ml.base
  • sparklightautoml.pipelines.ml.nested_ml_pipe
  • sparklightautoml.pipelines.selection.base
  • sparklightautoml.pipelines.selection.permutation_importance_based
  • sparklightautoml.reader.base
  • sparklightautoml.reader.guess_roles
  • sparklightautoml.tasks.base
  • sparklightautoml.transformers.base
  • sparklightautoml.transformers.categorical
  • sparklightautoml.transformers.datetime
  • sparklightautoml.transformers.numeric
  • sparklightautoml.transformers.scala_wrappers.laml_string_indexer
  • sparklightautoml.validation.base
  • sparklightautoml.validation.iterators

© Copyright 2023, AI Lab ML Tools. Revision 452fa867.

Built with Sphinx using a theme provided by Read the Docs.