logo

ZenML Docs

  • Introduction

Getting Started

  • Installation
  • Quickstart
  • Core Concepts
  • Architectural Overview
  • Organizing ML Code with ZenML
  • Creating custom logic

Benefits

  • Extensibility
  • Reproducibility
  • Metadata Tracking
  • Caching

Repository

  • What is a ZenML Repository
  • The ZenML Repository Instance
  • Integration with Git
  • Metadata Store
  • Artifact Store
  • Pipeline Directory
  • Team Collaboration

Datasources

  • What is a datasource
  • Google Bigquery
  • Images
  • CSV files

Pipelines

  • What is a pipeline?
  • Training
  • Data [WIP]
  • Batch Inference [WIP]
  • Scheduling Jobs

Steps

  • What is a step?
  • Split
    • Custom Split
  • Preprocess
  • Trainer
  • Evaluator
  • Deployer

Backends

  • What is a backend?
  • Orchestrator Backends
  • Processing Backends
  • Training Backends
  • Using Docker

Tutorials

  • Creating your first pipeline
  • Running a pipeline on Google Cloud VM
  • Running a pipeline on Kubernetes
  • Team collaboration with ZenML and Google Cloud
  • Style Transfer using a CycleGAN
  • Classification with 59M samples
  • Training with GPUs on the Cloud
  • Deploying a model to GCP

Misc

  • Roadmap
  • Changelogs
  • Usage Analytics

Support

  • Contact
  • FAQ

Reference

  • Module core
    • Module core.steps
      • Module core.steps.base_step
      • Module core.steps.sequencer
        • Module core.steps.sequencer.base_sequencer
        • Module core.steps.sequencer.standard_sequencer
          • Module core.steps.sequencer.standard_sequencer.utils
          • Module core.steps.sequencer.standard_sequencer.standard_sequencer
          • Module core.steps.sequencer.standard_sequencer.methods
            • Module core.steps.sequencer.standard_sequencer.methods.methods_filling
            • Module core.steps.sequencer.standard_sequencer.methods.methods_resampling
            • Module core.steps.sequencer.standard_sequencer.methods.standard_methods
      • Module core.steps.data
        • Module core.steps.data.image_data_step
        • Module core.steps.data.bq_data_step
        • Module core.steps.data.base_data_step
        • Module core.steps.data.csv_data_step
      • Module core.steps.preprocesser
        • Module core.steps.preprocesser.base_preprocesser
        • Module core.steps.preprocesser.standard_preprocesser
          • Module core.steps.preprocesser.standard_preprocesser.standard_preprocesser
          • Module core.steps.preprocesser.standard_preprocesser.methods
            • Module core.steps.preprocesser.standard_preprocesser.methods.methods_nonseq_filling
            • Module core.steps.preprocesser.standard_preprocesser.methods.methods_transform
            • Module core.steps.preprocesser.standard_preprocesser.methods.standard_methods
      • Module core.steps.evaluator
        • Module core.steps.evaluator.tfma_evaluator
      • Module core.steps.trainer
        • Module core.steps.trainer.base_trainer
        • Module core.steps.trainer.tensorflow_trainers
          • Module core.steps.trainer.tensorflow_trainers.tf_base_trainer
          • Module core.steps.trainer.tensorflow_trainers.tf_ff_trainer
        • Module core.steps.trainer.pytorch_trainers
      • Module core.steps.deployer
        • Module core.steps.deployer.base_deployer
        • Module core.steps.deployer.gcaip_deployer
      • Module core.steps.split
        • Module core.steps.split.categorical_ratio_split_step
        • Module core.steps.split.constants
        • Module core.steps.split.utils
        • Module core.steps.split.base_split_step
        • Module core.steps.split.random_split
        • Module core.steps.split.categorical_domain_split_step
        • Module core.steps.split.no_split_step
    • Module core.pipelines
      • Module core.pipelines.utils
      • Module core.pipelines.infer_pipeline
      • Module core.pipelines.base_pipeline
      • Module core.pipelines.data_pipeline
      • Module core.pipelines.training_pipeline
      • Module core.pipelines.pipeline_factory
    • Module core.standards
      • Module core.standards.standard_keys
    • Module core.backends
      • Module core.backends.backend_factory
      • Module core.backends.base_backend
      • Module core.backends.processing
        • Module core.backends.processing.processing_local_backend
        • Module core.backends.processing.processing_spark_backend
        • Module core.backends.processing.processing_dataflow_backend
      • Module core.backends.training
        • Module core.backends.training.training_gcaip_backend
        • Module core.backends.training.training_local_backend
      • Module core.backends.orchestrator
        • Module core.backends.orchestrator.entrypoint
        • Module core.backends.orchestrator.kubeflow
          • Module core.backends.orchestrator.kubeflow.orchestrator_kubeflow_backend
        • Module core.backends.orchestrator.local
          • Module core.backends.orchestrator.local.orchestrator_local_backend
          • Module core.backends.orchestrator.local.zenml_local_orchestrator
        • Module core.backends.orchestrator.gcp
          • Module core.backends.orchestrator.gcp.orchestrator_gcp_backend
        • Module core.backends.orchestrator.beam
          • Module core.backends.orchestrator.beam.zenml_beam_orchestrator
          • Module core.backends.orchestrator.beam.orchestrator_beam_backend
        • Module core.backends.orchestrator.kubernetes
          • Module core.backends.orchestrator.kubernetes.orchestrator_kubernetes_backend
    • Module core.datasources
      • Module core.datasources.bq_datasource
      • Module core.datasources.json_datasource
      • Module core.datasources.pandas_datasource
      • Module core.datasources.csv_datasource
      • Module core.datasources.base_datasource
      • Module core.datasources.image_datasource
      • Module core.datasources.numpy_datasource
    • Module core.metadata
      • Module core.metadata.mock_metadata_wrapper
      • Module core.metadata.metadata_wrapper
      • Module core.metadata.sqlite_metadata_wrapper
      • Module core.metadata.metadata_wrapper_factory
      • Module core.metadata.mysql_metadata_wrapper
    • Module core.repo
      • Module core.repo.constants
      • Module core.repo.zenml_config
      • Module core.repo.global_config
      • Module core.repo.repo
      • Module core.repo.git_wrapper
      • Module core.repo.artifact_store
    • Module core.components
      • Module core.components.sequencer
        • Module core.components.sequencer.constants
        • Module core.components.sequencer.utils
        • Module core.components.sequencer.component
        • Module core.components.sequencer.executor
      • Module core.components.transform
        • Module core.components.transform.transform_module
      • Module core.components.split_gen
        • Module core.components.split_gen.constants
        • Module core.components.split_gen.utils
        • Module core.components.split_gen.component
        • Module core.components.split_gen.executor
      • Module core.components.evaluator
        • Module core.components.evaluator.evaluator_module
      • Module core.components.trainer
        • Module core.components.trainer.trainer_module
      • Module core.components.data_gen
        • Module core.components.data_gen.constants
        • Module core.components.data_gen.utils
        • Module core.components.data_gen.component
        • Module core.components.data_gen.executor
Powered by Jupyter Book
Home GitHub Blog
Contents
  • Sub-modules

Module core.backends.orchestrator¶

Sub-modules¶

  • core.backends.orchestrator.beam

  • core.backends.orchestrator.entrypoint

  • core.backends.orchestrator.gcp

  • core.backends.orchestrator.kubeflow

  • core.backends.orchestrator.kubernetes

  • core.backends.orchestrator.local

Module core.backends.training.training_local_backend Module core.backends.orchestrator.entrypoint
Proudly built by maiot GmbH.
© Copyright 2021.
Imprint
ZenML
Github