Configuring a pipeline at runtime
Configuring a pipeline at runtime.
Last updated
Configuring a pipeline at runtime.
Last updated
It is often the case that there is a need to run a pipeline with a different configuration. In this case, you should in most cases use the pipeline.with_options method. You can do this:
Either by explicitly configuring options like with_options(steps="trainer": {"parameters": {"param1": 1}})
Or by passing a YAML file using with_options(config_file="path_to_yaml_file").
You can learn more about these options here.
However, there is one exception: if you would like to trigger a pipeline from the client or another pipeline, you would need to pass the PipelineRunConfiguration object. Learn more about this here.
