How to configure a pipeline with a YAML
Specify a configuration file
All configuration that can be specified in a YAML file can also be specified in code itself. However, it is best practice to use a YAML file to separate config from code.
You can use the with_options(config_path=<PATH_TO_CONFIG>)
pattern to apply your configuration to a pipeline. Here is a minimal example of using a file based configuration yaml.
The above would run the simple_ml_pipeline
with cache disabled for load_data
and the parameter dataset_name
set to best_dataset
.
Last updated