Track ML models
Creating a full picture of a ML model using the Model Control Plane
As discussed in the Core Concepts, ZenML also contains the notion of a Model
, which consists of many model versions (the iterations of the model). These concepts are exposed in the Model Control Plane
(MCP for short).
What is a ZenML Model?
Before diving in, let's take some time to build an understanding of what we mean when we say Model
in ZenML terms. A Model
is simply an entity that groups pipelines, artifacts, metadata, and other crucial business data into a unified entity. In this sense, a ZenML Model is a concept that more broadly encapsulates your ML product's business logic. You may even think of a ZenML Model as a "project" or a "workspace"
Please note that one of the most common artifacts that is associated with a Model in ZenML is the so-called technical model, which is the actually model file/files that holds the weight and parameters of a machine learning training result. However, this is not the only artifact that is relevant; artifacts such as the training data and the predictions this model produces in production are also linked inside a ZenML Model.
Models are first-class citizens in ZenML and as such viewing and using them is unified and centralized in the ZenML API, the ZenML client as well as on the ZenML Pro dashboard.
These models can be viewed within ZenML:
zenml model list
can be used to list all models.
Configuring a model in a pipeline
The easiest way to use a ZenML model is to pass a Model
object as part of a pipeline run. This can be done easily at a pipeline or a step level, or via a YAML config.
Once you configure a pipeline this way, all artifacts generated during pipeline runs are automatically linked to the specified model. This connecting of artifacts provides lineage tracking and transparency into what data and models are used during training, evaluation, and inference.
The above will establish a link between all artifacts that pass through this ZenML pipeline and this model. This includes the technical model which is what comes out of the svc_trainer
step. You will be able to see all associated artifacts and pipeline runs, all within one view.
Furthermore, this pipeline run and all other pipeline runs that are configured with this model configuration will be linked to this model as well.
You can see all versions of a model, and associated artifacts and run like this:
zenml model version list <MODEL_NAME>
can be used to list all versions of a particular model.
The following commands can be used to list the various pipeline runs associated with a model:
zenml model version runs <MODEL_NAME> <MODEL_VERSIONNAME>
The following commands can be used to list the various artifacts associated with a model:
zenml model version data_artifacts <MODEL_NAME> <MODEL_VERSIONNAME>
zenml model version model_artifacts <MODEL_NAME> <MODEL_VERSIONNAME>
zenml model version deployment_artifacts <MODEL_NAME> <MODEL_VERSIONNAME>
Fetching the model in a pipeline
When configured at the pipeline or step level, the model will be available through the StepContext or PipelineContext.
Logging metadata to the Model
object
Model
objectJust as one can associate metadata with artifacts, models too can take a dictionary of key-value pairs to capture their metadata. This is achieved using the log_model_metadata
method:
Choosing log metadata with artifacts or model versions depends on the scope and purpose of the information you wish to capture. Artifact metadata is best for details specific to individual outputs, while model version metadata is suitable for broader information relevant to the overall model. By utilizing ZenML's metadata logging capabilities and special types, you can enhance the traceability, reproducibility, and analysis of your ML workflows.
Once metadata has been logged to a model, we can retrieve it easily with the client:
For further depth, there is an advanced metadata logging guide that goes more into detail about logging metadata in ZenML.
Using the stages of a model
A model's versions can exist in various stages. These are meant to signify their lifecycle state:
staging
: This version is staged for production.production
: This version is running in a production setting.latest
: The latest version of the model.archived
: This is archived and no longer relevant. This stage occurs when a model moves out of any other stage.
ZenML Model and versions are some of the most powerful features in ZenML. To understand them in a deeper way, read the dedicated Model Management guide.
Last updated