Develop a Custom Data Validator
How to develop a custom Data Validator
ZenML comes equipped with Data Validator implementations that integrate a variety of data logging and validation libraries, frameworks and platforms. However, if you need to use a different library or service as a backend for your ZenML Data Validator, you can extend ZenML to provide your own custom Data Validator implementation.
If you want to implement your own custom Data Validator, you can follow the following steps:
- 2.Define the
- 3.Override one or more of the
BaseDataValidatormethods, depending on the capabilities of the underlying library/service that you want to integrate.
- 4.(Optional) You should also provide some standard steps that others can easily insert into their pipelines for instant access to data validation features.
Once you are done with the implementation, you can register it through the CLI as:
zenml data-validator flavor register <THE-SOURCE-PATH-OF-YOUR-DATA-VALIDATOR>
ZenML includes a range of Data Validator implementations provided by specific integration modules. You can use them as examples of how you can extend the base Data Validator class to implement your own custom Data Validator: