Deepchecks

Deepchecks is a comprehensive open source solution for continuous validation of AI and ML models and data. It includes three components: Deepchecks Testing, CI & Testing Management, and Deepchecks Monitoring. Deepchecks Testing can be used to run built-in and custom checks and suites for Tabular, NLP and CV validation. CI & Testing Management can be used to collaborate on test results and iterate until the model is ready for production. Deepchecks Monitoring can be used to track and verify the behavior of deployed models in production. Deepchecks also includes a number of built-in checks for testing models for issues such as performance, data distribution, and data integrity. Check results can be inspected and collaborated on through visual reporting, code processing, and Deepchecks’ dynamic UI. Deepchecks is open source, but some components of Deepchecks Monitoring require commercial licenses.