0.1.0

PyPI

ai-assurance-toolkit

A Python toolkit for evaluating AI model reliability, performance, and deployment readiness.

Published14 Jun 2026

Direct dependencies8

Transitive dependenciesNot calculated

README

Version 0.1.0 documentation

AI Assurance Toolkit is a lightweight Python package for evaluating machine learning model reliability, performance, and deployment readiness.

The toolkit evaluates a trained machine learning model against a labeled test dataset and generates a structured performance report.

pip install ai-assurance-toolkit

ai-assurance evaluate \
  --model model.pkl \
  --dataset test_data.csv \
  --target credit_risk \
  --model-name "German Credit Risk Classifier"

Generate a test model and sample dataset:

python examples/setup_test_model.py

Then run the evaluator:

ai-assurance evaluate \
  --model model.pkl \
  --dataset test_data.csv \
  --target credit_risk \
  --model-name "German Credit Risk Classifier"

The package creates:

module_a_outputs/performance_report.json

from ai_assurance_toolkit import run_performance_evaluation

Apache License 2.0.

Awaiting observations

Download counts and popularity will appear here as the collector receives them.

Native requirements

8 direct targetsNot calculated transitive count

Package / target	Requirement	Relationship
numpy Environment { "extras": "", "marker": null, "requires_python": ">=3.10", "evaluation": "NOT_EVALUATED" }	`numpy>=1.24`	runtime
pandas Environment { "extras": "", "marker": null, "requires_python": ">=3.10", "evaluation": "NOT_EVALUATED" }	`pandas>=2.0`	runtime
scikit-learn Environment { "extras": "", "marker": null, "requires_python": ">=3.10", "evaluation": "NOT_EVALUATED" }	`scikit-learn>=1.3`	runtime
joblib Environment { "extras": "", "marker": null, "requires_python": ">=3.10", "evaluation": "NOT_EVALUATED" }	`joblib>=1.3`	runtime
pytest Environment { "extras": "", "marker": "extra == \"dev\"", "requires_python": ">=3.10", "evaluation": "NOT_EVALUATED" }	`pytest>=8.0; extra == "dev"`	runtime
build Environment { "extras": "", "marker": "extra == \"dev\"", "requires_python": ">=3.10", "evaluation": "NOT_EVALUATED" }	`build>=1.2; extra == "dev"`	runtime
twine Environment { "extras": "", "marker": "extra == \"dev\"", "requires_python": ">=3.10", "evaluation": "NOT_EVALUATED" }	`twine>=5.0; extra == "dev"`	runtime
ruff Environment { "extras": "", "marker": "extra == \"dev\"", "requires_python": ">=3.10", "evaluation": "NOT_EVALUATED" }	`ruff>=0.5; extra == "dev"`	runtime