โš ๏ธ Heads up: this tool's official website appears to be unreachable right now. It may be offline, rebranded, or temporarily down.
AI Fairness 360

AI Fairness 360

โ˜… 3.8 ๐Ÿ”– 1200 saves ๐Ÿ’ฐ Free GitHub

AI Fairness 360 (AIF360) is IBM Research’s open-source toolkit for detecting, understanding and mitigating bias in machine learning datasets and models. It bundles a comprehensive library of fairness metrics, explanations of what those metrics mean, and bias-mitigation algorithms that can be applied before, during or after training. The project has close to 3,000 stars on GitHub and remains the reference toolkit in the responsible-AI field.

Overview

Fairness problems in ML are subtle: a model can be accurate on average while systematically disadvantaging a protected group. AIF360 gives practitioners a disciplined way to audit that risk. It ships with example datasets used in fairness research, dozens of metrics computed for datasets, models and predictions, and a suite of algorithms โ€” from reweighing training data and learning fair representations to post-processing model outputs โ€” that trade a small amount of accuracy for measurably fairer outcomes. Interactive demos on the project site explain each concept visually, which has made AIF360 a standard teaching resource as well as a practical auditing tool. A companion R package serves the same community. The toolkit is framework-agnostic: it works with models trained in scikit-learn, TensorFlow, PyTorch or anything else that produces predictions.

Key Features

  • Dozens of fairness metrics for datasets, models and predictions
  • Bias mitigation algorithms across pre-, in- and post-processing stages
  • Benchmark datasets used throughout fairness research
  • Python toolkit with an R counterpart
  • Interactive web demos explaining metrics and algorithms
  • Backed by IBM Research and the Trusted-AI community

๐Ÿ’ณ Pricing

AI Fairness 360 is completely free and open source under the Apache-2.0 license. There is no commercial edition or paid service attached to the toolkit.

Who Is It For

AIF360 is for data science teams, model risk and compliance specialists, and researchers who need to audit ML systems for bias and demonstrate โ€” with established metrics โ€” that mitigation steps actually worked.

๐Ÿš€ Visit AI Fairness 360 Official Site

๐Ÿšฉ Report an issue