What is Model interpretability?
Model interpretability describes how well people can understand how an AI model arrives at its results. Simple models such as decision trees are inherently easy to read; for complex neural networks, techniques that reveal the influence of individual features can help. Interpretability matters for debugging, trust and regulatory requirements, for example when a loan rejection has to be justified.