On the Impact of Neighbourhood Sampling to Satisfy Sufficiency and Necessity Criteria in Explainable AI

Urja Pawar, Christian Beder, Ruairi O\textsc\char13Reilly, Donna O\textsc\char13Shea
Proceedings of the Third Conference on Causal Learning and Reasoning, PMLR 236:570-586, 2024.

Abstract

In the context of Machine Learning(ML) and Artificial Intelligence (AI), the concepts of sufficiency and necessity of features offer nuanced perspectives on the cause-and-effect relationships underlying a model’s outputs. These concepts are, therefore, essential in Explainable AI (XAI) as they can provide a more holistic understanding of a “black-box" AI model. Addressing this need, our study explored the relationships between the XAI’s explanations and the sufficiency and necessity of features in data. This is achieved by emphasising the impact of neighbourhoods, which are central in generating explanations. By analysing a diverse set of neighbourhoods, we highlighted how they influence the alignment between the feature rankings by XAI and the measures of sufficiency and necessity. This work offers two contributions. First, it provides a comprehensive discussion on how XAI frameworks relate to sufficiency and necessity with respect to their operating neighbourhoods; and second, it empirically demonstrates the effectiveness of these neighbourhoods in conveying the sufficiency and necessity of features by the XAI frameworks.

Cite this Paper

BibTeX
@InProceedings{pmlr-v236-pawar24a, title = {On the Impact of Neighbourhood Sampling to Satisfy Sufficiency and Necessity Criteria in Explainable AI}, author = {Pawar, Urja and Beder, Christian and O\textsc{\char13}Reilly, Ruairi and O\textsc{\char13}Shea, Donna}, booktitle = {Proceedings of the Third Conference on Causal Learning and Reasoning}, pages = {570--586}, year = {2024}, editor = {Locatello, Francesco and Didelez, Vanessa}, volume = {236}, series = {Proceedings of Machine Learning Research}, month = {01--03 Apr}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v236/pawar24a/pawar24a.pdf}, url = {https://proceedings.mlr.press/v236/pawar24a.html}, abstract = {In the context of Machine Learning(ML) and Artificial Intelligence (AI), the concepts of sufficiency and necessity of features offer nuanced perspectives on the cause-and-effect relationships underlying a model’s outputs. These concepts are, therefore, essential in Explainable AI (XAI) as they can provide a more holistic understanding of a “black-box" AI model. Addressing this need, our study explored the relationships between the XAI’s explanations and the sufficiency and necessity of features in data. This is achieved by emphasising the impact of neighbourhoods, which are central in generating explanations. By analysing a diverse set of neighbourhoods, we highlighted how they influence the alignment between the feature rankings by XAI and the measures of sufficiency and necessity. This work offers two contributions. First, it provides a comprehensive discussion on how XAI frameworks relate to sufficiency and necessity with respect to their operating neighbourhoods; and second, it empirically demonstrates the effectiveness of these neighbourhoods in conveying the sufficiency and necessity of features by the XAI frameworks.} }
Endnote
%0 Conference Paper %T On the Impact of Neighbourhood Sampling to Satisfy Sufficiency and Necessity Criteria in Explainable AI %A Urja Pawar %A Christian Beder %A Ruairi O\textsc\char13Reilly %A Donna O\textsc\char13Shea %B Proceedings of the Third Conference on Causal Learning and Reasoning %C Proceedings of Machine Learning Research %D 2024 %E Francesco Locatello %E Vanessa Didelez %F pmlr-v236-pawar24a %I PMLR %P 570--586 %U https://proceedings.mlr.press/v236/pawar24a.html %V 236 %X In the context of Machine Learning(ML) and Artificial Intelligence (AI), the concepts of sufficiency and necessity of features offer nuanced perspectives on the cause-and-effect relationships underlying a model’s outputs. These concepts are, therefore, essential in Explainable AI (XAI) as they can provide a more holistic understanding of a “black-box" AI model. Addressing this need, our study explored the relationships between the XAI’s explanations and the sufficiency and necessity of features in data. This is achieved by emphasising the impact of neighbourhoods, which are central in generating explanations. By analysing a diverse set of neighbourhoods, we highlighted how they influence the alignment between the feature rankings by XAI and the measures of sufficiency and necessity. This work offers two contributions. First, it provides a comprehensive discussion on how XAI frameworks relate to sufficiency and necessity with respect to their operating neighbourhoods; and second, it empirically demonstrates the effectiveness of these neighbourhoods in conveying the sufficiency and necessity of features by the XAI frameworks.
APA
Pawar, U., Beder, C., O\textsc\char13Reilly, R. & O\textsc\char13Shea, D.. (2024). On the Impact of Neighbourhood Sampling to Satisfy Sufficiency and Necessity Criteria in Explainable AI. Proceedings of the Third Conference on Causal Learning and Reasoning, in Proceedings of Machine Learning Research 236:570-586 Available from https://proceedings.mlr.press/v236/pawar24a.html.

Related Material