Algorithms for Fairness in Sequential Decision Making

Min Wen, Osbert Bastani, Ufuk Topcu
Proceedings of The 24th International Conference on Artificial Intelligence and Statistics, PMLR 130:1144-1152, 2021.

Abstract

It has recently been shown that if feedback effects of decisions are ignored, then imposing fairness constraints such as demographic parity or equality of opportunity can actually exacerbate unfairness. We propose to address this challenge by modeling feedback effects as Markov decision processes (MDPs). First, we propose analogs of fairness properties for the MDP setting. Second, we propose algorithms for learning fair decision-making policies for MDPs. Finally, we demonstrate the need to account for dynamical effects using simulations on a loan applicant MDP.

Cite this Paper

BibTeX
@InProceedings{pmlr-v130-wen21a, title = { Algorithms for Fairness in Sequential Decision Making }, author = {Wen, Min and Bastani, Osbert and Topcu, Ufuk}, booktitle = {Proceedings of The 24th International Conference on Artificial Intelligence and Statistics}, pages = {1144--1152}, year = {2021}, editor = {Banerjee, Arindam and Fukumizu, Kenji}, volume = {130}, series = {Proceedings of Machine Learning Research}, month = {13--15 Apr}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v130/wen21a/wen21a.pdf}, url = {https://proceedings.mlr.press/v130/wen21a.html}, abstract = { It has recently been shown that if feedback effects of decisions are ignored, then imposing fairness constraints such as demographic parity or equality of opportunity can actually exacerbate unfairness. We propose to address this challenge by modeling feedback effects as Markov decision processes (MDPs). First, we propose analogs of fairness properties for the MDP setting. Second, we propose algorithms for learning fair decision-making policies for MDPs. Finally, we demonstrate the need to account for dynamical effects using simulations on a loan applicant MDP. } }
Endnote
%0 Conference Paper %T Algorithms for Fairness in Sequential Decision Making %A Min Wen %A Osbert Bastani %A Ufuk Topcu %B Proceedings of The 24th International Conference on Artificial Intelligence and Statistics %C Proceedings of Machine Learning Research %D 2021 %E Arindam Banerjee %E Kenji Fukumizu %F pmlr-v130-wen21a %I PMLR %P 1144--1152 %U https://proceedings.mlr.press/v130/wen21a.html %V 130 %X It has recently been shown that if feedback effects of decisions are ignored, then imposing fairness constraints such as demographic parity or equality of opportunity can actually exacerbate unfairness. We propose to address this challenge by modeling feedback effects as Markov decision processes (MDPs). First, we propose analogs of fairness properties for the MDP setting. Second, we propose algorithms for learning fair decision-making policies for MDPs. Finally, we demonstrate the need to account for dynamical effects using simulations on a loan applicant MDP.
APA
Wen, M., Bastani, O. & Topcu, U.. (2021). Algorithms for Fairness in Sequential Decision Making . Proceedings of The 24th International Conference on Artificial Intelligence and Statistics, in Proceedings of Machine Learning Research 130:1144-1152 Available from https://proceedings.mlr.press/v130/wen21a.html.

Related Material