Intrinsic and Extrinsic Motivation in Intelligent Systems

Henry Lieberman
Proceedings of the First International Workshop on Self-Supervised Learning, PMLR 131:62-71, 2020.

Abstract

There are two ways that systems, human or machine, can get ”motivated” to take action in problem solving. One, they can be given goals by some external entity. In some instances, they might have no capability other than to work towards the goals provided by that entity. Two, they can have their own, internal goals, and work towards those goals. If given a goal by an outside entity, they can then try to figure out whether, and how, the external goal might align with their internal goals. In that case, the agent might be said to be acting in a ”self-supervised” manner. There are, of course, cases where both intrinsic and extrinsic motivation come into play. This paper will argue that many machine learning systems, as well as human organiza- tions, put too much emphasis on extrinsic motivation, and have not fully taken advantage of the potential of intrinsic motivation. Reinforcement learning systems, for example, have a ”reward signal” that is the sole extrinsic motivating factor. It is no wonder then, that even when such systems work well, they are incapable of explaining themselves, because they cannot express an explanation in terms of their own (or their users’) goals. In hu- man organizations, relying only on extrinsic motivation (= ”incentive”) leads to rigid or dictatorial organizations; engaging internal motivation (at some cost to ”organizational efficiency”) can lead to creativity and invention.

Cite this Paper

BibTeX
@InProceedings{pmlr-v131-lieberman20a, title = {Intrinsic and Extrinsic Motivation in Intelligent Systems}, author = {Lieberman, Henry}, booktitle = {Proceedings of the First International Workshop on Self-Supervised Learning}, pages = {62--71}, year = {2020}, editor = {Minsky, Henry and Robertson, Paul and Georgeon, Olivier L. and Minsky, Milan and Shaoul, Cyrus}, volume = {131}, series = {Proceedings of Machine Learning Research}, month = {27--28 Feb}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v131/lieberman20a/lieberman20a.pdf}, url = {https://proceedings.mlr.press/v131/lieberman20a.html}, abstract = {There are two ways that systems, human or machine, can get ”motivated” to take action in problem solving. One, they can be given goals by some external entity. In some instances, they might have no capability other than to work towards the goals provided by that entity. Two, they can have their own, internal goals, and work towards those goals. If given a goal by an outside entity, they can then try to figure out whether, and how, the external goal might align with their internal goals. In that case, the agent might be said to be acting in a ”self-supervised” manner. There are, of course, cases where both intrinsic and extrinsic motivation come into play. This paper will argue that many machine learning systems, as well as human organiza- tions, put too much emphasis on extrinsic motivation, and have not fully taken advantage of the potential of intrinsic motivation. Reinforcement learning systems, for example, have a ”reward signal” that is the sole extrinsic motivating factor. It is no wonder then, that even when such systems work well, they are incapable of explaining themselves, because they cannot express an explanation in terms of their own (or their users’) goals. In hu- man organizations, relying only on extrinsic motivation (= ”incentive”) leads to rigid or dictatorial organizations; engaging internal motivation (at some cost to ”organizational efficiency”) can lead to creativity and invention.} }
Endnote
%0 Conference Paper %T Intrinsic and Extrinsic Motivation in Intelligent Systems %A Henry Lieberman %B Proceedings of the First International Workshop on Self-Supervised Learning %C Proceedings of Machine Learning Research %D 2020 %E Henry Minsky %E Paul Robertson %E Olivier L. Georgeon %E Milan Minsky %E Cyrus Shaoul %F pmlr-v131-lieberman20a %I PMLR %P 62--71 %U https://proceedings.mlr.press/v131/lieberman20a.html %V 131 %X There are two ways that systems, human or machine, can get ”motivated” to take action in problem solving. One, they can be given goals by some external entity. In some instances, they might have no capability other than to work towards the goals provided by that entity. Two, they can have their own, internal goals, and work towards those goals. If given a goal by an outside entity, they can then try to figure out whether, and how, the external goal might align with their internal goals. In that case, the agent might be said to be acting in a ”self-supervised” manner. There are, of course, cases where both intrinsic and extrinsic motivation come into play. This paper will argue that many machine learning systems, as well as human organiza- tions, put too much emphasis on extrinsic motivation, and have not fully taken advantage of the potential of intrinsic motivation. Reinforcement learning systems, for example, have a ”reward signal” that is the sole extrinsic motivating factor. It is no wonder then, that even when such systems work well, they are incapable of explaining themselves, because they cannot express an explanation in terms of their own (or their users’) goals. In hu- man organizations, relying only on extrinsic motivation (= ”incentive”) leads to rigid or dictatorial organizations; engaging internal motivation (at some cost to ”organizational efficiency”) can lead to creativity and invention.
APA
Lieberman, H.. (2020). Intrinsic and Extrinsic Motivation in Intelligent Systems. Proceedings of the First International Workshop on Self-Supervised Learning, in Proceedings of Machine Learning Research 131:62-71 Available from https://proceedings.mlr.press/v131/lieberman20a.html.

Related Material