Symbolic Guidance for Constructivist Learning by Neural Model

Steve Komrusch, Henry Minsky
Proceedings of the Third International Workshop on Self-Supervised Learning, PMLR 192:63-76, 2022.

Abstract

Deep learning has made impressive strides but still lacks key concepts necessary to truly reason and act in the world. In parallel, symbolic learning systems have shown success at certain types of abstract reasoning, as demonstrated in the Abstraction and Reasoning Challenge by Kaggle. Yet, these symbolic learners are challenged when generalizing to data from the analog world. This paper will present and evaluate ideas for using symbolic learning concepts to guide learning of a neural network in a constructivist way. We aim to show how a neural network with internal feedback can be used - somewhat like the brain - to suggest the proper actions to take and predict the results of those actions. In other words, the system will create an internal model of the world on which it can reason. The neurosymbolic system we consider is inspired by the symbolic learning system from Gary Dresher and neural network cortical columns as discussed by Jeff Hawkins. The hybrid system aims to create a synthesis which can generalize on real-world concepts while also quickly learning from few examples as the world changes and prior experience is found to be inaccurate.

Cite this Paper

BibTeX
@InProceedings{pmlr-v192-komrusch22a, title = {Symbolic Guidance for Constructivist Learning by Neural Model}, author = {Komrusch, Steve and Minsky, Henry}, booktitle = {Proceedings of the Third International Workshop on Self-Supervised Learning}, pages = {63--76}, year = {2022}, editor = {Thórisson, Kristinn R.}, volume = {192}, series = {Proceedings of Machine Learning Research}, month = {28--29 Jul}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v192/komrusch22a/komrusch22a.pdf}, url = {https://proceedings.mlr.press/v192/komrusch22a.html}, abstract = {Deep learning has made impressive strides but still lacks key concepts necessary to truly reason and act in the world. In parallel, symbolic learning systems have shown success at certain types of abstract reasoning, as demonstrated in the Abstraction and Reasoning Challenge by Kaggle. Yet, these symbolic learners are challenged when generalizing to data from the analog world. This paper will present and evaluate ideas for using symbolic learning concepts to guide learning of a neural network in a constructivist way. We aim to show how a neural network with internal feedback can be used - somewhat like the brain - to suggest the proper actions to take and predict the results of those actions. In other words, the system will create an internal model of the world on which it can reason. The neurosymbolic system we consider is inspired by the symbolic learning system from Gary Dresher and neural network cortical columns as discussed by Jeff Hawkins. The hybrid system aims to create a synthesis which can generalize on real-world concepts while also quickly learning from few examples as the world changes and prior experience is found to be inaccurate.} }
Endnote
%0 Conference Paper %T Symbolic Guidance for Constructivist Learning by Neural Model %A Steve Komrusch %A Henry Minsky %B Proceedings of the Third International Workshop on Self-Supervised Learning %C Proceedings of Machine Learning Research %D 2022 %E Kristinn R. Thórisson %F pmlr-v192-komrusch22a %I PMLR %P 63--76 %U https://proceedings.mlr.press/v192/komrusch22a.html %V 192 %X Deep learning has made impressive strides but still lacks key concepts necessary to truly reason and act in the world. In parallel, symbolic learning systems have shown success at certain types of abstract reasoning, as demonstrated in the Abstraction and Reasoning Challenge by Kaggle. Yet, these symbolic learners are challenged when generalizing to data from the analog world. This paper will present and evaluate ideas for using symbolic learning concepts to guide learning of a neural network in a constructivist way. We aim to show how a neural network with internal feedback can be used - somewhat like the brain - to suggest the proper actions to take and predict the results of those actions. In other words, the system will create an internal model of the world on which it can reason. The neurosymbolic system we consider is inspired by the symbolic learning system from Gary Dresher and neural network cortical columns as discussed by Jeff Hawkins. The hybrid system aims to create a synthesis which can generalize on real-world concepts while also quickly learning from few examples as the world changes and prior experience is found to be inaccurate.
APA
Komrusch, S. & Minsky, H.. (2022). Symbolic Guidance for Constructivist Learning by Neural Model. Proceedings of the Third International Workshop on Self-Supervised Learning, in Proceedings of Machine Learning Research 192:63-76 Available from https://proceedings.mlr.press/v192/komrusch22a.html.

Related Material