Paper
28 February 2023 Reinforcing feature distributions of hidden units of Boltzmann machine using correlations
Author Affiliations +
Proceedings Volume 12596, International Conference on Mechatronics Engineering and Artificial Intelligence (MEAI 2022); 125961W (2023) https://doi.org/10.1117/12.2672661
Event: International Conference on Mechatronics Engineering and Artificial Intelligence (MEAI 2022), 2022, Changsha, China
Abstract
This paper introduces and analyses the method of applying Neuroscience methods to Boltzmann Machine, involving a combination of cognitive psychology, information theory, and dynamical systems. We utilized the emergent property of the probability of hidden layers to find the pattern of how units are behaving when stimulated by the visual layer and research into enhancing the predictive encoding capability of the encoding layer. We measure the connections and links between the units of the encoding layer by approximating it with the probability distribution of two units' activation behaviours. For example, the portion of the Auditory cortex responsible for processing auditory information, such as music, differs from the sections responsible for processing visual information, although they can still be linked and active concurrently. Besides, Neurons can modify their connections by learning new information and reinforcing the connections that have been utilized more frequently, and forgetting the connections if the probability distributions of two units diverge much. The Boltzmann machine is the probabilistic inference machine for ground truth using the free energy principle. The latter has stepped further from the concept to interpret cortical responses as a fundamental of intelligent agency. With simple and random interactions of each neuron, this 'intelligent agency' could achieve sophisticated functions in a specific area of a brain. Randomness is also a vital aspect of learning since it may achieve balance and embrace regularities according to Ramsey's Theory.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Peixu Cai, Wangze Shen, Ruohan Yang, and Qixian Zhou "Reinforcing feature distributions of hidden units of Boltzmann machine using correlations", Proc. SPIE 12596, International Conference on Mechatronics Engineering and Artificial Intelligence (MEAI 2022), 125961W (28 February 2023); https://doi.org/10.1117/12.2672661
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Machine learning

Deep learning

Information theory

Information visualization

Neural networks

Neurons

Back to Top