Open Access Paper
15 January 2025 An improved frog swarm neural network algorithm based on hyperspace dimensional chaos mapping
Ruo cheng Wang
Author Affiliations +
Proceedings Volume 13513, The International Conference Optoelectronic Information and Optical Engineering (OIOE2024); 135130J (2025) https://doi.org/10.1117/12.3045370
Event: The International Conference Optoelectronic Information and Optical Engineering (OIOE2024), 2024, Wuhan, China
Abstract
In the paper, an improved frog leaping swarm optimization algorithm was proposed for training feed-forward neural networks based on the hyperspace dimensional and infinite folding inversion iterative chaos mapping. The error back propagation information and gradient information of BP algorithm were made full use, and the concept of hyperspace dimensional and infinite folding inversion iterative chaos mapping was presented. Combined with the shuffled frog leaping swarm algorithm, the chaotic Leapfrog Group was taken as the global searcher. Gradient information was taken as the local searcher for adjusting the intelligent network weights and threshold. The experiment results show that the new artificial neural network intelligent control algorithm has various advantages in the simulation parameters such as mean square error, MSE of generalization etc. It is very suitable for artificial intelligence control modeling, the training accuracy and generalization accuracy are perfect, and it has a better ability for global optimization adaptive control.

1.

INTRODUCTION

In the development process of artificial intelligence technology, the neural network system has been universally applied to the fields of pattern-recognition, data-mining and artificial intelligence control. Artificial neural network system research can be traced back to 1800 years Frued psychoanalysis period. An artificial neural network system has strong self-adaptive control and information prediction processing capability. Neural expert system is widely used in various types of intelligent control fields and information processing fields and prediction fields and so on. With the combination of artificial neural network and fuzzy system, genetic algorithm and intelligent group bionic algorithm, computational intelligence has been formed, finally. Nowadays, artificial neural network is developing on the cognitive path of human simulation and becoming an important direction of artificial intelligence, and has important development prospect in the control field.

Artificial neural network system takes three hierarchical structure and forward feedback as the main structural form of neural network. The research on the use of feedforward neural network systems is mainly focused on the control precision and the design of the predictive controller. In this paper, Liao Fucheng and Ren Zhenqin proposed a nonlinear system predictive controller based on the direct method of the control system[1]. The linear feedback part is input as the form, which makes the neural network control system satisfy certain stabilization and detectable condition. in the literature[2], Lu Zhiping, Hou Liqiang et al. proposed a multi-stage three-terminal interval type group decision-making method considering the stage weighting, introducing the dynamic attribute weights in the intelligent bionic group decision-making into the artificial intelligence control system and proving The decision-making algorithm is feasible and reasonable. Lou Ke etc. in the literature [3] proposed a target tracking algorithm for mobile sensor networks based on the swarming control, which enabled the sensor network to keep the topology connectivity and target visibility under the control of swarming in the artificial neural network control system. In addition, Li Yanyi etc. in the literature[4] proposed a variable universe fuzzy PID control algorithm, which better solves the contradiction between the measurement and accuracy of the control rules of the self-balance system. However, the traditional three-layer feedforward artificial neural network algorithm is sensitive to the adjustment of the weight of the middle layer, and the neural network system is easily caught in the local extremum and local convergence, which makes the training outcome of the neural network worse, thus affecting the characteristics of the BP neural network[5].

In recent years, many researchers have used artificial intelligence technology such as particle swarm algorithm, ant colony algorithm and genetic algorithm to train the neural network, and achieved good results. Particle Swarm Optimization algorithm (PSO algorithm) has the superiority of fast convergence speed, simple model design, and simple algorithm construction as a kind of bionic intelligent optimization algorithm[5]. Among them, the shuffled frog leaping swarm algorithm is used as a particle swarm optimization algorithm, and its realization mechanism is to simulate the behavior of information exchange of frog foraging in the natural environment, to achieve an intelligent solution, in the neural network training, pattern division, fuzzy control system, and other traditional optimization issues have achieved good results. In the traditional particle swarm algorithm, there are defects such as fast convergence in the early period and easily falling into the local extremum and poor robustness in the later [6]. In view of the shortcomings and problems of traditional algorithms, we use hyperspace dimensional chaos mapping to obtain the stochastic state of motion with deterministic equations. According to the characteristics of randomness, universality and regularity of hyperspace dimensional chaos motion, combined with the shuffled frog leaping swarm algorithm, the optimization capability of particle swarm is improved and the population isn’t precocious. So, an improved frog leaping swarm optimization algorithm was proposed for training feed-forward neural networks based on the hyperspace dimensional and infinite folding inversion iterative chaos mapping. The error back propagation information and gradient information of BP algorithm were made full use, and the concept of hyperspace dimensional and infinite folding inversion iterative chaos mapping was presented. Combined with the shuffled frog leaping swarm algorithm, the chaotic Leapfrog Group was taken as the global searcher. Gradient information was taken as the local searcher for adjusting the intelligent network weights and threshold. The global optimization and intelligent search were realized. Finally, we use the 4 benchmark functions to test the performance of global intelligent control model of the shuffled frog leaping swarm neural network, and compare it with the results of the traditional algorithm and related literature. Finally, we apply it to the artificial intelligence automatic control system, carry on the simulation experiment, and explain the validity of the algorithm.

2.

HYPERSPACE DIMENSIONAL CHAOTIC MAPPING AND ARTIFICIAL NEURAL NETWORK CONTROL

2.1

Chaotic Mapping Based On Hyper Space Dimensional

Hyper dimensional chaos is a common phenomenon in nonlinear systems. It is a random motion state obtained from the deterministic equations[7].hyperspace dimensional chaotic motion is characterized by randomness, universality and sensitivity to the initial value. It is a kind of random and regular motion model and state structure[8]. Therefore, the application of hyperspace dimensional chaotic mapping to artificial neural network can overcome the defects of artificial neural network into local convergence. In this paper, we propose a concept of hyperspace dimensional and infinite folding inversion iterative chaos mapping, and discuss its chaos strictly from the mathematical point of view. By calculating the maximum Lyapunov exponent, we prove that the system has chaotic features[9]. The hyperspace dimensional chaotic system has a strong adaptive control ability, and the hyperspace dimensional infinite folding inversion iterative chaotic mapping is described as follows:

First, generate a sequence of variables that are distributed between [-1, 1]

00019_PSISDG13513_135130J_page_2_1.jpg

Wherexk is the k-th component, a is control parameter, and generally a can take 5.65. By taking N samples of intelligent frogs with typical characteristic differences, we can get the chaotic variables of N trajectories with self-similar features. In the artificial intelligence control application, the variable interval of each variable is different, and the hyperspace dimensional chaotic variable needs to be controlled by the interval (-1,1) carrier to the ultra-pure interval of the particle swarm. Set xlmaxval and xlminval to be the upper and lower bounds of the l-th dimension variable, respectively. According to the following formula, we get the chaotic variable characteristic solution mapped to (-1,1).

00019_PSISDG13513_135130J_page_2_2.jpg

According to the above formula to update the hyper space dimensional chaotic variable cxl, according to the following formula into a decision variable xl:

00019_PSISDG13513_135130J_page_2_3.jpg

By the above equation, we obtain hyperspace dimensional infinite folding iterative chaotic mapping iterative variable, and adaptive control of artificial BP neural network under infinite folding inversion iteration. The learning process is guided by the hyperspace dimensional chaotic map, which is divided into is divided into two processes: forward spread and backward spread. The literatures have proved that a 3-layer BP neural network can close in on the nonlinear function very precisely. Next, take the 3-layer neural network as an example. Assume that the input layer has an L node, the hidden layer has m nodes, and the output layer has n nodes. BP artificial neural network mean square error function is:

00019_PSISDG13513_135130J_page_3_1.jpg
00019_PSISDG13513_135130J_page_3_2.jpg

Where q is the number of input sample of the artificial neural network system, εkis the output error of the k-th node in the output layer of the artificial neural network system,dk is the expected output value of the k-th node,ck is the actual output value of the k-th node.

2.2

Particle Swarm Optimization

In this paper, based on the concept of hyperspace dimensional infinite folding inversion iterative chaotic mapping, a PSO algorithm is introduced, and the early maturing judgment is carried out. For this algorithm, a group of particles is randomly initialized. Through its infinite evolution, the position of the particle is updated and evolved, and the optimal generalization solution Pb is obtained by adaptive adjustment. This optimal solution is called the individual extremum. With the progression of the particle swarm in layers of the neural network system, the global optimal solution is obtained. In the hyperspace dimensional chaotic mapping system, it is assumed that in the D-dimensional searching space, there are m particles to form a population. The position of the particle i in the D-dimensional space can be expressed as Xi = (xi1,xi2, … xiD), The i-th group of individuals through the traversal, to achieve the optimal location logo is Pi = (pi1, pi2, … piD), As a result of the intelligent frog group network, the jump speed of each individual group is Vi = (vi1,vi2, …,viD),i = 1,2, … m, In the whole leap group, the optimal traversal position experienced by the individual in the state space is Pg = (Pg1, Pg2, … PgD), For each generation of frogs, through tracking the state variables, update the single extremes and global state optimization values, the new position is

00019_PSISDG13513_135130J_page_3_3.jpg

Where k is the number of iterations,c1 and c2 are learning factors. By tracking individual extremes and global extremes to update their own speed and position, it is:

00019_PSISDG13513_135130J_page_3_4.jpg

Set rand() to a random number between [0,1], and ωas a linear decreasing inertia weight. Where the value of w is :

00019_PSISDG13513_135130J_page_3_5.jpg

Where wmaxval is the upper limit of the inertial control weight of the infinite folding inversion iterative chaotic map, wminval is the lower limit, Tmaxval is the maximum of iterations, and t is the current iteration number. With the infinite folding inversion of iterative chaotic mapping artificial neural network control population evolution, the emergence of mapping state results clustering leads to artificial neural network system local precocity. In order to suppress the early maturity of this population, we propose to use the value of the fitness of the frog leaping swarm jumping transformation to adjust the state and make the decision.

Assuming the global particle number of the hyperspace dimensional chaotic frog leaping swarm of artificial neural network system is N, the fitness fi of the frog leaping swarm jumping transformation of the i-th particle is defined, and the mean value is defined as favg. Then, the shuffled frog leaping swarm evolution average mean square error σ2is defined as:

00019_PSISDG13513_135130J_page_3_6.jpg

Where f is the normalized factor, the effect is to limit the size of σ2. The value f is: when max|fifavg| > 1,00019_PSISDG13513_135130J_page_3_7.jpg00019_PSISDG13513_135130J_page_3_8.jpg;when max|fifavg| ≤ 1, f =1.

Through the above formula, we can obtain the mean square root error σ2 of the artificial shuffled frog leaping swarm neural network control system. The response of σ2 to the physical properties is expressed as the degree of “aggregation” of the adaptive shuffled frog leaping swarm. The smaller the value σ2 is, the greater the degree of “aggregation” is. With the increase of population evolution and convergence iteration, the individual fitness of the population tends to be self-similar, resulting in convergence characteristics, which will become smaller and smaller. When σ2 > C, and the fitness does not meet the end conditions, it is necessary for early maturity treatment, that is, chaotic transformation operation.

3.

INTRODUCTION OF SHUFFLED FROG LEAPING SWARM ALGORITHM AND REALIZATION OF KEY TECHNOLOGY OF INTELLIGENT CONTROL

3.1

Shuffled Frog Leaping Swarm Algorithm

In recent years, many scholars have used the bionic genetic algorithm such as bee colony, ant colony and frog leaping swarm to train the neural network as an artificial intelligence method, and achieved good results. The shuffled frog leaping swarm algorithm can be well combined with the evolution of the module group, and can effectively overcome the shortcomings such as the slow convergence speed and the local extreme value of the feedforward neural network in the intelligent control design training, and the dependence on the initial weight. The shuffled frog swam algorithm is widely combined with artificial neural network(ANN) system with fast convergence speed, simple modeling and easy implementation. Its realization mechanism is to complete an intelligent solution through the simulation of the information interaction behavior of frog foraging information in the natural environment. The basic step of the algorithm implementation is described as follows:

  • (1) First, the parameters of the algorithm are initialized, including the frog group size N, the module-groups number m, and the evolutions number M, the maximum distance Dmax of individual frog, and the maximum number of iterations Imax.

  • (2) Initialized shuffled frog swam population;

  • (3) Group operator calculation of populations, group according to rules and update several module groups;

  • (4) The local update operator is the control variable, and the frog position is updated in each module group.

  • (5) To loop jump between the frog module groups and re-mix to form a new population;

  • (6) Determine whether the end condition is satisfied, and calculate the global optimal solution.

3.2

Realization of Frog Leaping Swarm Neural Network Algorithm

In this paper, the hyperspace dimensional infinite folding inversion iterative chaotic map is combined with the gradient descent method based on error back transfer. The shuffled frog swam algorithm has a strong search ability for global optimal solution, but the search speed is slow near the optimal solution and prone to early maturity phenomenon. In order to solve the shortcomings of the traditional PSO algorithm, we introduce the hyperspace dimensional infinite folding inversion iterative chaotic mapping and the gradient descent algorithm based on error back transfer to enhance the performance of particle swarm optimization algorithm. When the PSO algorithm is caught in the local optimal solution, the chaotic map is introduced to adjust the weight parameter of the shuffled frog leaping swarm in the network distribution system, so that each individual of the frog leaping swarm can escape the local convergence point and realize the global search, so as to avoid the occurrence of precocious population. According to the convergence, the algorithm can automatically switch between global and local searches.

According to the PSO algorithm early maturity judgment mechanism, when the fitness variance σ2is less than a given threshold, it shows that the population appears precocious. At this time, the current global optimal position is taken as the initial point, and the chaos map is carried out according to a certain probability, leading the frog to escape the local extreme value region. In order to speed up the local search process, call the BP algorithm and re-enter the PSO optimization process. The iteration is done until the algorithm terminates. This algorithm can acquire the diversity of frog populations by using the chaotic map, and the individual frog can search the whole space under the premise of rapid local search. The algorithm implementation steps are as follows:

  • Step 1 : Initialize the parameters of the improved algorithm.

    • Step 1.1: Set the size of the shuffled frog leaping swarm. The size is M, The total number of iterations T, the current number of iterations TN, the minimum training stop errorλ, the chaotic transform probabilityPm, the learning factors C1 and C2, the inertia weight ω, the fitness variance threshold C, the iteration times of BP algorithm TBP, the learning rate η, the momentum factor α.

    • Step1.2: Randomly initialize the particle velocity Vi = (vi1,vi2, …,viD)T and position Xi = (хі1,хі2, …,xiD)Tin the frog leaping swam population, weight values and threshold values of the BP artificial neural network are represented by the particle velocity Vi = (vi1,vi2, …,viD)T and positionXi = (хі1,хі2, …,xiD)T, where D is the sum of the weights of the neural network and the threshold dimension.

    • Step 1.3: Calculate the particle fitness f(xi) in the shuffled frog leaping swam. The position of the particle with the best fitness value in the initial population is taken as the global extremum position Pg of the initial algorithm and the global extremum position Pbest of the whole algorithm, and let TN = 1.

  • Step 2: If TNT, save the optimal result min{f(pg), f(pi)}. The algorithm ends. Otherwise, perform the following steps:

    • Step 2.1: The velocity and position of the particles Vi and Xi are updated according to equations (6) and (7).

    • Step 2.2: According to the individual information characteristics of the shuffled frog leaping swam, Pi and Pg are updated, and the global optimal particle subscript gbest is recorded.

  • Step 3: If condition σ2C holds, continue the steps backward, otherwise turn to step 2.

  • Step 4:Xggbest, Pi and TN are updated according to the BPNN algorithm which individuals’ position Xggbest of global optimal frog leaping swam was used as the initial search starting point.

  • Step 5: If condition TNT holds, preserve the optimization results min{f(pg), f(pi)}, the algorithm ends; otherwise, continue.

  • Step 6: For each particle, generate a randomness r between [0,1], if conditionrPm, and igbest are met, then perform ICMIC mapping in chaotic searching-space, and calculate the size of target 00019_PSISDG13513_135130J_page_5_1.jpg corresponding to the new position, renew TN and Pg.

  • Step 7: Go back to step 2.

Through the above analysis and improvement, the algorithm is an artificial neural network control algorithm combined with the advantages of shuffled frog leaping swarm algorithm, particle swarm algorithm, chaos map and BP algorithm. The shuffled frog leaping swarm algorithm and the chaotic mapping algorithm are simpler and the training speed is faster than the simple BP algorithm. In terms of complexity, it is equivalent to the traditional PSO-BP and GA-BP algorithms. In terms of convergence, due to the introduction of hyperspace dimensional infinite folding inversion iterative chaotic mapping mechanism, the population particles have a strong global search ability; Due to the acceleration of local optimization of particles for BP, PSO performance has been a good play. Therefore, the convergence of the algorithm is superior, and the speed of convergence is faster than the traditional PSO-BP and GA-BP algorithm.

4.

SIMULATION EXPERIMENT AND RESULT ANALYSIS

In order to test the effectiveness of the algorithm and its application value in intelligent artificial neural network control system, based on MATLAB 7.0 platform, we built a control model, and Carry out algorithm simulation. The performance of frog neural network intelligent control model based on hyperspace dimensional chaotic map is carried out by using four benchmark criteria. Set the various parameters: population sizeM = 40, T = 1000, λ = 10–6, C1 = C2 = 1.4,initialize the inertia weight value w between 0.4 and 0.9. r1 and r2 are two randomness in the range [0,1]. The maximum leaping speed between the frog module is 10. If the individual’s leaping speed exceeds the limits, Pm=0.2,C =0.01,νmax = (xmaxxmin)/2,vmin = –vmax. The dimension of the position and velocity of the shuffled frog leaping swarm is D = i×h + h×1 + h + 1 = h × (i +2)+ 1.BP neural network learning rate is η = 0.7and the state factor is α = 0.3.The simulation experiment is carried out in the artificial intelligence automatic control system, and the control precision and quality of the algorithm are verified by testing the mean square error, and compared with the results of the traditional algorithm and the related literature. Test the benchmark function set in table 1.

Table 1.

Test benchmark function sets

functionranges
f1= 100 × (x12 – x2)2 + (1 –x1)2xi ∈ [–10,10],i = 1, 2
xi ∈ [–2π,2π],i = 1,2,3
xi ∈ [0,2], i = 1,2, …,5
xi ∈ [–1,1], i = 1,2, …,8

Four function error simulation calculations are used to compare the improved BP neural network algorithm with the traditional algorithm, and the comparison results are displayed in Table 2.

Table 2.

Function error comparison for traditional methods and improved BPNN algorithm

algorithmerrorf1 (2-7-1)f2 (3-6-1)f3 (5-10-1)f4 (8-7-1)
The improved algorithm in this paperE11.04E-064.67E-060.0031560.005228
E24.28E-058.29E-050.0077640.006742
E30.0008670.0028350.0200150.041791
E40.0102340.0164570.0328150.062839
E50.0032010.0064880.0232150.047052
The improved PSO-BPNN algorithmE14.87E-063.56E-050.0058500.007367
E22.98E-049.26E-040.0034190.008337
E30.0018860.0049920.0442580.068605
E40.0149800.0250810.0436980.071793
E50.0051600.0100140.0441180.069402
The traditional PSO-BPNN algorithmE14.16E-052.54E-040.0089410.015331
E20.1108440.0661190.0025990.019901
E30.0057010.0133490.0619290.098510
E40.2506290.2247800.0416040.111654
E50.0669330.0662070.0568480.101796
GA-BPNN algorithmE15.37E-043.30E-040.0092720.011973
E20.0415190.0640650.0030020.016747
E30.0178570.0153690.0585520.086193
E40.1978770.2218040.0450650.105106
E50.0628620.0669780.0551800.090921
Basic BPNN algorithmE19.9995E-053.0685E-040.01140.0120
E20.41780.13500.19490.0132
E30.00820.01510.07300.0857
E40.59800.36290.38130.0944
E50.20750.13610.20010.1172

From Table 2, It can be observed that the improvement of the artificial neural network algorithm is superior to the traditional algorithm to an order of magnitude above the training algorithm, such as training mean square error, generalized mean square error, training absolute error, generalized absolute error and total sample absolute error. The improved algorithm is particularly suitable for artificial intelligence control model design and prediction modeling, with high prediction accuracy and generalization ability, good robustness, and good global optimization adaptive control ability. Similarly, it is also shown that the introduction of hyperspace dimensional chaotic mapping and fitness variance, adjust the shuffled frog leaping swarm in the network distribution system weight, the frogs of each individual can escape the local convergence point, achieve global search, effectively avoid the evolution of early maturity of population. The proposed BP artificial neural network algorithm based on hyper dimensional infinite folding inversion in this article is applied to the network control system designed in the literature [4], and the simulation experiment of control precision is performed. Through the simulation results, we can note that the smooth and accurate global control effect can be obtained, and the control precision and robustness are improved greatly, which shows the superior performance of the algorithm in the artificial intelligence controller, as shown in Figure 1.

Figure. 1

Global intelligent control precision comparison

00019_PSISDG13513_135130J_page_7_1.jpg

5.

CONCLUSION

In article, an improved and optimized frog-leaping swarm algorithm was proposed for training feed-forward neural networks based on the hyperspace dimensional and infinite folding inversion iterative chaos mapping. The hyperspace dimensional chaotic mapping and artificial neural network control algorithm and model structure were constructed, and the shuffled frog leaping swarm algorithm was designed. Combined with chaotic mapping, shuffled frog leaping swarm and artificial neural network theory, the key technology of the algorithm design is realized. Through the simulation experiment, it is concluded that the algorithm has the advantages of training mean square error, generalized mean square error, training absolute error, generalized absolute error and total error of the total sample. The five test indexes are superior to the traditional algorithm. The algorithm is particularly suitable for global intelligent control system modeling. From the control accuracy and control quality, the algorithm is also more ideal, which shows the algorithm has good robustness.

6.

6.

REFERENCES

[1] 

Liao Fucheng, Ren Zhenqin, “Design of a nonlinear system foresight controller based on the direct method of the Control System [J],” Control and Decision-making, 28 (11), 1679 –1684 (2013). Google Scholar

[2] 

Lu Zhiping, Hou Liqiang, Lu Chengyu, “A class of multi-stage three-terminal interval number group decision method that considers stage assignment [J],” Control and Decision-making, 28 (11), 1756 –1760 (2013). Google Scholar

[3] 

Lou Ke, Zhang Yan, Li Hao, “Mobile sensor network maintains network connectivity control [J],” Journal of Electronic Measurement and Instrument, 30 (11), 1657 –1663 (2016). Google Scholar

[4] 

Li Yanyi, Wang Jian, Li Zhiyuan, “Fuzzy PID control algorithm and simulation suitable for mapping quadrotor Uav [J],” Mapping Bulletin, 2020 (S1), 1 –5 + 12 Google Scholar

[5] 

Feng Zengxi, Zhang Cong, Li Binghui, “MFAC parameter optimization based on an improved particle swarm optimization algorithm [J],” Control Engineering, 28 (04), 766 –773 (2021). Google Scholar

[6] 

Tang Kzong, Li Zuoyong, Zhan Tangsen, “A multi-objective particle swarm optimization algorithm based on Pareto correlation degree dominance [J],” Journal of Nanjing University of Science and Technology, 43 (04), 439 –446 + 480 (2019). Google Scholar

[7] 

Cheng Jiangpeng, Xiao Jianmei, Wang Xihuai, “A VSG control strategy based on the improved particle swarm optimization algorithm [J],” Control works, 28 (10), 2028 –2037 (2021). Google Scholar

[8] 

Hu Hai, Wang Jie, Guan Peng, “Application of network video encryption based on superchaos theory [J],” Electronic measurement, 43 (09), 109 –113 (2020). Google Scholar

[9] 

Yuan Baoping, Xu Yi, Xia Yiwei, “Short-term load prediction method based on neural network and chaotic feature selection [J],” MicroPC, 37 (03), 87 –90 (2021). Google Scholar
(2025) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Ruo cheng Wang "An improved frog swarm neural network algorithm based on hyperspace dimensional chaos mapping", Proc. SPIE 13513, The International Conference Optoelectronic Information and Optical Engineering (OIOE2024), 135130J (15 January 2025); https://doi.org/10.1117/12.3045370
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Evolutionary algorithms

Artificial neural networks

Control systems

Particles

Chaos

Education and training

Particle swarm optimization

Back to Top