Printer Friendly

Multiscale Cooperative Differential Evolution Algorithm.

1. Introduction

The differential evolution (DE) is a bionic intelligence method proposed by American scholars Rainer Storn and Kenneth Price in 1995, simulating survival of the fittest [1,2]. The algorithm adopts mutation, crossover, and selection operations to mimic genetic mutations during biological evolution and retains highly adaptable individuals for optimal solutions. Aiming at the problems of both population convergence stagnation and premature convergence, researchers mainly focus on three aspects of control parameter setting and mutation strategy selection [3-6], crossover operation [7-9], and population structure [10-12] to improve the algorithm performance. The DE has been widely concerned by researchers because of its simple coding, convergence, and strong robustness. It has been applied in many fields such as industrial control [13], antenna design [14], power system [15], image processing [16], and so on.

The parameter control and evolutionary strategy selection are mainly discussed in two aspects of DE. On the one hand, control parameter settings for the scaling factor F, crossover probability CR, and population size NP [17]. On the other hand, different strategies for different optimization problems [18], we need to choose the most suitable strategy. The parameter setting affects the population diversity [19], the development ability of the early period, and the convergence of the later period [20]. The choice of evolutionary strategy is the key step to determine the balance between exploration and convergence of DE, and different evolution strategies will show different surveying capabilities and the convergence tendencies. At the same time, diverse crossover operations have diverse effects on seeking global optimization. Although the traditional binomial crossover operation has a certain role, it is more dependent on the cross coordinate system and is widely used. In addition, the population structure is also an important indicator for the algorithm performance. If the population size is too small, it will easily lead to the loss of effective alleles, thereby reducing the generation of competitive individuals. In contrast, if the population size is too large, the possibility of correct search direction by the algorithm will be reduced [11].

Due to premature convergence, parameter control, and strategy improvement, crossover operation and population structure attract increasing attention to improve the performances of DEs [17, 21-24]. Therefore, numerous DE-improvement algorithms [25, 26] have been proposed constantly based on parameters and strategies, such as parameter-adaptive jDE [21], JADE using "current-to-pbest/1" strategy and adaptive parameters [24], SaDE using adaptive difference strategy [23], CoDE suiting for experimental individual algebra strategy and control parameters [27], EPSDE for mutation strategy and control parameter [17], TDE for triangular mutation strategy [28], and super-fit multistandard adaptive SMADE [29]. Moreover, the DE is improved based on the crossover operation, such as ODE [30] adopting orthogonal crossover operators and CoBiDE [31] using covariance learning and bimodal distribution of parameters. And DE is improved based on population structure, such as SPSRDEMMS [32] for multivariation strategies, MPEDE [33] for multipopulations and strategy sets, master-slave model [34], island model [35], cellular model [36], level model [37], and pool model [38]. In recent years, population segregation techniques have been used to improve evolutionary algorithms, including particle swarm optimization, genetic algorithm, and evolutionary algorithm [39-44].

To further improve the convergence and reduce the population stagnation, a multiscale cooperative differential evolution (MCDE) algorithm is proposed. In terms of parameter setting, the scaling factor F and the crossover probability CR are mainly adjusted based on the literature [24]. In the selection of mutation strategy, the MCDE selects "current-to-pbest/1," "current-to-rand/1," and "rand/1" as mutation strategy groups. In the initial phase, the evolutionary population was divided into multiple subpopulations, and one subpopulation was selected as the experimental population to test the mutation strategy with better evolutionary results. In the evolutionary phase, the global search capability is continuously promoted by establishing a constant rotation of the cross coordinate system and coordinating among multiple subpopulations. In the end, the best individual that remains is used as the optimal solution. In CEC 2005, 30-dimension and 50-dimension simulation tests were conducted and compared with contemporary evolutionary algorithms; MCDE was found to have more significant effects.

The paper is organized as follows. Section 2 briefly introduces the standard DE algorithm. Section 3 elaborates on the algorithm improvement. Section 4 analyzes the significance of the proposed algorithm through experimental data. Section 5 gives a summary.

2. Standard Differential Evolution Algorithm

DE can be regarded as greedy evolution algorithm based on real number coding and global optimization. In the evolutionary phase, three iteration processes of mutation, crossover, and selection are performed until the stop condition is satisfied. The fitness function f(x) is utilized to evaluate the quality and the best individual is recorded.

2.1. Initialization. Assuming that the population size is NP and the dimension of the feasible solution space [x.sup.G] is employed to represent the evolution population of G generation. Each individual is composed of D-dimensional parameters, which can be expressed as

[x.sup.G.sub.i] = {[x.sup.G.sub.i,1], [x.sup.G.sub.i,2], ... [x.sup.G.sub.i,D]}, i [member of] {1,2,..., NP}, (1)

where [x.sup.G.sub.i,j] [member of] ([x.sup.L], [x.sup.H]) and [x.sup.L] and [x.sup.H] represent the upper and lower bounds of the individual, respectively.

2.2. Mutation Operation. The individual [x.sup.G.sub.i] in the parent population generates a variant individual [v.sup.G.sub.i] by a mutation strategy. "DE/rand/1" indicates that the DE chooses a random perturbation individual to mutate. The expression is as follows:

[v.sup.G.sub.i] = [x.sup.G.sub.r1] + F x ([x.sup.G.sub.r2] - [x.sup.G.sub.r3]), r1, r2, r3 [member of] {1,2,..., NP}, (2)

where r1 [not equal to] r2 [not equal to] r3 and r1, r2, and r3 are a randomly generated mutation individual. The scaling factor F is chosen from [0,1].

2.3. Crossover Operation. The main function of the crossover operation is that the generated variant individuals cross with individuals in the original population to generate new crossover individuals. The DE adopts binomial crossover scheme. The crossover operation is as follows:

[mathematical expression not reproducible], (3)

where [rand.sub.j] [member of] [0, 1], [j.sub.rand] is chosen from {1, 2,..., D}, and crossover probability CR is [0, 1].

2.4. Selection Operation. The selection operation mainly adopts the greedy selection mode of the survival of the fittest, making the offspring always superior to or equal to the parent individual [x.sub.i]. When the fitness value of the new individual [u.sub.i] is better than that of the objective individual, the new individuals [u.sub.i] will be accepted by the population. Otherwise, [x.sub.i] still remains in the next generation population and continues to perform mutation and crossover operations as the objective individual in the next iterative calculation so that the population will always evolve toward the optimal solution. The selection operation is for minimization fitness value as follows:

[mathematical expression not reproducible], (4)

where f(x) is the objective function to be optimized.

3. Multiscale Cooperative Differential Evolution Algorithm

In the proposed algorithm, we divide the whole population into multiple subpopulations and give corresponding mutation strategies. Then, the cross coordinate system of each subpopulation is established by covariance learning and parameter adaptation of evolutionary subpopulation. Finally, the obtained crossover individual is selected and the individuals with better fitness are retained to make the whole population search forward to the global optimal solution.

3.1. Multiscale Mutation Strategy Integration Method. In recent years, because different mutation strategies are suitable for solving different optimization functions, some researchers mainly focus on multiple mutation strategies method [23, 24]. Even for a specific optimization problem, the most appropriate mutation strategy may be different at different stages of evolution. Therefore, mutation strategy is an important indicator to ensure significant results in the DE. During evolution, this paper selects "current-to-pbest/ 1," "current-to-rand/1," and "rand/1" as the multiscale mutation strategy set because of the different performance requirements for the mutation strategy. The individuals of "current-to-rand/1" and "rand/1" involved in mutation are all selected in a random manner so that global optimization can be performed in the early stages of evolution. "current-to-pbest/1" seeks the global optimal solution through the current best population individual. During evolution, the search range can be reduced to the vicinity of the optimal solution and the convergence speed can be accelerated.

Current-to-pbest/1:

[mathematical expression not reproducible]. (5)

Current-to-rand/1:

[mathematical expression not reproducible]. (6)

rand/1:

[mathematical expression not reproducible], (7)

where [x.sup.G.sub.pbest] is uniformly chosen as one of the top p individuals in the current population with pbest [member of] (0, 1]. Because the three mutation strategies have their own advantages, there are some differences. Therefore, the population multiscale mechanism is introduced in this paper. The whole population Pop is divided into three subpopulation [Pop.sub.1], [Pop.sub.2], and [Pop.sub.3]. [Pop.sub.1] with the largest population size is determined as the experimental population and combined with the corresponding mutation strategy. During evolution, the experimental population is allocated to mutation strategy with better evolution results. The population structure is expressed as follows:

[mathematical expression not reproducible], (8)

where we assume that [Pop.sub.1] is an experimental population, NP is the population size, [sigma] represents population size ratio, [[sigma].sub.1] > [[sigma].sub.2] = [[sigma].sub.3] and [[sigma].sub.i] [member of] [0, 1].

After the population structure is well designed, the distribution rules of the subpopulations should be given. First, subpopulation [Pop.sub.1], [Pop.sub.2], and [Pop.sub.3] incorporate corresponding mutation strategies. Then, the population undergoes mutation, crossover, and selection operations. Finally, the total number b[d.sub.i] of superior individuals retained after each subpopulation evolution is counted. That is, the superior rate b[r.sub.i] of the subpopulation can be expressed as

b[r.sub.i] = b[d.sub.i]/N[P.sub.i], i = 1,2,3. (9)

The superior rate b[r.sub.i] of each generation of subpopulation is calculated, and the subpopulation is reallocated for three mutation strategies according to the superior rate b[r.sub.i] in the next generation initialization stage. The multiscale mutation strategy set method makes full use of the advantages of the three mutation strategies to regulate and balance the contradiction between the population diversity and the convergence speed, which can be seen from the experimental results of the latter. In the first generation, the subpopulations randomly assign a mutation strategy. At the end of the first generation, we calculate the subpopulations superior rate by equation (9). The maximum superior rate stands for the best mutation strategy in this generation. Assume that the first-generation mutation strategy "current-to-pbest/1" has the highest superior rate, and the second generation assigns [Pop.sub.1] to it. The remaining subpopulations [Pop.sub.2] and [Pop.sub.3] randomly assign a mutation strategy ("current-to-rand/1" or "rand/1").

3.2. Covariance Learning. The aforementioned crossover operators mainly depend on the coordinate system, while the distribution information of the population reflects the direction of evolution to some extent [20]. During evolution, the distribution of population is often neglected, leading to the possibility of the population falling into local optimum and premature convergence. In this paper, variance and covariance are utilized to analyze population distribution and form covariance matrix to reflect population diversity information. Therefore, the systematic use of covariance matrix can reduce the dependence on coordinate system and the interaction between variables. Covariance matrix learning includes two related technologies: the feature decomposition and coordinate transformation of covariance matrix. The covariance matrix learning steps are as follows:

Step 1. Calculate covariance matrix C of subpopulations.

Step 2. Get the eigenvalue [lambda] and feature vector matrix R of covariance.

Step 3. Update the objective individual and the variant individual through the feature-based cooperative system.

[mathematical expression not reproducible]. (10)

Step 4. Populations with better fitness for crossover and selection operations are retained and rotated back to the original coordinate system.

[u.sup.G.sub.i] = R * [u.sup.G.sub.i]. (11)

Based on the above four steps, we establish the population feature coordinate system. Figure 1(a) shows the initial coordinate system of population evolution, and Figure 1(b) shows the feature coordinate system. By analyzing the population feature, we obtain the o[x.sub.1][x.sub.2] coordinate system and discover that we can find the global optimum faster.

3.3. Adaptive Control Parameter Settings. At present, researchers have proposed many effective parameter adaptation methods [21, 23, 24]. The combination of different control parameters and mutation strategies for the optimization problem will yield different results. In this paper, each scale strategy has its own control parameters, and different technologies are applied to the algorithm. The method in [24] is more suitable for the algorithm, so it adapts to the algorithm by improving its technology.

During evolution, scaling factor F plays a decisive role in the search range of base vectors. In standard DE algorithm, the value of F is a fixed value, which cannot be applied to solve all global optimization functions. In this paper, the scalar factor F mainly adopts the Cauchy inverse cumulative distribution function, assuming that [F.sub.i,j] represents the scale factor of each dimension in the individual. [F.sub.i,j] is expressed as follows:

[F.sub.i,j] = [Cauchy.sub.i,j](F[m.sub.j], 0.1), (12)

where F[m.sub.j] is the position parameter of the Cauchy inverse cumulative distribution function and the scale factor of current individual and the initial value of F[m.sub.j] is set to 0.5. 0.1 indicates the scale parameter of the Cauchy inverse cumulative distribution function. To better apply to population evolution, the weighting factor c is introduced to combine the parent factor and the next generation factor. The current F[m.sub.j] is expressed as follows:

F[m.sub.j] = (1 - c) * F[m.sub.j] + c * [mean.sub.F]([S.sub.F,j]), (13)

where c [member of] [0,1] and parental scalar factor [S.sub.F,j] is calculated using the power mean. The power mean is expressed as follows:

[mean.sub.F]([S.sub.F,j]) = [(1/NP * [summation over (NP)] [F.sup.n]).sup.1/n], (14)

where n is the index value of the power mean, which is quantified to the influence of the parent's scaling factor on the offspring.

In the DE algorithm, the crossover probability CR determines the possibility that an objective individual inherits gene from variant individual [v.sup.G.sub.i]. In this paper, the crossover probability CR mainly adopts the normal distribution function, assuming that C[R.sub.i,j] represents the crossover probability of each dimension in the individual. C[R.sub.i,j] is expressed as follows:

C[R.sub.i,j] = rand [n.sub.i,j](CR[m.sub.j], 0.1), (15)

where CR[m.sub.j] is the mean of individual crossover probability and the initial value is set to 0.5. The standard deviation of normal distribution is set to 0.1. To better inherit the parent gene, a weighting factor c is introduced to combine the parent crossover probability with the next generation crossover probability. CR[m.sub.j] is expressed as follows:

CR[m.sub.j] = (1 - c) * CR[m.sub.j] + c * [mean.sub.CR]([S.sub.CR,j]), (16)

where c [member of] [0,1] and parental crossover probability [S.sub.CR,j] is calculated using the Lehmer mean. The Lehmer mean is as follows:

[mean.sub.CR] ([S.sub.CR,j]) = [[summation].sub.D][CR.sup.2]/[[summation].sub.D]CR. (17)

The Lehmer mean method can flexibly adjust the value of CR according to the parent cross probability.

3.4. Algorithm Framework. The proposed algorithm combines multiscale strategy and covariance learning and introduces adaptive control parameters to lead the population to keep close to the global optimum. Based on the above analysis, the basic flow of MCDE is summarized as Algorithm 1.

4. Experimental Results and Analysis

The MCDE is tested on 25 benchmark functions of IEEE CEC 2005. The 25 benchmark functions mainly include unimodal function [F.sub.1]-[F.sub.5], basic multimodal function [F.sub.6]-[F.sub.12], extended multimodal function [F.sub.13]-[F.sub.14], and complex function [F.sub.15]-[F.sub.25]. For details, please refer to [45]. In this paper, the parameter setting of the MCDE is as follows: population size NP = 250 and subpopulation ratio [[sigma].sub.1] = 0.6, [[sigma].sub.2] = [[sigma].sub.3] = 0.2. Experimental environment: the operating system is win7 Professional 64 bit, CPU is core i7 (3.40 GHz), RAM is 8 GB, and the compiler is MATLAB R2014b.

4.1. Comparison with Improved DE Algorithm. To verify the performance of the MCDE, it is compared with the six classic DE-improvement algorithms: JADE [24], jDE [21], SaDE [23], EPSDE [17], CoDE [18], CoBiDE [31], and LSHADE [46]. JADE and jDE are representative algorithms and are heavily referenced. SaDE and EPSDE are based on multi-strategy improved algorithms. CoDE and CoBiDE are improved algorithms based on population structure. The experimental results of the above seven algorithms are shown in Table 1, where D = 30 and MaxFES = 300000. The form of the numerical values in the table is the mean error [+ or -] standard deviation. "-/ + / [approximately equal to] " means that the comparison algorithm is obviously better than, worse than, and similar to MCDE. Based on the data given in Table 1 and Figure 2, we can draw the following conclusions: (1) unimodal function [F.sub.1]-[F.sub.5]: among the comparison algorithms, JADE and LSHADE have the best effect. Because of the greedy strategy "current-to-pbest/1," the algorithm can achieve fast convergence and high precision. However, the MCDE multiscale strategy achieves better results than JADE in the accuracy of the benchmark functions [F.sub.3] (a), [F.sub.4] (b), and [F.sub.5] (c). (2) Basic multimodal function [F.sub.6]-[F.sub.12]: the best performing algorithm is CoBiDE, which is better than MCDE on benchmark functions [F.sub.6], [F.sub.8], [F.sub.9], and [F.sub.1]1. Test results on [F.sub.7] (d), [F.sub.1]0 (e), and [F.sub.12] (f) are worse than MCDE.
Algorithm 1: Pseudocode of the MCDE algorithm.

Input: population size NP, dimension D, Maximum number of evaluations
   MaxFES; the initial scale factor F[m.sub.j], the initial crossover
   probability CR[m.sub.j]; weighting factor c = 0.1, power mean n = 4;
   initialize the population [Pop.sub.1], [Pop.sub.2], and [Pop.sub.3]
   according to equation (8); let [[sigma].sub.1] + [[sigma].sub.2] +
   [[sigma].sub.3] = 1;
Begin:
   Evolutionary generation G = 0, current evaluation times FES = 0;
   While FES  [less than or equal to] MaxFES
   For j = 1 [right arrow] 3
      If G > 0
         Calculate F[m.sub.j], CR[m.sub.j] according to equations
         (13), (14), (16), and (17);
      End if
      For i = 1 [right arrow] N[P.sub.j]
         Calculate the subpopulation [F.sub.ij], [CR.sub.ij]
         according to equations (12) and (15); Perform mutation
         strategies according to equations (5), (6), and (7),
         respectively; Perform covariance learning according
         to equations (10) and (11);
      End for
      For i = 1 [right arrow] NP;
        If f([u.sup.G.sub.i]) [less than or equal to]
        f([x.sup.G.sub.i])
        [x.sup.G+1.sub.i] = [u.sup.G.sub.i];
        [S.sub.F.j] = [F.sub.i,j], SCR, j = CRi,j;
      Else
        [x.sup.G+1.sub.i] = [x.sup.G.sub.i];
      End if
      FES = FES + N[P.sub.j];
    End for
  End for
  Pop = [[summation].sub.j=1,2,3 ][Pop.sub.j], G = G + 1;
  According to the equation (9), the proportion of good individuals
  and the redistribution of subpopulations were counted;
  End while
End
Output: the population of individual minimum objective function.


Overall, the MCDE is similar to the CoBiDE on this type of benchmark function. (3) Extended multimodal function [F.sub.13]-[F.sub.14] (g): the average error of the seven algorithms is at an order of magnitude, but the effects of JADE, CoDE, and MCDE are slightly better than the other four algorithms. (4) Complex function [F.sub.15]-[F.sub.25] (h): MCDE is significantly better than JADE, jDE, CoDE, CoBiDE and LSHADE and slightly better than SaDE and EPSDE.

Based on the above four conclusions and Wilcoxon's test, it can be concluded that the MCDE shows significant effects in the four types of benchmark functions. Finally, the experimental results of the MCDE in D = 30 are better than those of JADE, jDE, SaDE, EPSDE, CoDE, CoBiDE, and LSHADE on 13, 13, 15, 18, 10, 13, and 11 benchmark functions, respectively, worse than other comparison algorithms on 3, 3, 5, 6, 5, 4, and 7 benchmark functions, and similar to other comparison algorithms on 9, 9, 5, 1, 10, 8, and 7 benchmark functions.

From Table 2, it can be seen that when Wilcoxon's detection is at [alpha] = 0.05 and [alpha] = 0.1, MCDE is more effective than JADE, jDE, SaDE, EPSDE, CoDE, CoBiDE, and LSHADE. According to Friedman's average ranking (D = 30) in Table 3, MCDE performed well in all types of benchmark functions and achieved the best ranking.

The experimental results of the above seven algorithms are shown in Table 4, where D = 50 and MaxFES = 500000. Based on the data given in Table 4 and Figure 3, we can draw the following conclusions. (1) Unimodal function [F.sub.1]-[F.sub.5]:in D = 50, the effect of MCDE is higher than the other algorithms on [F.sub.4] (b) and [F.sub.5] (c). It shows that the search scope of mutation strategy is wider and the parameter-adaptive control performance is better. The test results of [F.sub.2] and [F.sub.3] are only inferior to the JADE and LSHADE. (2) Basic multimodal function [F.sub.6]-[F.sub.12]: CoBiDE and LSHADE perform significantly better in this type of benchmark functions, whereas MCDE is slightly better than that on [F.sub.6] (d), [F.sub.7] (e), [F.sub.1]0 (f), and [F.sub.12] (g). (3) Extended multimodal function [F.sub.13]-[F.sub.14] (h): the accuracy of MCDE is better than that of the other six algorithms, mainly because the proposed algorithm adopts a multiscale strategy to search for the best results. (4) Complex function [F.sub.15]-[F.sub.25] (i) (j): such functions are the most complex problems on benchmark functions. There are 11 benchmark functions in all. The result of JADE, jDE, SaDE, CoDE, and LSHADE is not significant. The result of EPSDE is not stable, while MCDE, JADE, and CoBiDE are better than them.

Based on the above four conclusions and Wilcoxon's test, it can be concluded that MCDE shows significant effects in the four types of benchmark functions. Finally, the experimental results of the MCDE in D = 50 are better than the JADE, jDE, SaDE, EPSDE, CoDE, CoBiDE, and LSHADE on 18, 20, 21, 17, 22, 13, and 15 benchmark functions, worse than them on 4, 2, 2, 7, 2, 6, and 7 benchmark functions, and similar to them on 3, 3, 2, 1, 1, 6, and 3 benchmark functions, respectively.

From Table 5, it can be seen that when Wilcoxon's detection is at [alpha] = 0.05, MCDE is more effective than JADE, jDE, SaDE, EPSDE, CoDE, and LSHADE, and the p value of CoBiDE is 0.06. At [alpha] = 0.1, MCDE has significant differences from other algorithms. Based on Table 6 Friedman average ranking in D = 50, MCDE performed well in all types of benchmark functions and achieved the top ranking.

4.2. Comparison with Related Evolutionary Algorithms. To further evaluate MCDE, it is compared with CLPSO [47], CMA-ES [48], and GL-25 [25, 26]. CLPSO is a local version of the PSO, adopting a new learning strategy mechanism. CMA-ES adopts a covariance matrix adaptive mechanism and is mainly utilized to solve continuous optimization problems. GL-25 is a global and local real-coded genetic algorithm based on a new crossover operator. The experimental results of MCDE, CLPSO, CMA-ES, and GL-25 are shown in Table 7 at D = 30 and MaxFES = 300000. It can be concluded that MCDE has the most prominent effect on the unimodal function ([F.sub.2]-[F.sub.5]) and is smaller than the average error of other evolution algorithms. On the basic multimodal function [F.sub.10] and [F.sub.12], the result of MCDE is significantly better than other algorithms. On the extended multimodal functions and complex functions, most functions ([F.sub.14], [F.sub.16], [F.sub.17], [F.sub.21], [F.sub.23], [F.sub.24], and [F.sub.25]) have significant effects. Finally, the experimental results of MCDE in D = 30 are better than CLPSO, CMA-ES, and GL on 19, 15, and 21 benchmark functions, worse than those on 2, 5, and 1 benchmark functions, and similar to those on 4, 5, and 3 benchmark functions.

In this paper, the proposed algorithm is further compared with other evolution algorithms. From Table 8, it can be seen that when Wilcoxon's test detects [alpha] = 0.05 and [alpha] = 0.1, MCDE's p value is less than 0.05 and 0.1, and the effect is most significant. According to Table 9, the average ranking of Friedman under D = 30 shows that MCDE performs best on benchmark functions.

4.3. Runtime Comparison and Mechanism Comparison. In general, the running time of evolution algorithm contains the operating time of operator and the time of evaluating the fitness function. JADE, jDE, SaDE, EPSDE, CoDE, CoBiDE, and the proposed algorithms were run 25 times independently on 25 benchmark functions, and the average CPU time consumed was recorded. Set the parameters: MaxFES = 300000 and D = 30. To compare the average time, this paper determines the running speed of the algorithm by means of the mean CPU time ratio (AR) between the algorithms. AR > 1 shows that the algorithm runs slower than MCDE, and AR < 1 shows that the algorithm is faster than MCDE.

From the average AR in Table 10, it can be seen that its main range is [0.85,13.41]. jDE runs at the fastest speed, and EPSDE runs at the slowest speed. The proposed algorithm is ranked third. The proposed algorithm is slower than jDE and JADE because multiscale strategies increase the search range but consume more time in mutation strategies.

By increasing the experiment with and without multigroup mechanism and covariance learning, it can be concluded from Table 11 and Figure 4 that the multiscale mechanism (DE-1) is outstanding in the unimodal function [F.sub.4] (a). Covariance learning (DE-2) performs significantly in basic multimodal and complex functions with relatively complex structures in [F.sub.10] (b), [F.sub.16] (c), and [F.sub.17] (d). The population structure is a multipopulation mechanism, and each subpopulation combines the corresponding mutation strategy to ensure the individual diversity in the evolutionary process. Then, the covariance learning establishes a proper rotation coordinate system for the crossover operation in the population. At the same time, adaptive control parameters are adopted to balance population survey and algorithm convergence.

5. Conclusions

MCDE introduces multiscale strategies, including local mutation strategies and global mutation strategies, to expand the population search scope. During evolution, the initial coordinate system is properly rotated by the covariance learning matrix to rotate the objective individual and the variant individual. During the covariance learning, the excellent crossover probability CR and the scaling factor F were inherited from the previous generation by the Lehmer mean and the power mean, respectively. The proposed algorithm is compared with JADE, jDE, SaDE, EPSDE, CoDE, CoBiDE, and LSHADE on the CEC 2005 benchmark function, and it can be seen that there are significant effects on the global optimization problem with D = 30 and D = 50. To further verify the algorithm, we compare it with other evolutionary algorithms such as CLPSO, CMA-ES, and GL-25 in D = 30 and discover it works best. In terms of running time, the proposed algorithm is in the upper part of the comparison algorithms. In summary, both the accuracy and the convergence speed have improved, so MCDE can be implemented.

https://doi.org/10.1155/2019/5259129

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Authors' Contributions

Yongzhao Du and Yuling Fan contributed equally.

Acknowledgments

This study was supported by the Promotion Program for Young and Middle-Aged Teachers in Science and Technology Research of Huaqiao University (no. ZQN-PY518) and the grants from National Natural Science Foundation of China (grant nos. 61605048 and 61603144). This study was also supported in part by the Natural Science Foundation of Fujian Province, China (grant nos. 2015J01256 and 2016J01300), Quanzhou Scientific and Technological Planning Projects of Fujian, China (grant nos. 2015Z120 and 2017G024), and postgraduate research and innovation ability training program funds of Huaqiao University (grant no. 1611422002).

References

[1] R. Storn and K. Price, "Differential evolution--a simple and efficient heuristic for global optimization over continuous spaces," Journal of Global Optimization, vol. 11, no. 4, pp. 341-359, 1997.

[2] R. Storn and K. Price, "Differential evolution: a simple evolution strategy for fast optimization," Dr. Dobb's Journal, vol. 22, pp. 18-24, 1997.

[3] S. Biswas, S. Kundu, and S. Das, "An improved parent-centric mutation with normalized neighborhoods for inducing niching behavior in differential evolution," IEEE Transactions on Cybernetics, vol. 44, no. 10, pp. 1726-1737, 2014.

[4] H. Guo, Y. Li, J. Li, H. Sun, D. Wang, and X. Chen, "Differential evolution improved with self-adaptive control parameters based on simulated annealing," Swarm and Evolutionary Computation, vol. 19, pp. 52-67, 2014.

[5] L. Tang, Y. Dong, and J. Liu, "Differential evolution with an individual-dependent mechanism," IEEE Transactions on Evolutionary Computation, vol. 19, no. 4, pp. 560-574, 2015.

[6] J. Wang, J. Liao, Y. Zhou, and Y. Cai, "Differential evolution enhanced with multiobjective sorting-based mutation operators," IEEE Transactions on Cybernetics, vol. 44, no. 12, pp. 2792-2805, 2014.

[7] N. Pholdee and S. Bureerat, "Hybridisation of real-code population-based incremental learning and differential evolution for multiobjective design of trusses," Information Sciences, vol. 223, no. 6, pp. 136-152, 2013.

[8] S. Sayah and A. Hamouda, "A hybrid differential evolution algorithm based on particle swarm optimization for non-convex economic dispatch problems," Applied Soft Computing, vol. 13, no. 4, pp. 1608-1619, 2013.

[9] Y.-J. Zheng, X.-L. Xu, H.-F. Ling, and S.-Y. Chen, "A hybrid fireworks optimization method with differential evolution operators," Neurocomputing, vol. 148, no. 148, pp. 75-82, 2015.

[10] J. Cheng, G. Zhang, and F. Neri, "Enhancing distributed differential evolution with multicultural migration for global numerical optimization," Information Sciences, vol. 247, no. 15, pp. 72-93, 2013.

[11] M. Yang, C. Li, Z. Cai, and J. Guan, "Differential evolution with auto-enhanced population diversity," IEEE Transactions on Cybernetics, vol. 45, no. 2, pp. 302-315, 2015.

[12] W. Zhu, Y. Tang, J.-A. Fang, and W. Zhang, "Adaptive population tuning scheme for differential evolution," Information Sciences, vol. 223, no. 2, pp. 164-191, 2013.

[13] L. Tang, Y. Zhao, and J. Liu, "An improved differential evolution algorithm for practical dynamic scheduling in steelmaking-continuous casting production," IEEE Transactions on Evolutionary Computation, vol. 18, no. 2, pp. 209-225, 2014.

[14] M. A. Mangoud, M. T. Alshara, and H. M. Elragal, "Design of time modulated concentric circular and concentric hexagonal antenna array using hybrid enhanced particle swarm optimisation and differential evolution algorithm," IET Microwaves, Antennas & Propagation, vol. 8, no. 9, pp. 657-665, 2014.

[15] V. Basetti and A. K. Chandel, "Hybrid power system state estimation using Taguchi differential evolution algorithm," IET Science, Measurement and technology, vol. 9, no. 4, pp. 449-466, 2015.

[16] Y. Zhong, L. Zhao, and L. Zhang, "An adaptive differential evolution endmember extraction algorithm for hyperspectral remote sensing imagery," IEEE Geoscience and Remote Sensing Letters, vol. 11, no. 6, pp. 1061-1065, 2014.

[17] R. Mallipeddi, P. N. Suganthan, Q. K. Pan, and M. F. Tasgetiren, "Differential evolution algorithm with ensemble of parameters and mutation strategies," Applied Soft Computing, vol. 11, no. 2, pp. 1679-1696, 2011.

[18] R. Wang, R. C. Purshouse, and P. J. Fleming, "Preference-inspired co-evolutionary algorithms using weight vectors," European Journal of Operational Research, vol. 243, no. 2, pp. 423-441, 2015.

[19] D. Zaharie, "Critical values for the control parameters of differential evolution algorithm," in Proceedings of the 8th International Mendel Conference on Soft Computing, pp. 62-67, Brno, Czech Republic, 2002.

[20] S. Das and P. N. Suganthan, "Differential evolution: a survey of the state-of-the-art," IEEE Transactions on Evolutionary Computation, vol. 15, no. 1, pp. 4-31, 2011.

[21] J. Brest, S. Greiner, B. Boskovic, M. Mernik, and V. Zumer, "Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems," IEEE Transactions on Evolutionary Computation, vol. 10, no. 6, pp. 646-657, 2006.

[22] W. Gong, Z. Cai, C. X. Ling, and C. Li, "Enhanced differential evolution with adaptive strategies for numerical optimization," IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 41, no. 2, pp. 397-413, 2011.

[23] A. K. Qin, V. L. Huang, and P. N. Suganthan, "Differential evolution algorithm with strategy adaptation for global numerical optimization," IEEE Transactions on Evolutionary Computation, vol. 13, no. 2, pp. 398-417, 2009.

[24] J. Zhang and A. C. Sanderson, "JADE: adaptive differential evolution with optional external archive," IEEE Transactions on Evolutionary Computation, vol. 13, no. 5, pp. 945-958, 2009.

[25] C. Garcia-Martinez, M. Lozano, F. Herrera, D. Molina, and A. M. Sanchez, "Global and local real-coded genetic algorithms based on parent-centric crossover operators," European Journal of Operational Research, vol. 185, no. 3, pp. 1088-1113, 2008.

[26] S. Das, S. S. Mullick, and P. N. Suganthan, "Recent advances in differential evolution--an updated survey," Swarm and Evolutionary Computation, vol. 27, pp. 1-30, 2016.

[27] Y. Wang, Z. Cai, and Q. Zhang, "Differential evolution with composite trial vector generation strategies and control parameters," IEEE Transactions on Evolutionary Computation, vol. 15, no. 1, pp. 55-66, 2011.

[28] H.-Y. Fan and J. Lampinen, "A trigonometric mutation operation to differential evolution," Journal of Global Optimization, vol. 27, no. 1, pp. 105-129, 2003.

[29] F. Caraffini, F. Neri, J. Cheng et al., "Super-fit multicriteria adaptive differential evolution," in Proceedings of the IEEE Congress on Evolutionary Computation, pp. 1678-1685, Cancun, Mexico, June 2013.

[30] Y. Wang, Z. Cai, and Q. Zhang, "Enhancing the search ability of differential evolution through orthogonal crossover," Information Sciences, vol. 185, no. 1, pp. 153-177, 2012.

[31] R. Tanabe and A. Fukunaga, "Success-history based parameter adaptation for differential evolution," in Proceedings of the IEEE Congress on Evolutionary Computation, pp. 71-78, Cancun, Mexico, June 2013.

[32] A. Zamuda, J. Brest, and E. Mezura-Monte, "Structured population size reduction differential evolution with multiple mutation strategies on CEC 2013 real parameter optimization," in Proceedings of the IEEE Congress on Evolutionary Computation, pp. 1925-1931, Cancun, Mexico, June 2013.

[33] G. H. Wu, R. Mallipeddi, P. N. Suganthan, R. M. Duwairi, and R. G. Reynolds, "Differential evolution with multi-population based ensemble of mutation strategies," Information Sciences, vol. 10, pp. 329-345, 2016.

[34] M. Dubreuil, C. Gagne, and M. Parizeau, "Analysis of a master-slave architecture for distributed evolutionary computations," IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics), vol. 36, no. 1, pp. 229-235, 2006.

[35] F. Herrera and M. Lozano, "Gradual distributed real-coded genetic algorithms," IEEE Transactions on Evolutionary Computation, vol. 4, no. 1, pp. 43-63, 2000.

[36] E. Alba and B. Dorronsoro, "The exploration/exploitation tradeoff in dynamic cellular genetic algorithms," IEEE Transactions on Evolutionary Computation, vol. 9, no. 2, pp. 126-142, 2005.

[37] G. Folion, C. Pizzuti, and G. Spezzano, "Training distributed GP ensemble with a selective algorithm based on clustering and pruning for pattern classification," IEEE Transactions on Evolutionary Computation, vol. 12, no. 4, pp. 458-468, 2008.

[38] G. Roy, H. Lee, J. L. Welch et al., "A distributed pool architecture for genetic algorithms," in Proceedings of the IEEE Congress on Evolutionary Computation, pp. 1177-1184, Trondheim, Norway, May 2009.

[39] M. Ali, M. Pant, and A. Abraham, "Improved differential evolution algorithm with decentralisation of population," International Journal of Bio-Inspired Computation, vol. 3, no. 1, pp. 17-30, 2011.

[40] Y.-L. Li and J. Zhang, "A new differential evolution algorithm with dynamic population partition and local restart," in Proceedings of the 13th Annual Genetic and Evolutionary Computation Conference-GECCO-2011, pp. 1085-1092, Dublin, Ireland, July 2011.

[41] P. Novoa-Hernaandez, C. C. Corona, and D. A. Pelta, "Self-adaptive, multipopulation differential evolution in dynamic environments," Soft Computing, vol. 17, no. 10, pp. 1861-1881, 2013.

[42] W.-J. Yu and J. Zhang, "Multi-population differential evolution with adaptive parameter control for global optimization," in Proceedings of the 13th Annual Genetic and Evolutionary Computation Conference-GECCO-2011, pp. 1093-1098, Dublin, Ireland, July 2011.

[43] J. Zhang and X. Ding, "A multi-swarm self-adaptive and cooperative particle swarm optimization," Engineering Applications of Artificial Intelligence, vol. 24, no. 6, pp. 958-967, 2011.

[44] S.-Z. Zhao, P. N. Suganthan, Q.-K. Pan, and M. Fatih Tasgetiren, "Dynamic multi-swarm particle swarm optimizer with harmony search," Expert Systems with Applications, vol. 38, no. 4, pp. 3735-3742, 2011.

[45] P. N. Suganthan, N. Hansen, J. J. Liang et al., "Problem definitions and evaluation criteria for cec 2005 special session on real-parameter optimization," KanGAL report, 2005005, Nanyang Technological University, Singapore, 2005.

[46] R. Tanabe and A. S. Fukunaga, "improving the search performance of shade using linear population size reduction," in Proceedings of the 2014 IEEE Congress on Evolutionary Computation, July 2014.

[47] J. J. Liang, A. K. Qin, P. N. Suganthan, and S. Baskar, "Comprehensive learning particle swarm optimizer for global optimization of multimodal functions," IEEE Transactions on Evolutionary Computation, vol. 10, no. 3, pp. 281-295, 2006.

[48] N. Hansen and A. Ostermeier, "Completely derandomized self-adaptation in evolution strategies," Evolutionary Computation, vol. 9, no. 2, pp. 159-195, 2001.

Yongzhao Du, (1,2) Yuling Fan, (1) Xiaofang Liu, (1) Yanmin Luo [ID], (3) Jianeng Tang [ID], (1) and Peizhong Liu [ID]

(1) College of Engineering, Huaqiao University, Quanzhou 362021, China

(2) Research Center of Apply Statistics and Big Data, Huaqiao University, Xiamen 361021, China

(3) College of Computer Science and Technology, Huaqiao University, Xiamen 361021, China

Correspondence should be addressed to Peizhong Liu; pzliu@hqu.edu.cn

Received 20 June 2019; Revised 2 August 2019; Accepted 26 August 2019; Published 17 December 2019

Academic Editor: Roman Bartak

Caption: Figure 1: Population initial coordinate system and population feature coordinate system: (a) the initial coordinate system of population evolution; (b) the Eigen coordinate system of population evolution.

Caption: Figure 2: Evolution of the mean function error values derived from JADE, jDE, SaDE, CoDE, CoBiDE, LSHADE, and MCDE versus the number of FES on [F.sub.3], [F.sub.4], [F.sub.5], [F.sub.7], [F.sub.1]0, [F.sub.12], [F.sub.13], and [F.sub.23]. (a) D = 30 [F.sub.3]. (b) D = 30 [F.sub.4]. (c) D = 30 [F.sub.5]. (d) D = 30 [F.sub.7]. (e) D = 30 [F.sub.10]. (f) D = 30 [F.sub.12]. (g) D = 30 [F.sub.13]. (h) D = 30 [F.sub.23].

Figure 3: Evolution of the mean function error values derived from JADE, jDE, SaDE, CoDE, CoBiDE, LSHADE, and MCDE versus the number of FES on [F.sub.3], [F.sub.4], [F.sub.5], [F.sub.6], [F.sub.7], [F.sub.10], [F.sub.12], [F.sub.13], [F.sub.16], and [F.sub.2]3. (a) D = 50 [F.sub.3]. (b) D = 50 [F.sub.4]. (c) D = 50 [F.sub.5]. (d) D = 50 [F.sub.6]. (e) D = 50 [F.sub.7]. (f) D = 50 [F.sub.10]. (g) D = 50 [F.sub.12]. (h) D = 50 [F.sub.13]. (i) D = 50 [F.sub.16]. (j) D = 50 [F.sub.23].

Caption: Figure 4: Evolution of the mean function error values derived from DE-1, DE-2, and MCDE versus the number of FES on [F.sub.4], [F.sub.1]0, [F.sub.15], and [F.sub.17]. (a) The result of [F.sub.4] under D = 30. (b) The result of [F.sub.10] under D = 30. (c) the result of [F.sub.16] under D = 30. (d) The result of [F.sub.17] under D = 30.
Table 1: Comparison results of MCDE with JADE, jDE,
SaDE, EPSDE, CoDE, and CoBiDE (D = 30).

Function                             JADE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                           [approximately equal to]
[F.sub.2]              1.49E - 28 [+ or -] 1.32E - 28 +
[F.sub.3]               8.36E + 03 [+ or -] 6.57E + 03-
[F.sub.4]               1.88E - 15 [+ or -] 8.53E - 15-
[F.sub.5]               3.86E - 08 [+ or -] 1.41E - 07-
[F.sub.6]               1.73E + 01 [+ or -] 5.14E + 01-
[F.sub.7]               8.17E - 03 [+ or -] 8.57E - 03-
[F.sub.8]               2.08E + 01 [+ or -] 2.43E - 01
                           [approximately equal to]
[F.sub.9]              0.00E + 00 [+ or -] 0.00E + 00 +
[F.sub.10]              2.37E + 01 [+ or -] 3.91E + 00-
[F.sub.11]              2.55E + 01 [+ or -] 1.62E + 00-
[F.sub.12]              5.88E + 03 [+ or -] 3.63E + 03-
[F.sub.13]             1.45E + 00 [+ or -] 1.16E - 01 +
[F.sub.14]              1.23E + 01 [+ or -] 3.21E - 01~

[F.sub.15]             3.26E + 02 [+ or -] 1.27E + 02 +

[F.sub.16]              9.14E + 01 [+ or -] 9.89E + 01-
[F.sub.17]              1.44E + 02 [+ or -] 1.34E + 02-
[F.sub.18]              9.04E + 02 [+ or -] 7.97E - 01
                           [approximately equal to]
[F.sub.19]              9.04E + 02 [+ or -] 1.02E + 00
                           [approximately equal to]
[F.sub.20]              9.04E + 02 [+ or -] 9.61E - 01
                           [approximately equal to]
[F.sub.21]              5.00E + 02 [+ or -] 7.33E - 14
                           [approximately equal to]
[F.sub.22]              8.63E + 02 [+ or -] 2.06E + 01
                           [approximately equal to]
[F.sub.23]              5.66E + 02 [+ or -] 1.12E + 02-

[F.sub.24]              2.00E + 02 [+ or -] 2.90E - 14
                           [approximately equal to]
[F.sub.25]              2.11E + 02 [+ or -] 8.77E - 01-
-/ + /[approximately                13/3/9
equal to]

Function                              jDE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                           [approximately equal to]
[F.sub.2]               1.06E - 06 [+ or -] 1.92E - 06-
[F.sub.3]               1.67E + 05 [+ or -] 1.06E + 05-
[F.sub.4]               2.06E - 02 [+ or -] 3.14E - 02-
[F.sub.5]                  3.27E + 03 + 2.94E + 02-
[F.sub.6]               1.96E + 01 [+ or -] 2.22E + 01-
[F.sub.7]               1.18E - 02 [+ or -] 9.30E - 03-
[F.sub.8]               2.09E + 01 [+ or -] 3.91E - 02
                           [approximately equal to]
[F.sub.9]              0.00E + 00 [+ or -] 0.00E + 00 +
[F.sub.10]                 5.45E + 01 + 9.77E + 00-
[F.sub.11]                 2.82E + 01 + 1.71E + 00-
[F.sub.12]                 1.17E + 04 + 9.44E + 03-
[F.sub.13]                1.71E + 00 + 1.37E - 01 +
[F.sub.14]              1.29E + 01 [+ or -] 2.88E - 01-

[F.sub.15]             3.56E + 02 [+ or -] 6.46E + 01 +

[F.sub.16]                 8.04E + 01 + 2.51E + 01-
[F.sub.17]                 1.40E + 02 + 3.24E + 01-
[F.sub.18]              9.04E + 02 [+ or -] 9.87E - 01
                           [approximately equal to]
[F.sub.19]              9.04E + 02 [+ or -] 9.35E - 01
                           [approximately equal to]
[F.sub.20]              9.04E + 02 [+ or -] 1.04E + 00
                           [approximately equal to]
[F.sub.21]                  5.00E + 02 + 8.83E - 14
                           [approximately equal to]
[F.sub.22]              8.81E + 02 [+ or -] 1.46E + 01
                           [approximately equal to]
[F.sub.23]              5.34E + 02 [+ or -] 2.14E - 04
                           [approximately equal to]
[F.sub.24]                 2.00E + 02 + 2.90E - 14-

[F.sub.25]                 2.11E + 02 + 7.33E + 02-
-/ + /[approximately                13/3/9
equal to]

Function                             SaDE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                           [approximately equal to]
[F.sub.2]              1.21E - 05 [+ or -] 1.39E - 05-
[F.sub.3]                  3.71E + 05 + 1.79E + 05-
[F.sub.4]              1.14E + 01 [+ or -] 1.39E + 01-
[F.sub.5]                  2.19E + 03 + 7.10E + 02-
[F.sub.6]                  5.61E + 01 + 2.78E + 01-
[F.sub.7]                  1.19E - 02 + 5.83E - 03-
[F.sub.8]               2.09E + 01 [+ or -] 5.11E - 02
                           [approximately equal to]
[F.sub.9]                 0.00E + 00 + 0.00E + 00 +
[F.sub.10]             3.86E + 01 [+ or -] 8.61E + 01-
[F.sub.11]                 1.97E + 01 + 7.77E + 00-
[F.sub.12]                 5.15E + 03 + 4.33E + 03-
[F.sub.13]             4.55E + 00 [+ or -] 3.10E - 01-
[F.sub.14]                 1.28E + 01 + 2.24E - 01-

[F.sub.15]                3.84E + 02 + 7.48E + 01 +

[F.sub.16]             5.99E + 01 [+ or -] 2.16E + 01-
[F.sub.17]                 8.38E + 01 + 7.68E + 01-
[F.sub.18]                8.69E + 02 + 5.78E + 01 +

[F.sub.19]                8.51E + 02 + 5.76E + 01 +

[F.sub.20]                8.51E + 02 + 5.77E + 02 +

[F.sub.21]              5.00E + 02 [+ or -] 9.84E - 14
                           [approximately equal to]
[F.sub.22]             9.16E + 02 [+ or -] 1.54E + 01-

[F.sub.23]              5.34E + 02 [+ or -] 2.74E - 03
                           [approximately equal to]
[F.sub.24]              2.00E + 02 [+ or -] 2.90E - 14
                           [approximately equal to]
[F.sub.25]                 2.11E + 02 + 1.23E + 00-
-/ + /[approximately                15/5/5
equal to]

Function                            EPSDE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                           [approximately equal to]
[F.sub.2]                  4.25E - 10 + 2.12E - 09-
[F.sub.3]                  1.37E + 06 + 4.97E + 06-
[F.sub.4]                  2.30E + 05 + 6.26E - 05-
[F.sub.5]                  9.15E + 02 + 5.45E + 02-
[F.sub.6]              3.18E - 01 [+ or -] 1.10E + 00-
[F.sub.7]              1.22E - 02 [+ or -] 1.34E - 02-
[F.sub.8]               2.09E + 01 [+ or -] 6.24E - 02
                           [approximately equal to]
[F.sub.9]                 0.00E + 00 + 0.00E + 00 +
[F.sub.10]                 6.14E + 01 + 9.02E + 00-
[F.sub.11]                 3.57E + 01 + 2.87E + 00-
[F.sub.12]                 5.75E + 04 + 1.05E + 04-
[F.sub.13]             2.52E + 00 [+ or -] 1.77E - 01-
[F.sub.14]             1.34E + 01 [+ or -] 1.98E - 01-

[F.sub.15]                2.36E + 02 + 4.25E + 01 +

[F.sub.16]             1.18E + 02 [+ or -] 8.78E + 01-
[F.sub.17]                 1.74E + 02 + 7.24E + 01-
[F.sub.18]             8.16E + 02 [+ or -] 5.16E - 01 +

[F.sub.19]             8.16E + 02 [+ or -] 5.59E - 01 +

[F.sub.20]             8.16E + 02 [+ or -] 4.03E - 01 +

[F.sub.21]             8.58E + 02 [+ or -] 1.37E + 02-

[F.sub.22]                5.04E + 02 + 3.63E + 00 +

[F.sub.23]                 8.66E + 02 + 1.45E + 00-

[F.sub.24]             2.11E + 02 [+ or -] 1.16E + 00-

[F.sub.25]                 2.11E + 02 + 2.52E + 00-
-/ + /[approximately                18/6/1
equal to]

Function                             CoDE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                           [approximately equal to]
[F.sub.2]                  2.39E - 15 + 5.11E - 15-
[F.sub.3]                  1.27E + 05 + 7.91E + 04-
[F.sub.4]               5.24E - 03 [+ or -] 1.12E - 02-
[F.sub.5]                  5.52E + 02 + 4.20E + 02-
[F.sub.6]               3.18E - 01 [+ or -] 1.10E + 00-
[F.sub.7]                  6.99E - 03 + 7.47E - 03-
[F.sub.8]                 2.02E + 01 + 1.41E - 01 +

[F.sub.9]                 0.00E + 00 + 0.00E + 00 +
[F.sub.10]              4.23E + 01 [+ or -] 1.12E + 01-
[F.sub.11]             1.31E + 01 [+ or -] 3.10E + 00 +
[F.sub.12]              2.81E + 03 [+ or -] 3.19E + 03-
[F.sub.13]             1.61E + 00 [+ or -] 4.13E - 01 +
[F.sub.14]              1.23E + 01 [+ or -] 5.90E - 01
                           [approximately equal to]
[F.sub.15]              4.00E + 02 [+ or -] 5.00E + 01
                           [approximately equal to]
[F.sub.16]                6.89E + 01 + 2.23E + 01 +
[F.sub.17]                 7.24E + 01 + 2.54E + 01-
[F.sub.18]              9.04E + 02 [+ or -] 1.31E + 00
                           [approximately equal to]
[F.sub.19]              9.04E + 02 [+ or -] 8.03E - 01
                           [approximately equal to]
[F.sub.20]              9.04E + 02 [+ or -] 7.11E - 01
                           [approximately equal to]
[F.sub.21]              5.00E + 02 [+ or -] 9.84E - 14
                           [approximately equal to]
[F.sub.22]              8.62E + 02 [+ or -] 2.22E + 01
                           [approximately equal to]
[F.sub.23]              5.34E + 02 [+ or -] 4.13E - 04
                           [approximately equal to]
[F.sub.24]              2.00E + 02 [+ or -] 2.90E - 14
                           [approximately equal to]
[F.sub.25]                 2.10E + 02 + 7.22E - 01-
-/ + /[approximately                10/5/10
equal to]

Function                            CoBiDE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                           [approximately equal to]
[F.sub.2]                  1.52E - 12 + 3.08E - 12-
[F.sub.3]              8.86E + 04 [+ or -] 6.74E + 04-
[F.sub.4]              1.35E - 03 [+ or -] 2.34E - 03-
[F.sub.5]                  1.04E + 02 + 8.07E + 01-
[F.sub.6]                 3.73E - 02 + 4.66E - 02 +
[F.sub.7]                  3.25E - 03 + 5.49E - 03-
[F.sub.8]                 2.07E + 01 + 3.84E - 01 +

[F.sub.9]                 0.00E + 00 + 0.00E + 00 +
[F.sub.10]                 4.28E + 01 + 1.44E + 01-
[F.sub.11]                6.05E + 00 + 2.24E + 00 +
[F.sub.12]                 3.86E + 03 + 5.02E + 03-
[F.sub.13]                 2.69E + 00 + 99.2E - 01-
[F.sub.14]              1.22E + 01 [+ or -] 5.23E - 01
                           [approximately equal to]
[F.sub.15]                 4.12E + 02 + 6.00E + 01-

[F.sub.16]             6.50E + 01 [+ or -] 1.26E + 01-
[F.sub.17]             8.03E + 01 [+ or -] 7.42E + 01-
[F.sub.18]              9.04E + 02 [+ or -] 7.16E - 01
                           [approximately equal to]
[F.sub.19]              9.04E + 02 [+ or -] 8.61E - 01
                           [approximately equal to]
[F.sub.20]              9.04E + 02 [+ or -] 7.38E - 01
                           [approximately equal to]
[F.sub.21]                 5.00E + 02 + 7.46E - 14
                           [approximately equal to]
[F.sub.22]              8.69E + 02 [+ or -] 3.42E + 01
                           [approximately equal to]
[F.sub.23]              5.34E + 02 [+ or -] 2.43E - 04
                           [approximately equal to]
[F.sub.24]             2.00E + 02 [+ or -] 2.90E - 14-
                           [approximately equal to]
[F.sub.25]                 2.10E + 02 + 8.03E - 01-
-/ + /[approximately                13/4/8
equal to]

Function                            LSHADE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                           [approximately equal to]
[F.sub.2]              3.08E - 29 [+ or -] 6.89E - 29 +
[F.sub.3]                  7.70E + 03 + 6.16E + 03-
[F.sub.4]                  5.05E - 15 + 2.44E - 14-
[F.sub.5]                  7.09E - 10 + 3.21E - 09-
[F.sub.6]              1.59E - 01 [+ or -] 7.97E - 01 +
[F.sub.7]               7.88E - 03 [+ or -] 2.82E - 03-
[F.sub.8]                 2.04E + 01 + 3.47E - 01 +

[F.sub.9]                 0.00E + 00 + 0.00E + 00 +
[F.sub.10]                1.53E + 01 + 2.74E + 00 +
[F.sub.11]              2.68E + 01 [+ or -] 1.69E + 00-
[F.sub.12]                 2.44E + 03 + 2.44E + 03-
[F.sub.13]             1.17E + 00 [+ or -] 1.11E - 01 +
[F.sub.14]              1.23E + 01 [+ or -] 4.08E - 01
                           [approximately equal to]
[F.sub.15]             3.56E + 02 [+ or -] 7.11E + 01 +

[F.sub.16]                 9.07E + 01 + 1.32E + 02-
[F.sub.17]                 1.08E + 02 + 1.11E + 02-
[F.sub.18]              9.03E + 02 [+ or -] 6.22E - 01
                           [approximately equal to]
[F.sub.19]              9.03E + 02 [+ or -] 7.09E - 01
                           [approximately equal to]
[F.sub.20]              9.03E + 02 [+ or -] 7.21E - 01
                           [approximately equal to]
[F.sub.21]              5.00E + 02 [+ or -] 1.25E - 13
                           [approximately equal to]
[F.sub.22]                 8.75E + 02 + 1.69E + 01-

[F.sub.23]              5.34E + 02 [+ or -] 2.28E - 13
                           [approximately equal to]
[F.sub.24]                 2.29E + 02 + 1.48E + 02-

[F.sub.25]              2.11E + 02 [+ or -] 7.91E - 01-
-/ + /[approximately                11/7/7
equal to]

Function                            MCDE

[F.sub.1]                 0.00E + 00 + 0.00E + 00

[F.sub.2]                 8.52E - 28 + 3.79E - 28
[F.sub.3]                 3.82E - 12 + 1.64E - 11
[F.sub.4]                 7.12E - 22 + 3.13E - 21
[F.sub.5]                 4.54E - 10 + 6.03E - 10
[F.sub.6]              3.18E - 01 [+ or -] 1.10E + 00
[F.sub.7]                 1.67E - 03 + 4.06E - 03
[F.sub.8]                 2.09E + 01 + 4.25E - 02

[F.sub.9]                 2.56E - 07 + 5.94E - 07
[F.sub.10]                2.23E + 01 + 6.39E + 00
[F.sub.11]             1.45E + 01 [+ or -] 7.73E + 00
[F.sub.12]             1.71E + 03 [+ or -] 2.33E + 03
[F.sub.13]             1.78E + 00 [+ or -] 2.04E - 01
[F.sub.14]             1.23E + 01 [+ or -] 2.53E - 01

[F.sub.15]             4.00E + 02 [+ or -] 1.15E + 02

[F.sub.16]                5.48E + 01 + 2.92E + 01
[F.sub.17]             6.41E + 01 [+ or -] 7.58E + 01
[F.sub.18]                9.03E + 02 + 5.59E - 01

[F.sub.19]                9.03E + 02 + 2.01E - 01

[F.sub.20]                9.03E + 02 + 2.40E - 01

[F.sub.21]             5.00E + 02 [+ or -] 6.76E - 14

[F.sub.22]             8.69E + 02 [+ or -] 1.92E + 01

[F.sub.23]                5.34E + 02 + 3.40E - 13

[F.sub.24]                2.00E + 02 + 2.90E - 14

[F.sub.25]             2.09E + 02 [+ or -] 2.84E - 01
-/ + /[approximately
equal to]

Table 2: Wilcoxon's detection (D = 30).

Algorithm        [R.sup.+]   [R.sup.-]   p value    [alpha] =
                                                      0.05

MCDE vs JADE       249.0       76.0      0.017653      Yes
MCDE vs jDE        262.0       38.0      0.001111      Yes
MCDE vs SaDE       224.0       76.0      0.032663      Yes
MCDE vs EPSDE      219.5       80.5      0.027602      Yes
MCDE vs CoDE       225.5       74.5      0.027602      Yes
MCDE vs CoBiDE     243.0       57.0      0.006725      Yes
MCDE vs LSHADE     196.5       103.5     0.19244       No

Algorithm        [alpha] =
                    0.1

MCDE vs JADE        Yes
MCDE vs jDE         Yes
MCDE vs SaDE        Yes
MCDE vs EPSDE       Yes
MCDE vs CoDE        Yes
MCDE vs CoBiDE      Yes
MCDE vs LSHADE      No

Table 3: Friedman's average ranking (D = 30).

Algorithm   Ranking   Final rank

JADE         4.48         5
jDE          5.76         7
SaDE         5.08         6
EPSDE        5.68         8
CoDE         3.92         3
CoBiDE       4.22         4
LSHADE       3.62         2
MCDE         3.24         1

Table 4: Comparison results of MCDE with JADE, jDE,
SaDE, EPSDE, CoDE, and CoBiDE (D = 50).

Function                             JADE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                            [approximately equal to]
[F.sub.2]              3.57E - 27 [+ or -] 1.67E - 27 +
[F.sub.3]              1.41E + 05 [+ or -] 6.61E + 03 -
[F.sub.4]              2.79E + 00 [+ or -] 1.26E + 01 -
[F.sub.5]                 1.45E + 03 + 4.38E + 02 -
[F.sub.6]              7.71E + 00 [+ or -] 3.03E + 01 -
[F.sub.7]              7.57E - 03 [+ or -] 1.09E - 02 -
[F.sub.8]               2.11E + 01 [+ or -] 5.93E - 02
                            [approximately equal to]
[F.sub.9]              0.00E + 00 [+ or -] 0.00E + 00 +
[F.sub.10]             6.55E + 01 [+ or -] 6.93E + 00 -
[F.sub.11]             5.24E + 01 [+ or -] 2.15E + 00 -
[F.sub.12]             1.54E + 04 [+ or -] 1.27E + 04 -
[F.sub.13]             2.78E + 00 [+ or -] 1.99E - 01 -
[F.sub.14]             2.16E + 01 [+ or -] 4.76E - 01 -
[F.sub.15]             3.77E + 02 [+ or -] 9.03E + 01 -
[F.sub.16]             8.42E + 01 [+ or -] 7.92E + 01 -
[F.sub.17]             9.39E + 01 [+ or -] 2.64E + 01 -
[F.sub.18]             9.21E + 02 [+ or -] 4.38E + 00 -

[F.sub.19]             9.19E + 02 [+ or -] 1.07E + 01 -

[F.sub.20]             9.21E + 02 [+ or -] 3.38E + 00 -

[F.sub.21]             5.52E + 02 [+ or -] 1.49E + 02 +
[F.sub.22]             9.05E + 02 [+ or -] 2.48E + 01 -

[F.sub.23]             5.82E + 02 [+ or -] 1.31E + 02 +

[F.sub.24]              2.00E + 02 [+ or -] 1.49E - 12
                            [approximately equal to]
[F.sub.25]             2.18E + 02 [+ or -] 1.71E + 00 -
-/ + /[approximately                18/4/3
equal to]

Function                              jDE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                            [approximately equal to]
[F.sub.2]              2.22E - 02 [+ or -] 3.21E - 02 -
[F.sub.3]                 4.48E + 05 + 2.21E + 05 -
[F.sub.4]                 3.88E + 02 + 3.13E + 02 -
[F.sub.5]                 3.65E + 03 + 6.29E + 02 -
[F.sub.6]                 4.43E + 02 + 2.78E + 01 -
[F.sub.7]              2.85E - 03 [+ or -] 6.10E - 03 +
[F.sub.8]               2.11E + 01 [+ or -] 3.72E - 02
                            [approximately equal to]
[F.sub.9]                 0.00E + 00 + 0.00E + 00 +
[F.sub.10]             9.98E + 01 [+ or -] 1.32E + 01 -
[F.sub.11]                5.42E + 01 + 2.10E + 00 -
[F.sub.12]                1.57E + 04 + 1.54E + 04 -
[F.sub.13]                2.94E + 00 + 2.41E - 01 -
[F.sub.14]             2.25E + 01 [+ or -] 2.26E - 01 -
[F.sub.15]                3.62E + 02 + 1.21E + 02 +
[F.sub.16]             8.35E + 01 [+ or -] 1.03E + 01 -
[F.sub.17]             1.81E + 02 [+ or -] 2.31E + 01 -
[F.sub.18]                9.20E + 02 + 3.35E + 00 -

[F.sub.19]                9.20E + 02 + 2.88E + 00 -

[F.sub.20]                9.20E + 02 + 3.14E + 00 -

[F.sub.21]                7.21E + 02 + 2.55E + 02 -
[F.sub.22]                9.05E + 02 + 1.23E + 00 -

[F.sub.23]                8.60E + 02 + 2.25E + 02 -

[F.sub.24]              2.00E + 02 [+ or -] 1.62E - 12
                            [approximately equal to]
[F.sub.25]                2.16E + 02 + 1.41E + 00 -
-/ + /[approximately                20/2/3
equal to]

Function                             SaDE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                            [approximately equal to]
[F.sub.2]                 6.55E - 02 + 4.34E - 02 -
[F.sub.3]                 8.01E + 05 + 5.44E + 05 -
[F.sub.4]                 7.28E + 02 + 4.56E + 02 -
[F.sub.5]              8.34E + 03 [+ or -] 1.29E + 03 -
[F.sub.6]                 4.39E + 02 + 2.52E + 01 -
[F.sub.7]                 9.23E - 03 + 5.45E - 02 -
[F.sub.8]               2.11E + 01 [+ or -] 4.33E - 02
                            [approximately equal to]
[F.sub.9]                 9.94E - 01 + 2.21E - 01 -
[F.sub.10]             1.14E + 02 [+ or -] 1.54E + 01 -
[F.sub.11]             4.45E + 01 [+ or -] 1.89E + 00 -
[F.sub.12]                5.65E + 04 + 2.04E + 04 -
[F.sub.13]             7.27E + 00 [+ or -] 7.34E - 01 -
[F.sub.14]             2.23E + 01 [+ or -] 2.42E - 01 -
[F.sub.15]                3.86E + 02 + 7.62E + 01 -
[F.sub.16]                8.78E + 01 + 6.57E + 01 -
[F.sub.17]                9.81E + 01 + 1.01E + 02 -
[F.sub.18]                9.78E + 02 + 8.37E + 01 -

[F.sub.19]                9.78E + 02 + 7.81E + 01 -

[F.sub.20]             9.55E + 02 [+ or -] 3.54E + 01 -

[F.sub.21]                5.66E + 02 + 2.32E + 02 +
[F.sub.22]                9.82E + 02 + 8.21E + 01 -

[F.sub.23]                5.98E + 02 + 7.29E + 00 +

[F.sub.24]             2.89E + 02 [+ or -] 6.55E + 01 -

[F.sub.25]             2.24E + 02 [+ or -] 1.25E + 01 -
-/ + /[approximately                21/2/2
equal to]

Function                             EPSDE

[F.sub.1]              5.25E - 29 [+ or -] 1.28E - 28 -

[F.sub.2]                 5.77E - 23 + 8.87E - 23 +
[F.sub.3]              7.82E + 06 [+ or -] 1.35E + 07 -
[F.sub.4]                 3.42E + 03 + 3.51E + 04 -
[F.sub.5]                 4.66E + 03 + 8.85E + 02 -
[F.sub.6]              1.43E + 02 [+ or -] 1.95E + 00 -
[F.sub.7]              1.08E - 02 [+ or -] 1.79E - 02 -
[F.sub.8]               2.11E + 01 [+ or -] 3.35E - 02
                            [approximately equal to]
[F.sub.9]              6.39E - 16 [+ or -] 1.01E - 15 +
[F.sub.10]                1.54E + 02 + 2.53E + 01 -
[F.sub.11]                7.04E + 01 + 3.21E + 00 -
[F.sub.12]                3.16E + 05 + 3.85E + 04 -
[F.sub.13]             6.17E + 00 [+ or -] 6.03E - 01 -
[F.sub.14]             2.34E + 01 [+ or -] 2.63E - 01 -
[F.sub.15]                2.64E + 02 + 6.45E + 01 +
[F.sub.16]             1.50E + 02 [+ or -] 4.25E + 01 -
[F.sub.17]             2.38E + 02 [+ or -] 7.01E + 01 -
[F.sub.18]                8.53E + 02 + 2.42E + 01 +

[F.sub.19]                8.59E + 02 + 1.54E + 01 +

[F.sub.20]                8.56E + 02 + 3.03E + 00 +

[F.sub.21]                7.29E + 02 + 2.82E + 00 -
[F.sub.22]                5.00E + 02 + 6.61E - 02 +

[F.sub.23]                7.33E + 02 + 4.48E + 00 -

[F.sub.24]                2.38E + 02 + 1.34E + 01 -

[F.sub.25]                2.47E + 02 + 1.87E + 01 -
-/ + /[approximately                17/7/1
equal to]

Function                             CoDE

[F.sub.1]              8.07E - 30 [+ or -] 4.04E - 29 -

[F.sub.2]                 5.87E - 09 + 6.51E - 09 -
[F.sub.3]                 3.22E + 05 + 8.66E + 04 -
[F.sub.4]                 4.98E + 02 + 5.78E + 02 -
[F.sub.5]                 3.60E + 03 + 5.69E + 02 -
[F.sub.6]              1.23E + 02 [+ or -] 2.12E + 00 -
[F.sub.7]              6.54E - 03 [+ or -] 9.36E - 03 -
[F.sub.8]                 2.01E + 01 + 1.09E - 01 +

[F.sub.9]              2.38E + 00 [+ or -] 4.33E - 01 -
[F.sub.10]             8.29E + 01 [+ or -] 1.93E + 01 -
[F.sub.11]             3.14E + 01 [+ or -] 5.35E + 00 -
[F.sub.12]             1.54E + 04 [+ or -] 1.73E + 04 -
[F.sub.13]             3.23E + 00 [+ or -] 4.15E - 01 -
[F.sub.14]             2.19E + 01 [+ or -] 4.39E - 01 -
[F.sub.15]             3.88E + 02 [+ or -] 6.00E + 01 -
[F.sub.16]                9.35E + 01 + 7.01E + 01 -
[F.sub.17]                7.21E + 01 + 2.58E + 01 +
[F.sub.18]                9.21E + 02 + 5.42E + 00 -

[F.sub.19]                9.21E + 02 + 4.64E + 00 -

[F.sub.20]             9.11E + 02 [+ or -] 3.38E + 01 -

[F.sub.21]                6.83E + 02 + 2.49E + 02 -
[F.sub.22]                9.01E + 02 + 2.18E + 01 -

[F.sub.23]                7.10E + 02 + 2.33E + 02 -

[F.sub.24]              2.00E + 02 [+ or -] 5.81E - 14
                            [approximately equal to]
[F.sub.25]             2.17E + 02 [+ or -] 1.97E + 00 -
-/ + /[approximately                22/2/1
equal to]

Function                            CoBiDE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                            [approximately equal to]
[F.sub.2]              1.03E - 06 [+ or -] 1.08E - 06 -
[F.sub.3]                 2.31E + 05 + 7.87E + 04 -
[F.sub.4]                 1.52E + 02 + 9.61E + 01 -
[F.sub.5]                 2.71E + 03 + 6.16E + 02 -
[F.sub.6]              2.36E + 01 [+ or -] 1.88E + 01 -
[F.sub.7]              4.01E - 03 [+ or -] 3.09E - 03 -
[F.sub.8]                 2.08E + 01 + 4.45E - 01 +

[F.sub.9]                 3.21E - 13 + 9.03E - 13 +
[F.sub.10]                9.24E + 01 + 2.04E + 01 -
[F.sub.11]                1.80E + 01 + 4.49E + 00 +
[F.sub.12]             1.35E + 04 [+ or -] 1.22E + 04 -
[F.sub.13]             4.28E + 00 [+ or -] 1.32E + 00 -
[F.sub.14]                2.20E + 01 + 3.87E - 01 -
[F.sub.15]                3.92E + 02 + 4.00E + 01 -
[F.sub.16]                7.64E + 01 + 2.11E + 01 -
[F.sub.17]                7.62E + 01 + 1.73E + 01 +
[F.sub.18]              9.12E + 02 [+ or -] 2.39E + 01
                            [approximately equal to]
[F.sub.19]              9.14E + 02 [+ or -] 2.39E + 01
                            [approximately equal to]
[F.sub.20]              9.18E + 02 [+ or -] 3.40E + 00
                            [approximately equal to]
[F.sub.21]             5.40E + 02 [+ or -] 1.41E + 02 +
[F.sub.22]             8.84E + 02 [+ or -] 2.53E + 01 +

[F.sub.23]              6.91E + 02 [+ or -] 2.25E + 02
                            [approximately equal to]
[F.sub.24]                2.00E + 02 + 1.08E - 12 -

[F.sub.25]                2.15E + 02 + 1.46E + 00 -
-/ + /[approximately                13/6/6
equal to]

Function                            LSHADE

[F.sub.1]               0.00E + 00 [+ or -] 0.00E + 00
                            [approximately equal to]
[F.sub.2]                 6.85E - 27 + 7.92E - 27 +
[F.sub.3]              1.97E + 04 [+ or -] 1.07E + 04 +
[F.sub.4]                 2.24E + 01 + 5.73E + 01 -
[F.sub.5]                 1.12E + 03 + 4.72E + 02 -
[F.sub.6]                 7.37E - 01 + 1.49E + 00 -
[F.sub.7]                 2.16E - 03 + 4.04E - 03 +
[F.sub.8]                 2.07E + 01 + 2.89E - 01 +

[F.sub.9]                 7.11E - 17 + 3.55E - 16 +
[F.sub.10]                4.60E + 01 + 5.30E + 00 -
[F.sub.11]                5.39E + 01 + 3.26E + 00 -
[F.sub.12]             1.21E + 04 [+ or -] 1.04E + 04 -
[F.sub.13]                2.14E + 00 + 1.03E - 01 +
[F.sub.14]             2.18E + 01 [+ or -] 3.12E - 01 -
[F.sub.15]                2.97E + 02 + 9.67E + 01 +
[F.sub.16]                 9.82E + 02 + 1.35 + 02 -
[F.sub.17]             1.18E + 02 [+ or -] 1.08E + 02 -
[F.sub.18]                9.18E + 02 + 4.25E + 00 -

[F.sub.19]                9.18E + 02 + 6.62E + 00 -

[F.sub.20]              9.17E + 02 [+ or -] 7.36E + 00
                            [approximately equal to]
[F.sub.21]                6.82E + 02 + 2.48E + 02 -
[F.sub.22]              8.97E + 02 [+ or -] 1.94E + 01
                            [approximately equal to]
[F.sub.23]                8.04E + 02 + 2.40E + 02 -

[F.sub.24]                2.32E + 02 + 1.57E + 02 -

[F.sub.25]             2.18E + 02 [+ or -] 1.69E + 00 -
-/ + /[approximately                15/7/3
equal to]

Function                            MCDE

[F.sub.1]                 0.00E + 00 + 0.00E + 00

[F.sub.2]                 5.76E - 13 + 1.01E - 12
[F.sub.3]                 4.31E + 04 + 3.02E + 04
[F.sub.4]              8.51E - 01 [+ or -] 8.82E - 01
[F.sub.5]                 2.09E + 02 + 4.11E + 02
[F.sub.6]                 7.21E - 01 + 1.46E + 00
[F.sub.7]                 3.05E - 03 + 6.32E - 03
[F.sub.8]              2.11E + 01 [+ or -] 5.06E - 02

[F.sub.9]                 9.55E - 01 + 2.92E + 00
[F.sub.10]             4.31E + 01 [+ or -] 1.15E + 01
[F.sub.11]                3.03E + 01 + 8.38E + 00
[F.sub.12]             1.16E + 04 [+ or -] 1.01E + 04
[F.sub.13]             2.72E + 00 [+ or -] 4.54E - 01
[F.sub.14]                2.12E + 01 + 3.24E - 01
[F.sub.15]                3.68E + 02 + 6.23E + 01
[F.sub.16]                7.56E + 01 + 1.01E + 02
[F.sub.17]             8.84E + 01 [+ or -] 1.26E + 02
[F.sub.18]                9.14E + 02 + 9.46E + 00

[F.sub.19]                9.15E + 02 + 2.90E + 00

[F.sub.20]                9.16E + 02 + 3.94E + 00

[F.sub.21]                6.21E + 02 + 2.21E + 02
[F.sub.22]             8.97E + 02 [+ or -] 1.65E + 01

[F.sub.23]                6.90E + 02 + 2.25E + 02

[F.sub.24]             2.00E + 02 [+ or -] 1.66E - 12

[F.sub.25]                2.14E + 02 + 7.36E - 01
-/ + /[approximately
equal to]

Table 5: Wilcoxon's detection (D = 50).

Algorithm        [R.sup.+]   [R.sup.-]   p value    [alpha] =
                                                      0.05

MCDE vs JADE       267.5       32.5      0.000716      Yes
MCDE vs jDE        278.0       22.0      0.000229      Yes
MCDE vs SaDE       303.5       21.5      0.00014       Yes
MCDE vs EPSDE      223.0        77       0.035729      Yes
MCDE vs CoDE       269.0       31.0      0.000611      Yes
MCDE vs CoBiDE     214.0       86.0      0.060605      No
MCDE vs LSHADE     250.5       74.5      0.016642      Yes

Algorithm        [alpha] =
                    0.1

MCDE vs JADE        Yes
MCDE vs jDE         Yes
MCDE vs SaDE        Yes
MCDE vs EPSDE       Yes
MCDE vs CoDE        Yes
MCDE vs CoBiDE      Yes
MCDE vs LSHADE      Yes

Table 6: Friedman's average ranking (D = 50).

Algorithm   Ranking   Final rank

JADE         3.98         4
jDE          5.36         6
SaDE         6.46         8
EPSDE        5.64         7
CoDE         4.88         5
CoBiDE       3.54         2
LSHADE       3.56         3
MCDE         2.58         1

Table 7: Comparison results of MCDE with CLPSO, CMA-ES, and
GL-25 (D = 30).

Function                                    CLPSO

                 [F.sub.1]     0.00E + 00 [+ or -] 0.00E + 00
                                  [approximately equal to]
                 [F.sub.2]     8.40E + 02 [+ or -] 1.90E + 02-
Unimodal         [F.sub.3]     1.42E + 07 [+ or -] 4.19E + 06-
function         [F.sub.4]     6.99E + 03 [+ or -] 1.73E + 03-
                 [F.sub.5]     3.86E + 03 [+ or -] 4.35E + 02-

                 [F.sub.6]     4.16E + 00 [+ or -] 3.48E + 00-
                 [F.sub.7]     4.5LE - 01 [+ or -] 8.47E - 02-
                 [F.sub.8]     2.09E + 01 [+ or -] 4.41E - 02-
Basic            [F.sub.9]    0.00E + 00 [+ or -] 0.00E + 00 +
multimodal       [F.sub.10]    1.04E + 02 [+ or -] 1.53E + 01-
function         [F.sub.11]    2.60E + 01 [+ or -] 1.63E + 00-
                 [F.sub.12]    1.79E + 04 [+ or -] 5.24E + 03-

Expanded         [F.sub.13]    2.06E + 00 [+ or -] 2.15E - 01-
multimodal       [F.sub.14]    1.28E + 01 [+ or -] 2.48E - 01-
function
                 [F.sub.15]    5.77E + 01 [+ or -] 2.76E + 01-
                 [F.sub.16]    1.74E + 02 [+ or -] 2.82E + 01-
                 [F.sub.17]    2.46E + 02 [+ or -] 4.81E + 01-
                 [F.sub.18]    9.13E + 02 [+ or -] 1.42E + 00-
                 [F.sub.19]    9.14E + 02 [+ or -] 1.45E + 00-
Hybrid           [F.sub.20]    9.14E + 02 [+ or -] 3.62E + 00-
composition      [F.sub.21]    5.00E + 02 [+ or -] 3.39E - 13
function                          [approximately equal to]
                 [F.sub.22]    9.72E + 02 [+ or -] 1.20E + 01-
                 [F.sub.23]    5.34E + 02 [+ or -] 2.19E - 04
                                  [approximately equal to]
                 [F.sub.24]    2.00E + 02 [+ or -] 1.49E - 12
                                  [approximately equal to]
                 [F.sub.25]   2.00E + 02 [+ or -] 1.96E + 00 +

-/+/                                       19/2/4
[approximately
equal to]

Function                                   CMA-ES

                 [F.sub.1]     1.58E - 25 [+ or -] 3.35E - 26-

                 [F.sub.2]     1.12E - 24 [+ or -] 2.93E - 25-
Unimodal         [F.sub.3]    5.54E - 21 [+ or -] 1.69E - 21 +
function         [F.sub.4]     9.15E + 05 [+ or -] 2.16E + 06-
                 [F.sub.5]    2.77E - 10 [+ or -] 5.04E - 11 +

                 [F.sub.6]     4.78E - 01 [+ or -] 1.32E + 00-
                 [F.sub.7]     1.82E - 03 [+ or -] 4.33E - 03-
                 [F.sub.8]    2.03E + 01 [+ or -] 5.72E - 01 +
Basic            [F.sub.9]     4.45E + 02 [+ or -] 7.12E + 01-
multimodal       [F.sub.10]    4.63E + 01 [+ or -] 1.16E + 01-
function         [F.sub.11]   7.1 IE + 00 [+ or -] 2.14E + 00 +
                 [F.sub.12]    1.26E + 04 [+ or -] 1.74E + 04-

Expanded         [F.sub.13]    3.43E + 00 [+ or -] 7.60E - 01-
multimodal       [F.sub.14]    1.47E + 01 [+ or -] 3.31E - 01-
function
                 [F.sub.15]    5.55E + 02 [+ or -] 3.32E + 02-
                 [F.sub.16]    2.98E + 02 [+ or -] 2.08E + 02-
                 [F.sub.17]    4.43E + 02 [+ or -] 3.34E + 02-
                 [F.sub.18]    9.04E + 02 [+ or -] 3.01E - 01=
                 [F.sub.19]    9.16E + 02 [+ or -] 6.03E + 01-
Hybrid           [F.sub.20]    9.04E + 02 [+ or -] 2.71E - 01=
composition      [F.sub.21]    5.00E + 02 [+ or -] 2.68E - 12=
function
                 [F.sub.22]   8.26E + 02 [+ or -] 1.46E + 01 +
                 [F.sub.23]    5.36E + 02 [+ or -] 5.44E + 00
                                  [approximately equal to]
                 [F.sub.24]    2.12E + 02 [+ or -] 6.00E + 01-

                 [F.sub.25]    2.07E + 02 [+ or -] 6.07E + 00
                                  [approximately equal to]
-/+/                                       15/5/5
[approximately
equal to]

Function                                    GL-25

                 [F.sub.1]        5.60E - 27 + 1.76E - 26 -

                 [F.sub.2]     4.04E + 01 [+ or -] 6.28E + 01-
Unimodal         [F.sub.3]     2.19E + 06 [+ or -] 1.08E + 06-
function         [F.sub.4]     9.07E + 02 [+ or -] 4.25E + 02-
                 [F.sub.5]        2.51E + 03 + 1.96E + 02-

                 [F.sub.6]        2.15E + 01 + 1.17E + 00-
                 [F.sub.7]     2.78E - 02 [+ or -] 3.62E - 02-
                 [F.sub.8]     2.09E + 01 [+ or -] 5.94E - 02-
Basic            [F.sub.9]     2.45E + 01 [+ or -] 7.35E + 00-
multimodal       [F.sub.10]    1.42E + 02 [+ or -] 6.45E + 01-
function         [F.sub.11]    3.27E + 01 [+ or -] 7.79E + 00-
                 [F.sub.12]    6.53E + 04 [+ or -] 4.69E + 04-

Expanded         [F.sub.13]    6.23E + 00 [+ or -] 4.88E + 00-
multimodal       [F.sub.14]   1.31.E + 01 [+ or -] 1.84E - 01-
function
                 [F.sub.15]   3.04E + 02 [+ or -] 1.99E + 01 +
                 [F.sub.16]    1.32E + 02 [+ or -] 7.60E + 01-
                 [F.sub.17]    1.6LE + 02 [+ or -] 6.80E + 01-
                 [F.sub.18]       9.07E + 02 + 1.48E + 00-
                 [F.sub.19]    9.06E + 02 [+ or -] 1.24E + 00-
Hybrid           [F.sub.20]       9.07E + 02 + 1.35E + 00-
composition      [F.sub.21]    5.00E + 02 [+ or -] 4.83E - 13
function                          [approximately equal to]
                 [F.sub.22]    9.28E + 02 [+ or -] 7.04E + 01-
                 [F.sub.23]    5.34E + 02 [+ or -] 4.66E - 04
                                  [approximately equal to]
                 [F.sub.24]    2.00E + 02 [+ or -] 5.52E - 11
                                  [approximately equal to]
                 [F.sub.25]        2.17E + 02 + 1.36E-01-

-/+/                                       21/1/3
[approximately
equal to]

Function                                   MCDE

                 [F.sub.1]    0.00E + 00 [+ or -] 0.00E + 00

                 [F.sub.2]    8.52E - 28 [+ or -] 3.79E - 28
Unimodal         [F.sub.3]     3.82E- 12 [+ or -] 1.64E - 11
function         [F.sub.4]    7.12E - 22 [+ or -] 3.13E - 21
                 [F.sub.5]    4.54E - 10 [+ or -] 6.03E - 10

                 [F.sub.6]    3.18E - 01 [+ or -] 1.10E + 00
                 [F.sub.7]    1.67E - 03 [+ or -] 4.06E - 03
                 [F.sub.8]    2.09E + 01 [+ or -] 4.25E - 02
Basic            [F.sub.9]    2.56E - 07 [+ or -] 5.94E - 07
multimodal       [F.sub.10]   2.23E + 01 [+ or -] 6.39E + 00
function         [F.sub.11]   1.45E + 01 [+ or -] 7.73E + 00
                 [F.sub.12]   1.71E + 03 [+ or -] 2.33E + 03

Expanded         [F.sub.13]   1.78E + 00 [+ or -] 2.04E - 01
multimodal       [F.sub.14]   1.23E + 01 [+ or -] 2.53E - 01
function
                 [F.sub.15]   4.00E + 02 [+ or -] 1.15E + 02
                 [F.sub.16]   5.48E + 01 [+ or -] 2.92E + 01
                 [F.sub.17]   6.41E + 01 [+ or -] 7.58E + 01
                 [F.sub.18]   9.03E + 02 [+ or -] 5.59E - 01
                 [F.sub.19]   9.03E + 02 [+ or -] 2.01E - 01
Hybrid           [F.sub.20]   9.03E + 02 [+ or -] 2.40E - 01
composition      [F.sub.21]   5.00E + 02 [+ or -] 6.76E - 14
function
                 [F.sub.22]   8.69E + 02 [+ or -] 1.92E + 01
                 [F.sub.23]   5.34E + 02 [+ or -] 3.40E - 13

                 [F.sub.24]   2.00E + 02 [+ or -] 2.90E - 14

                 [F.sub.25]   2.09E + 02 [+ or -] 2.84E - 01

-/+/
[approximately
equal to]

Table 8: Wilcoxon's detection with evolution algorithm.

Algorithm        [R.sup.+]   [R.sup.-]   p value    [alpha] =
                                                      0.05
MCDE vs CLPSO      261.0       39.0      0.001388      Yes
MCDE vs CMA-ES     241.0       59.0      0.008699      Yes
MCDE vs GL         301.0       24.0      0.000175      Yes

Algorithm        [alpha] =
                    0.1
MCDE vs CLPSO       Yes
MCDE vs CMA-ES      Yes
MCDE vs GL          Yes

Table 9: Friedman average ranking with
evolution algorithm.

Algorithm   Ranking   Final rank

CLPSO        2.86         3
CMA-ES        2.6         2
GL           2.92         4
MCDE         1.62         1

Table 10: Average CPU time for MCDE, JADE, jDE, SaDE, EPSDE,
CoDE, and CoBiDE (D = 30).

Function     JADE     jDE     SaDE    EPSDE    CoDE   CoBiDE   MCDE

[F.sub.1]    2.20    1.77    38.72    73.93    6.27    3.78    2.54
[F.sub.2]    2.29    2.04    35.61    76.71    6.52    4.18    2.88
[F.sub.3]    2.53    2.19    35.34    72.37    7.45    4.25    2.90
[F.sub.4]    2.34    2.14    31.52    73.96    6.66    4.28    3.01
[F.sub.5]    2.63    2.41    35.49    76.41    7.29    4.19    3.32
[F.sub.6]    2.15    1.87    33.71    79.66    6.34    3.87    2.79
[F.sub.7]    2.34    2.24    30.73    74.79    6.75    4.05    2.70
[F.sub.8]    2.82    2.72    33.82    71.86    8.96    4.74    3.18
[F.sub.9]    2.37    2.05    34.66    73.91    6.95    4.01    2.85
[F.sub.10]   2.65    2.50    32.28    72.04    7.81    4.30    2.94
[F.sub.11]   28.84   28.14   103.99   98.35    32.21  31.09    29.02
[F.sub.12]   10.30   10.44   65.05    81.98    14.53  12.72    10.76
[F.sub.13]   2.47    2.13    31.88    71.55    6.78    4.49    3.02
[F.sub.14]   3.16    2.88    34.24    72.24    8.75    5.09    3.65
[F.sub.15]   76.01   73.49   202.83   150.91   77.95  85.29    75.28
[F.sub.16]   73.83   72.74   202.17   144.18   76.25  82.40    75.63
[F.sub.17]   73.66   72.98   204.50   143.44   78.80  83.14    77.24
[F.sub.18]   82.29   75.51   211.46   150.07   80.43  86.19    79.29
[F.sub.19]   81.26   75.79   211.67   151.88   81.01  86.29    78.97
[F.sub.20]   84.06   75.81   211.70   150.82   80.46  86.50    79.04
[F.sub.21]   81.41   73.25   211.90   154.60   78.09  85.74    77.24
[F.sub.22]   99.15   91.68   256.54   196.01   96.17  103.81   92.63
[F.sub.23]   79.61   73.79   216.39   171.24   80.19  87.85    75.63
[F.sub.24]   56.19   52.84   150.57   145.81   56.74  64.01    54.80
[F.sub.25]   59.55   56.30   154.85   143.67   59.98  67.57    58.39
Average AR   0.93    0.85     6.99    13.41    1.71    1.27

Table 11: Comparison results of MCDE with DE-1
and DE-2 (D = 30).

Function                       DE-1

[F.sub.1]         0.00E + 00 [+ or -] 0.00E + 00
                     [approximately equal to]
[F.sub.2]         6.89E - 28 [+ or -] 8.87E - 28
                     [approximately equal to]
[F.sub.3]         1.98E - 12 [+ or -] 7.27E - 11
                     [approximately equal to]
[F.sub.4]        2.09E - 24 [+ or -] 3.79E - 24+
[F.sub.5]        1.26E - 09 [+ or -] 1.89E - 09-
[F.sub.6]         4.78E - 01 [+ or -] 1.32E + 00
                     [approximately equal to]
[F.sub.7]        9.86E - 04 [+ or -] 2.75E - 03+
[F.sub.8]         2.09E + 01 [+ or -] 6.90E - 02
                     [approximately equal to]
[F.sub.9]        3.43E - 13 [+ or -] 3.53E - 13+
[F.sub.10]       3.02E + 01 [+ or -] 9.89E + 00-
[F.sub.11]       1.74E + 01 [+ or -] 6.49E + 00-
[F.sub.12]       3.89E + 03 [+ or -] 1.08E + 03-
[F.sub.13]       2.01E + 00 [+ or -] 2.49E - 01-
[F.sub.14]        1.21E + 01 [+ or -] 3.12E - 01
                     [approximately equal to]
[F.sub.15]       3.36E + 02 [+ or -] 1.41E + 02+
[F.sub.16]       8.89E + 01 [+ or -] 9.84E + 01-
[F.sub.17]       1.47E + 02 [+ or -] 1.56E + 02-
[F.sub.18]        9.04E + 02 [+ or -] 1.14E + 00
                     [approximately equal to]
[F.sub.19]        9.04E + 02 [+ or -] 8.02E - 01
                     [approximately equal to]
[F.sub.20]        9.04E + 02 [+ or -] 2.20E - 01
                     [approximately equal to]
[F.sub.21]        5.00E + 02 [+ or -] 6.76E - 14
                     [approximately equal to]
[F.sub.22]       8.73E + 02 [+ or -] 2.19E + 01-

[F.sub.23]       5.50E + 02 [+ or -] 8.05E + 01-
[F.sub.24]       8.66E + 02 [+ or -] 2.51E + 02-

[F.sub.25]        2.09E + 02 [+ or -] 5.22E - 01
                     [approximately equal to]
-/+/                         10/4/11
[approximately
equal to]

Function                       DE-2

[F.sub.1]         0.00E + 00 [+ or -] 0.00e + 00
                     [approximately equal to]
[F.sub.2]        2.24E - 14 [+ or -] 2.68E - 13-

[F.sub.3]        1.23E + 05 [+ or -] 8.34E + 04-

[F.sub.4]        1.97E - 04 [+ or -] 3.69E - 04-
[F.sub.5]        1.91E + 01 [+ or -] 6.15E + 01-
[F.sub.6]        1.84E - 10 [+ or -] 4.18E - 10+

[F.sub.7]        5.80E - 03 [+ or -] 1.05E - 02-
[F.sub.8]        2.00E + 01 [+ or -] 1.58E - 02+

[F.sub.9]        0.00E + 00 [+ or -] 0.00e + 00+
[F.sub.10]       5.18E + 01 [+ or -] 1.23E + 01-
[F.sub.11]       9.16E + 00 [+ or -] 3.91E + 00-
[F.sub.12]       4.75E + 03 [+ or -] 6.16E + 03-
[F.sub.13]       1.95E + 00 [+ or -] 5.26E - 01-
[F.sub.14]       1.28E + 01 [+ or -] 3.77E - 01-

[F.sub.15]       3.52E + 02 [+ or -] 1.08E + 02+
[F.sub.16]       1.64E + 02 [+ or -] 1.26E + 02-
[F.sub.17]       1.36E + 02 [+ or -] 1.12E + 02-
[F.sub.18]        9.04E + 02 [+ or -] 7.46 - 01
                     [approximately equal to]
[F.sub.19]        9.04E + 02 [+ or -] 1.11E + 00
                     [approximately equal to]
[F.sub.20]        9.04E + 02 [+ or -] 6.97E - 01
                     [approximately equal to]
[F.sub.21]        5.00E + 02 [+ or -] 7.95E - 14
                     [approximately equal to]
[F.sub.22]        8.68E + 02 [+ or -] 2.16 + 01
                     [approximately equal to]
[F.sub.23]       5.49E + 02 [+ or -] 7.67E + 01-
[F.sub.24]        2.00E + 02 [+ or -] 2.90 - 14
                     [approximately equal to]
[F.sub.25]        2.10E + 02 [+ or -] 8.77E - 01
                     [approximately equal to]
-/+/                          03/4/8
[approximately
equal to]

Function                      MCDE

[F.sub.1]        0.00E + 00 [+ or -] 0.00E + 00

[F.sub.2]        8.52E - 28 [+ or -] 3.79E - 28

[F.sub.3]        3.82E - 12 [+ or -] 1.64E - 11

[F.sub.4]        7.12E - 22 [+ or -] 3.13E - 21
[F.sub.5]        4.54E - 10 [+ or -] 6.03E - 10
[F.sub.6]        3.18E - 01 [+ or -] 1.10E + 00

[F.sub.7]        1.67E - 03 [+ or -] 4.06E - 03
[F.sub.8]        2.09E + 01 [+ or -] 4.25E - 02

[F.sub.9]        2.56E - 07 [+ or -] 5.94E - 07
[F.sub.10]       2.23E + 01 [+ or -] 6.39E + 00
[F.sub.11]       1.45E + 01 [+ or -] 7.73e + 00
[F.sub.12]       1.71E + 03 [+ or -] 2.33E + 03
[F.sub.13]       1.78E + 00 [+ or -] 2.04E - 01
[F.sub.14]       1.23E + 01 [+ or -] 2.53E - 01

[F.sub.15]       4.00E + 02 [+ or -] 1.15E + 02
[F.sub.16]       5.48E + 01 [+ or -] 2.92E + 01
[F.sub.17]       6.41E + 01 [+ or -] 7.58E + 01
[F.sub.18]       9.03E + 02 [+ or -] 5.59E - 01

[F.sub.19]       9.03E + 02 [+ or -] 2.01E - 01

[F.sub.20]       9.03E + 02 [+ or -] 2.40E - 01

[F.sub.21]       5.00E + 02 [+ or -] 6.76E - 14

[F.sub.22]       8.69E + 02 [+ or -] 1.92E + 01

[F.sub.23]        5.34E + 02 [+ or -] 3.40E-13
[F.sub.24]       2.00E + 02 [+ or -] 2.90E - 14

[F.sub.25]       2.09E + 02 [+ or -] 2.84E - 01

-/+/
[approximately
equal to]
COPYRIGHT 2019 Hindawi Limited
No portion of this article can be reproduced without the express written permission from the copyright holder.
Copyright 2019 Gale, Cengage Learning. All rights reserved.

Article Details
Printer friendly Cite/link Email Feedback
Title Annotation:Research Article
Author:Du, Yongzhao; Fan, Yuling; Liu, Xiaofang; Luo, Yanmin; Tang, Jianeng; Liu, Peizhong
Publication:Computational Intelligence and Neuroscience
Geographic Code:9CHIN
Date:Dec 1, 2019
Words:13754
Previous Article:An Interactive Model of Target and Context for Aspect-Level Sentiment Classification.
Next Article:Effective and Generalizable Graph-Based Clustering for Faces in the Wild.
Topics:

Terms of use | Privacy policy | Copyright © 2020 Farlex, Inc. | Feedback | For webmasters