Fish School Search

From HandWiki

Fish School Search (FSS), proposed by Bastos Filho and Lima Neto in 2008 is, in its basic version,[1] an unimodal optimization algorithm inspired on the collective behavior of fish schools. The mechanisms of feeding and coordinated movement were used as inspiration to create the search operators. The core idea is to make the fishes “swim” toward the positive gradient in order to “eat” and “gain weight”. Collectively, the heavier fishes have more influence on the search process as a whole, what makes the barycenter of the fish school moves toward better places in the search space over the iterations.[2] The FSS uses the following principles:[3]

  1. Simple computations in all individuals (i.e. fish)
  2. Various means of storing information (i.e. weights of fish and school barycenter)
  3. Local computations (i.e. swimming is composed of distinct components)
  4. Low communications between neighboring individuals (i.e. fish are to think local but also be socially aware)
  5. Minimum centralized control (mainly for self-controlling of the school radius)
  6. Some distinct diversity mechanisms (this to avoid undesirable flocking behavior)
  7. Scalability (in terms of complexity of the optimization/search tasks)
  8. Autonomy (i.e. ability to self-control functioning)

Algorithm

FSS is a population based search algorithm inspired in the behavior of swimming fishes that expand and contract while looking for food. Each fish [math]\displaystyle{ n }[/math]-dimensional location represents a possible solution for the optimization problem. The algorithm makes use of weights for all the fishes which represents cumulative account on how successful has been the search for each fish in the school. FSS is composed of the feeding and movement operators, the latter being divided into three sub-components, which are:[4]

Individual component of the movement

Every fish in the school performs a local search looking for promising regions in the search space. It is done as represented below:

[math]\displaystyle{ x_{i}(t + 1) = x_{i}(t)+rand(-1,1)step_{ind}, }[/math]

where [math]\displaystyle{ x_{i}(t) }[/math] and [math]\displaystyle{ x_{i}(t + 1) }[/math] represent the position of the fish [math]\displaystyle{ i }[/math] before and after the individual movement operator, respectively. [math]\displaystyle{ rand(-1, 1) }[/math] is a uniformly distributed random number varying from -1 up to 1 and [math]\displaystyle{ step_{ind} }[/math] is a parameter that defines the maximum displacement for this movement. The new position [math]\displaystyle{ x_{i}(t + 1) }[/math] is only accepted if the fitness of the fish improves with the position change. If it is not the case, the fish remains in the same position and [math]\displaystyle{ x_{i}(t + 1) = x_{i}(t) }[/math].

Collective-instinctive component of the movement

An average of the individual movements is calculated based on the following:

[math]\displaystyle{ I=\frac{\sum^{N}_{i=1} \Delta x_{i} \Delta f_{i}}{\sum^{N}_{i=1} \Delta f_{i}}. }[/math]

The vector [math]\displaystyle{ I }[/math] represents the weighted average of the displacements of each fish. It means that the fishes that experienced a higher improvement will attract fishes into its position. After the vector [math]\displaystyle{ I }[/math] computation, every fish will be encouraged to move according to:

[math]\displaystyle{ x_i(t+1)=x_{i}(t)+I. }[/math]

Collective-volitive component of the movement

This operator is used in order to regulate the exploration/exploitation ability of the school during the search process. First of all, the barycenter [math]\displaystyle{ B }[/math] of the school is calculated based on the position [math]\displaystyle{ x_{i} }[/math] and the weight [math]\displaystyle{ W_{i} }[/math] of each fish:

[math]\displaystyle{ B(t)=\frac{\sum^{N}_{i=1} x_{i}(t) W_{i}(t)}{\sum^{N}_{i=1} W_{i}(t)}, }[/math]

and then, if the total school weight [math]\displaystyle{ \sum^{N}_{i=1} W_{i} }[/math] has increased from the last to the current iteration, the fishes are attracted to the barycenter according to equation A. If the total school weight has not improved, the fishes are spread away from the barycenter according to equation B:

Eq. A:

[math]\displaystyle{ x_i(t+1)=x_{i}(t)- step_{vol} rand(0,1)\frac{x_{i}(t) - B(t)}{distance(x_{i}(t),B(t))}, }[/math]

Eq. B:

[math]\displaystyle{ x_i(t+1)=x_{i}(t)+step_{vol} rand(0,1)\frac{x_{i}(t) - B(t)}{distance(x_{i}(t),B(t))}, }[/math]

where [math]\displaystyle{ step_{vol} }[/math] defines the size of the maximum displacement performed with the use of this operator. [math]\displaystyle{ distance(x_{i}(t),B(t)) }[/math] is the euclidean distance between the fish [math]\displaystyle{ i }[/math] position and the school barycenter. [math]\displaystyle{ rand(0, 1) }[/math] is a uniformly distributed random number varying from 0 up to 1.

Besides the movement operators, it was also defined a feeding operator used in order to update the weights of every fish according to:

[math]\displaystyle{ W_{i}(t+1)=W_{i}(t)+\frac{\Delta f_i}{max(| \Delta f_i |)}, }[/math]

where [math]\displaystyle{ W_{i}(t) }[/math] is the weight parameter for fish [math]\displaystyle{ i }[/math], [math]\displaystyle{ \Delta f_i }[/math] is the fitness variation between the last and the new position, and [math]\displaystyle{ max(| \Delta f_i |) }[/math] represents the maximum absolute value of the fitness variation among all the fishes in the school. [math]\displaystyle{ W }[/math] is only allowed to vary from 1 up to [math]\displaystyle{ W_{scale}/2 }[/math], which is a user defined attribute. The weights of all fishes are initialized with the value [math]\displaystyle{ W_{scale}/2 }[/math].

The pseudo-code for FSS

  1. Initialize user parameters
  2. Initialize fishes positions randomly
  3. while Stopping condition is not met do
  4. Calculate fitness for each fish
  5. Run individual operator movement
  6. Calculate fitness for each fish
  7. Run feeding operator
  8. Run collective-instinctive movement operator
  9. Run collective-volitive movement operator
  10. end while

The parameters [math]\displaystyle{ step_{ind} }[/math] and [math]\displaystyle{ step_{vol} }[/math] decay linearly according to:

[math]\displaystyle{ step_{ind}(t+1)=step_{ind}(t)-\frac{step_{ind}(initial)}{It_{max}}, }[/math]

and similarly:

[math]\displaystyle{ step_{vol}(t+1)=step_{vol}(t)-\frac{step_{vol}(initial)}{It_{max}}, }[/math]

where [math]\displaystyle{ step_{ind}(initial) }[/math] and [math]\displaystyle{ step_{vol}(initial) }[/math] are user defined initial values for [math]\displaystyle{ step_{ind} }[/math] and [math]\displaystyle{ step_{vol} }[/math], respectively. [math]\displaystyle{ It_{max} }[/math] is the maximum number of iterations allowed in the search process.

Variations of FSS

dFSS (Density-based Fish School Search)

This version excels for multimodal hyper-dimensional functions. It includes modifications in the previous operators: Feeding and Swimming, as well as new: Memory and Partition operators. The latter two were introduced to account for the partition of the main school into subgroups. Some changes were also included in the stop conditions that now also have to consider subswarms.[5]

wFSS (Weight-based Fish School Search)

wFSS is a weight based niching version of FSS intended to produce multiple solutions. The niching strategy is based on a new operator called link formator. This operator is used to define leaders for the fishes in order to form sub-schools.[6]

FSS-SAR (Stagnation Avoidance Routine Fish School Search)

In the original version of the algorithm, the individual movement component is only allowed to move a fish if it improves the fitness. However, in a very smooth search space, there would be many moving trials with no success and the algorithm could fail to converge. To solve these issues, was introduced a parameter X for which 0 <= X <= 1 in the individual component of the movement. X decays exponentially along with the iterations and measures a probability for a worsening allowance for each fish. It means that, every time a fish tries to move to a position that does not improve its fitness, a random number is chosen and if it is smaller than X the movement is allowed.[7]

bFSS (Binary Fish School Search)

The bFSS intended to cope with premature convergence. Proposing the use of a binary encoding scheme for the internal mechanisms of the fish school search. It combined the FSS with fuzzy modeling in a wrapper approach for Feature Selection.[8]

MOFSS (Multi-Objective Fish School Search)

In the MOFSS the operators are adapted to solve multi-objective problems. The algorithm deploys an External Archive to store the best non-dominated solutions found during the search process. This approach has been extensively used for different bio-inspired multiobjective optimizers.[9][10] Furthermore, the solutions within the External Archive are used to guide the fish movements in the proposal version.[11]

See also

External links

References

  1. C. J. A. B Filho., F. B. de Lima Neto, A. J. C. C.. Lins, A. I. S. Nascimento., and M. P. Lima, "A novel search algorithm based on fish school behavior," Systems, Man and Cybernetics, SMC 2008. IEEE International Conference on, 2008, pp. 2646-2651.
  2. de Lima Neto, Fernando Buarque, and Marcelo Gomes Pereira de Lacerda. "Multimodal Fish School Search Algorithms Based on Local Information for School Splitting." 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence. IEEE, 2013
  3. "FBLN – Prof. Dr. Fernando Buarque de Lima Neto, B.Sc. M.Sc. DIC-Ph.D.(Imperial College/UK) Hab(BR) SM-IEEE(USA) Alexander von Humboldt-Fellow(DE) Academy of Science-Fellow(PE/BR)". http://www.fbln.pro.br/fss/. 
  4. J. B. Monteiro, I. M. C. Albuquerque, F. B. L. Neto, and F. V. S. Ferreira, “Optimizing multi-plateau functions with FSS-SAR (Stagnation Avoidance Routine),” Submitted to IEEE Symposium Series on Computational Intelligence, 2016.
  5. Madeiro, S. S., de Lima-Neto, F. B., Bastos-Filho, C. J. A., & do Nascimento Figueiredo, E. M. (2011, June). Density as the segregation mechanism in fish school search for multimodal optimization problems. In International Conference in Swarm Intelligence (pp. 563-572). Springer Berlin Heidelberg.
  6. F. Buarque De Lima Neto and M. Gomes Pereira de Lacerda, “Weight based fish school search,” in Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on. IEEE, 2014, pp. 270–277.
  7. J. B. Monteiro, I. M. C. Albuquerque, F. B. L. Neto, and F. V. S. Ferreira, “Optimizing multi-plateau functions with FSS-SAR (Stagnation Avoidance Routine),” Submitted to IEEE Symposium Series on Computational Intelligence, 2016.
  8. Sargo, João AG, et al. "Binary Fish School Search applied to feature selection: Application to ICU readmissions." 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). IEEE, 2014.
  9. Deb, K., Thiele, L., Laumanns, M., & Zitzler, E.(2002) Scalable Multi-Objective Optimization Test Problems, In: IEEE Congress on Evolutionary Computation (pp. 825–830).
  10. Nebro, A. J., Durillo, J. J., Garça-Nieto, J., Coello Coello, C. A., Luna, F., & Alba, E. (2009) SMPSO: A new PSO-based metaheuristic for multi-objective optimization[|permanent dead link|dead link}}], In: IEEE Symposium on Computational Intelligence in Multicriteria Decision-Making (pp. 66–73). doi:10.1109/MCDM.2009.4938830
  11. Bastos-Filho, Carmelo JA, and Augusto CS Guimarães. "Multi-Objective Fish School Search." International Journal of Swarm Intelligence Research (IJSIR) 6.1 (2015): 23-40.