A model of an Ant System where ants are controlled by a spiking neural circuit and a second order pheromone mechanism in a foraging task is presented. A neural circuit is trained for individual ants and subsequently the ants are exposed to a virtual environment where a swarm of ants performed a resource foraging task.
The model comprises an associative and unsupervised learning strategy for the neural circuit of the ant. The neural circuit adapts to the environment by means of classical conditioning. The initially unknown environment includes different types of stimuli representing food (rewarding) and obstacles (harmful) which, when they come in direct contact with the ant, elicit a reflex response in the motor neural system of the ant: moving towards or away from the source of the stimulus. The spiking neural circuits of the ant is trained to identify food and obstacles and move towards the former and avoid the latter.
The ants are released on a landscape with multiple food sources where one ant alone would have difficulty harvesting the landscape to maximum efficiency. In this case the introduction of a double pheromone mechanism (positive and negative reinforcement feedback) yields better results than traditional ant colony optimization strategies.
Traditional ant systems include mainly a positive reinforcement pheromone. This approach uses a second pheromone that acts as a marker for forbidden paths (negative feedback). This blockade is not permanent and is controlled by the evaporation rate of the pheromones. The combined action of both pheromones acts as a collective stigmergic memory of the swarm, which reduces the search space of the problem.
This paper explores how the adaptation and learning abilities observed in biologically inspired cognitive architectures is synergistically enhanced by swarm optimization strategies. The model portraits two forms of artificial intelligent behaviour: at the individual level the spiking neural network is the main controller and at the collective level the pheromone distribution is a map towards the solution emerged by the colony. The presented model is an important pedagogical tool as it is also an easy to use library that allows access to the spiking neural network paradigm from inside a Netlogo—a language used mostly in agent based modelling and experimentation with complex systems.
Intelligence and decision in foraging ants. Individual or Collective? Internal or External? What is the right balance between the two. Can one have internal intelligence without external intelligence? Can one take examples from nature to build in silico artificial lives that present us with interesting patterns? We explore a model of foraging ants in this paper that will be presented in early September in Exeter.
Co-authored with Cristian Jimenez-Romero, Jeffrey Johnson and Vitorino Ramos and available in arXiv 1507.08467 and Researchgate, this will be presented latter this year at UKCI 2015.
 C. G. Langton, “Studying artificial life with cellular automata,”
Physica D: Nonlinear Phenomena, vol. 22, no. 1–3, pp. 120
– 149, 1986, proceedings of the Fifth Annual International
[Online]. Available: http://www.sciencedirect.com/
 A. Abraham and V. Ramos, “Web usage mining using artificial ant
colony clustering and linear genetic programming,” in Proceedings
of the Congress on Evolutionary Computation. Australia: IEEE Press,
2003, pp. 1384–1391.
 V. Ramos, F. Muge, and P. Pina, “Self-organized data and image
retrieval as a consequence of inter-dynamic synergistic relationships
in artificial ant colonies,” Hybrid Intelligent Systems, vol. 87,
 V. Ramos and J. J. Merelo, “Self-organized stigmergic document
maps: Environment as a mechanism for context learning,” in
Proceddings of the AEB, Merida, Spain, February 2002. ´
 D. Sousa-Rodrigues and V. Ramos, “Traversing news with ant
colony optimisation and negative pheromones,” in European Conference
in Complex Systems, Lucca, Italy, Sep 2014.
 E. Bonabeau, G. Theraulaz, and M. Dorigo, Swarm Intelligence:
From Natural to Artificial Systems, 1st ed., ser. Santa Fe Insitute
Studies In The Sciences of Complexity. 198 Madison Avenue,
New York: Oxford University Press, USA, Sep. 1999.
 M. Dorigo and L. M. Gambardella, “Ant colony system: A cooperative
learning approach to the traveling salesman problem,”
Universite Libre de Bruxelles, Tech. Rep. TR/IRIDIA/1996-5, ´
 M. Dorigo, G. Di Caro, and L. M. Gambardella, “Ant algorithms
for discrete optimization,” Artif. Life, vol. 5, no. 2, pp. 137–
172, Apr. 1999. [Online]. Available: http://dx.doi.org/10.1162/
 L. M. Gambardella and M. Dorigo, “Ant-q: A reinforcement learning
approach to the travelling salesman problem,” in Proceedings of
the ML-95, Twelfth Intern. Conf. on Machine Learning, M. Kaufman,
Ed., 1995, pp. 252–260.
 A. Gupta, V. Nagarajan, and R. Ravi, “Approximation algorithms
for optimal decision trees and adaptive tsp problems,” in
Proceedings of the 37th international colloquium conference on
Automata, languages and programming, ser. ICALP’10. Berlin,
Heidelberg: Springer-Verlag, 2010, pp. 690–701. [Online].
 V. Ramos, D. Sousa-Rodrigues, and J. Louçã, “Second order ˜
swarm intelligence,” in HAIS’13. 8th International Conference on
Hybrid Artificial Intelligence Systems, ser. Lecture Notes in Computer
Science, J.-S. Pan, M. Polycarpou, M. Wozniak, A. Carvalho, ´
H. Quintian, and E. Corchado, Eds. Salamanca, Spain: Springer ´
Berlin Heidelberg, Sep 2013, vol. 8073, pp. 411–420.
 W. Maass and C. M. Bishop, Pulsed Neural Networks. Cambridge,
Massachusetts: MIT Press, 1998.
 E. M. Izhikevich and E. M. Izhikevich, “Simple model of
spiking neurons.” IEEE transactions on neural networks / a
publication of the IEEE Neural Networks Council, vol. 14, no. 6,
pp. 1569–72, 2003. [Online]. Available: http://www.ncbi.nlm.nih.
 C. Liu and J. Shapiro, “Implementing classical conditioning
with spiking neurons,” in Artificial Neural Networks ICANN
2007, ser. Lecture Notes in Computer Science, J. de S,
L. Alexandre, W. Duch, and D. Mandic, Eds. Springer Berlin
Heidelberg, 2007, vol. 4668, pp. 400–410. [Online]. Available:
 J. Haenicke, E. Pamir, and M. P. Nawrot, “A spiking
neuronal network model of fast associative learning in the
honeybee,” Frontiers in Computational Neuroscience, no. 149, 2012.
[Online]. Available: http://www.frontiersin.org/computational
 L. I. Helgadottir, J. Haenicke, T. Landgraf, R. Rojas, and M. P.
Nawrot, “Conditioned behavior in a robot controlled by a spiking
neural network,” in International IEEE/EMBS Conference on Neural
Engineering, NER, 2013, pp. 891–894.
 A. Cyr and M. Boukadoum, “Classical conditioning in different
temporal constraints: an STDP learning rule for robots controlled
by spiking neural networks,” pp. 257–272, 2012.
 X. Wang, Z. G. Hou, F. Lv, M. Tan, and Y. Wang, “Mobile robots’
modular navigation controller using spiking neural networks,”
Neurocomputing, vol. 134, pp. 230–238, 2014.
 C. Hausler, M. P. Nawrot, and M. Schmuker, “A spiking neuron
classifier network with a deep architecture inspired by the olfactory
system of the honeybee,” in 2011 5th International IEEE/EMBS
Conference on Neural Engineering, NER 2011, 2011, pp. 198–202.
 U. Wilensky, “Netlogo,” Evanston IL, USA, 1999. [Online].
 C. Jimenez-Romero and J. Johnson, “Accepted abstract: Simulation
of agents and robots controlled by spiking neural networks
using netlogo,” in International Conference on Brain Engineering and
Neuro-computing, Mykonos, Greece, Oct 2015.
 W. Gerstner and W. M. Kistler, Spiking Neuron Models: Single Neurons,
Populations, Plasticity. Cambridge: Cambridge University
 J. v. H. W Gerstner, R Kempter and H. Wagner, “A neuronal
learning rule for sub-millisecond temporal coding,” Nature, vol.
386, pp. 76–78, 1996.
 I. P. Pavlov, “Conditioned reflexes: An investigation of the activity
of the cerebral cortex,” New York, 1927.
 E. J. H. Robinson, D. E. Jackson, M. Holcombe, and F. L. W.
Ratnieks, “Insect communication: ‘no entry’ signal in ant
foraging,” Nature, vol. 438, no. 7067, pp. 442–442, 11 2005.
[Online]. Available: http://dx.doi.org/10.1038/438442a
 E. J. Robinson, D. Jackson, M. Holcombe, and F. L. Ratnieks,
“No entry signal in ant foraging (hymenoptera: Formicidae):
new insights from an agent-based model,” Myrmecological News,
vol. 10, no. 120, 2007.
 D. Sousa-Rodrigues, J. Louçã, and V. Ramos, “From standard ˜
to second-order swarm intelligence phase-space maps,” in 8th
European Conference on Complex Systems, S. Thurner, Ed., Vienna,
Austria, Sep 2011.
 V. Ramos, D. Sousa-Rodrigues, and J. Louçã, “Spatio-temporal ˜
dynamics on co-evolved stigmergy,” in 8th European Conference on
Complex Systems, S. Thurner, Ed., Vienna, Austria, 9 2011.
 S. Tisue and U. Wilensky, “Netlogo: A simple environment for
modeling complexity,” in International conference on complex systems.
Boston, MA, 2004, pp. 16–21.