Abstract
Recent approaches to improving the scalability of Spiking Neural Networks (SNNs) have looked to use custom architectures to implement and interconnect the neurons in the hardware. The Networks-on-Chip (NoC) interconnection strategy has been used for the hardware SNNs and has achieved a good performance. However, the map** between a SNN and the NoC system becomes one of the most urgent challenges. In this paper, an energy-aware hybrid Particle Swarm Optimization (PSO) algorithm for SNN map** is proposed, which combines the basic PSO and Genetic Algorithm (GA). A Star-Subnet-Based-2D Mesh (2D-SSBM) NoC system is used for the testing. Results show that the proposed hybrid PSO algorithm can avoid the premature convergence to local optimum, and effectively reduce the energy consumption of the hardware NoC systems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Liu, J., Harkin, J., Maguire, L.P., McDaid, L.J., Wade, J.J., Martin, G.: Scalable networks-on-chip interconnected architecture for astrocyte-neuron networks. IEEE Trans. Circuits Syst. I Regul. Pap. 63(12), 2290–2303 (2016)
Liu, J., Harkin, J., Maguire, L.P., Mcdaid, L.J., Wade, J.J.: SPANNER: A self-repairing spiking neural network hardware architecture. IEEE Trans. Neural Netw. Learn. Syst. 1–14 (2017, inpress)
Akopyan, F., Sawada, J., Cassidy, A., Alvarez-Icaza, R., Arthur, J., Merolla, P., Imam, N., Nakamura, Y., Datta, P., Nam, G.J., Taba, B., Beakes, M., Brezzo, B., Kuang, J.B., Manohar, R., Risk, W.P., Jackson, B., Modha, D.S.: TrueNorth: design and tool flow of a 65 mW 1 million neuron programmable neurosynaptic chip. IEEE Trans. Comput. Aided Des. Integrated Circuits Syst. 34(10), 1537–1557 (2015)
Carrillo, S., Harkin, J., McDaid, L.J., Morgan, F., Pande, S., Cawley, S., McGinley, B.: Scalable hierarchical network-on-chip architecture for spiking neural network hardware implementations. IEEE Trans. Parallel Distrib. Syst. 24(12), 2451–2461 (2013)
Firuzan, A., Modarressi, M., Daneshtalab, M.: Reconfigurable communication fabric for efficient implementation of neural networks. In: International Symposium on Reconfigurable and Communication-Centric Systems-on-Chip (ReCoSoC), pp. 1–8 (2015)
Benini, L., De Micheli, G.: Networks on chips: a new SoC paradigm. Computer 35(1), 70–78 (2002)
Gambardella, L.M., Taillard, É., Dorigo, M.: Ant colonies for the quadratic assignment problem. J. Oper. Res. Soc. 50(2), 167–176 (1999)
Misevicius, A.: An improved hybrid genetic algorithm: new results for the quadratic assignment problem. Knowl. Based Syst. 17(2–4), 65–73 (2004)
Paul, G.: Comparative performance of tabu search and simulated annealing heuristics for the quadratic assignment problem. Oper. Res. Lett. 38(6), 577–581 (2010)
Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: International Symposium on MICRO Machine and Human Science, pp. 39–43 (1995)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks (ICNN), pp. 1942–1948 (1995)
Bahirat, S., Pasricha, S.: A particle swarm optimization approach for synthesizing application-specific hybrid photonic networks-on-chip. In: International Symposium on Quality Electronic Design (ISQED), pp. 78–83 (2012)
Sahu, P.K., Shah, T., Manna, K., Chattopadhyay, S.: Application map** onto mesh-based network-on-chip using discrete particle swarm optimization. IEEE Trans. Very Large Scale Integr. (VLSI) Syst. 22(2), 300–312 (2014)
Singh, A.K., Srikanthan, T., Kumar, A., Jigang, W.: Communication-aware heuristics for run-time task map** on NoC-based MPSoC platforms. J. Syst. Architect. 56(7), 242–255 (2010)
Hu, J., Marculescu, R.: Energy-aware map** for tile-based NoC architectures under performance constraints. In: Proceedings of Asia South Pacific Design Automation Conference (ASP-DAC), pp. 233–239 (2003)
Kennedy, J., Eberhart, R.: A discrete binary version of the particle swarm algorithm. In: Proceedings of IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation, pp. 4104–4108 (1997)
Liu, J., Harkin, J., McDaid, L., Martin, G.: Hierarchical networks-on-chip interconnect for astrocyte-neuron network hardware. In: Villa, A.E.P., Masulli, P., Pons Rivero, A.J. (eds.) ICANN 2016. LNCS, vol. 9886, pp. 382–390. Springer, Cham (2016). doi:10.1007/978-3-319-44778-0_45
Acknowledgments
This research was supported by the National Natural Science Foundation of China under Grants 61603104 and 61661008, the Guangxi Natural Science Foundation under Grant 2015GXNSFBA139256 and 2016GXNSFCA380017, the funding of Overseas 100 Talents Program of Guangxi Higher Education, the Research Project of Guangxi University of China under Grant KY2016YB059, Guangxi Key Lab of Multi-source Information Mining & Security under Grant MIMS15-07, and the Doctoral Research Foundation of Guangxi Normal University.