Design and Implementation of a Benchmarking Tool for OpenFlow Controllers

Full Text (PDF, 1579KB), PP.1-13

Views: 0 Downloads: 0


Eric Gamess 1,* Daniel Tovar 2 Alberto Cavadia 2

1. Jacksonville State University, MCIS Department, Jacksonville, AL 36265, USA

2. Central University of Venezuela, School of Computing, Caracas, Venezuela

* Corresponding author.


Received: 11 Sep. 2018 / Revised: 20 Sep. 2018 / Accepted: 27 Sep. 2018 / Published: 8 Nov. 2018

Index Terms

SDN, SDN Controller, OpenFlow, Performance Evaluation, Ryu, OpenDaylight, OpenMUL, Floodlight


The growth of data traffic on the web, the virtualization of services, and the changes in the pattern of traffic between users and data centers have led to a reassessment of the current methods of doing network administration. Software Defined Networks (SDNs) propose a paradigm that delegate the control of packets and flows to applications, developed according to specific requirements, where the OpenFlow protocol can be used for communications. The development of this type of applications, as in any other development area, requires tests and measurement tools to facilitate a performance evaluation. However, the current open-source performance measurement applications for SDN networks cover only very basic characteristics, while there is a wide range of SDN controllers with support to many versions of OpenFlow, making the selection of the controller a difficult point to address. In this paper, we propose a distributed performance evaluation tool for SDN controllers, that can assess the throughput, latency, percentage of memory consumption, percentage of CPU utilization, and consumption in kB for input/output interfaces, using OpenFlow version 1.3. Our tool is based on Cbench, and adds new functionalities such as the graphical representation of results to analyze the outcomes. To validate our tool, we make a performance evaluation of well-known SDN controllers such as Ryu, OpenDaylight, OpenMUL, and Floodlight, in environments under great stress of requests.

Cite This Paper

Eric Gamess, Daniel Tovar, Alberto Cavadia, "Design and Implementation of a Benchmarking Tool for OpenFlow Controllers", International Journal of Information Technology and Computer Science(IJITCS), Vol.10, No.11, pp.1-13, 2018. DOI:10.5815/ijitcs.2018.11.01


[1]P. Goransson, C. Black, and T. Culver. Software Defined Networks: A Comprehensive Approach, Second Edition. November 2016.
[2]J. Doherty. SDN and NFV Simplified: A Visual Guide to Understanding Software Defined Networks and Network Function Virtualization. Addison-Wesley Professional; First Edition, March 2016.
[3]Open Networking Foundation. OpenFlow Switch Specification. Version 1.5.1 (Protocol Version 0x06). March 2015.
[4]O. Coker and‎ S. Azodolmolky. Software Defined Networking with OpenFlow, Packt Publishing, Second Edition. October 2017.
[5]G. Blokdyk, OpenFlow: The Definitive Handbook. CreateSpace Independent Publishing Platform. October 2017.
[6]M. Basheer Al-Somaidai and E. Bassam Yahya, Survey of Software Components to Emulate OpenFlow Protocol as an SDN Implementation, American Journal of Software Engineering and Applications, Vol. 3, No. 6, pp. 74-82.
[7]A. Hassan and S. Ahmed, “Performance Comparison of the State of the Art OpenFlow Controllers”. Halmstad, September 2014.
[8]M. Jarschel, F. Lehrieder, Z. Magyari, and R. Pries, A Flexible OpenFlow-Controller Benchmark, in Proceedings of the 2012 European Workshop on Software Defined Networking (EWSDN 2012), Darmstadt, Germany, October 2012.
[9]M. Darianian, C. Williamson, and I. Haque, Experimental Evaluation of Two OpenFlow Controllers, in Proceedings of the 2017 IEEE 25th International Conference on Network Protocols (ICNP), Toronto, ON, Canada, November 2017.
[10]B. Xiong, K. Yang, J. Zhao, W. Li, and K. Li. Performance Evaluation of OpenFlow-based Software-defined Networks based on Queueing Model, Computer Networks, Vol. 102, pp. 172-185, 2016.
[11]I. Bholebawa and U. Dalal, Performance Analysis of SDN/OpenFlow Controllers: POX Versus Floodlight, Wireless Personal Communications: An International Journal, Vol. 98, No. 2, pp. 1679-1699, January 2018.
[12]B. Lantz, B. Heller, and N. McKeown. A Network in a Laptop: Rapid Prototyping for Software-Defined Networks. In Proceedings of the 9th ACM Workshop on Hot Topics in Networks, Monterey, CA, USA. October 2010.
[13]B. Lantz, B. O’Connor, A Mininet-based Virtual Testbed for Distributed SDN Development. In Proceedings of SIGCOMM 2015, London, UK. August 2015.
[14]S. Rowshanrad, V. Abdi, and M. Keshtgari, Performance Evaluation of SDN Controllers: Floodlight and OpenDaylight, IIUM Engineering Journal, Vol. 17, No. 2, 2016.
[15]S.-Y. Wang, H.-W. Chiu, and C.-L. Chou, Comparisons of SDN OpenFlow Controllers over EstiNet: Ryu vs. NOX, in Proceedings of the Fourteenth International Conference on Networks (ICN 2015), Barcelona, Spain, April 2015.
[16]G. Blokdyk, SNMP Simple Network Management Protocol: Amazing Projects from Scratch, CreateSpace Independent Publishing Platform, October 2017.
[17]N. Feamster, J. Rexford, and E. Zegura, “The Road to SDN: An Intellectual History”. ACM SIGCOMM Computer Communication Review, vol. 44, no. 2, pp. 87-98, April 2014.
[18]N. Figuerola, “SDN – Redes Definidas por Software”. October 2013.
[19]I. Gavilán, “Fundamentos de SDN (Software Defined Networking)”. August 2013.
[20]S. Azodolmolky, “Software Defined Networking with OpenFlow”, Packt Publishing Ltd., October 2013.
[21]P. Göransson and C. Black, “Software Defined Networks: A Comprehensive Approach”, Morgan Kaufmann, May 2014.
[22]M. Palacin Mateo, “OpenFlow Switching Performance”. July 2009.
[23]T. D. Nadeau and K. Gray, “SDN: Software Defined Networks”. O’Reilly, August 2013.
[24]A. Nierbeck,‎ J. Goodyear,‎ J. Edstrom,‎ and H. Kesler, Apache Karaf Cookbook, Packt Publishing, August 2014.
[25]J. Edstrom,‎ J. Goodyear,‎ and H. Kesler, Learning Apache Karaf, Packt Publishing, October 2013.
[26]G. Blokdyk, OSGi: Upgrader’s Guide, CreateSpace Independent Publishing Platform, November 2017.
[27]H. Cummins and‎ T. Ward, Enterprise OSGi in Action: With Examples using Apache Aries, Manning Publications, 1st edition, April 2013.
[28]OpenDaylight, “Wiki OpenDaylight”,
[29]K. Ohmura, “OpenStack/Quantum SDN-based Network Virtualization”. May 2013.
[30]R. Enns, M. Bjorklund, J. Schoenwaelder, and A. Bierman, Network Configuration Protocol (NETCONF), RFC 6241, June 2011.
[31]P. Phaal, S. Panchen, and N. McKee, InMon Corporation’s sFlow: A Method for Monitoring Traffic in Switched and Routed Networks, RFC 3176, September 2001.
[32]O. Santos, Network Security with NetFlow and IPFIX: Big Data Analytics for Information Security, Cisco Press, 1st edition, October 2015.
[33]M. Allen Patterson,‎ D. Robb,‎ and A. Akhter, Unleashing the Power of NetFlow and IPFIX, Amazon Digital Services LLC, September 2013.
[34]S. Nadas, Virtual Router Redundancy Protocol (VRRP) Version 3 for IPv4 and IPv6, RFC 5798, March 2010.
[35]N. Malik and D. Saikia, “An Introduction to OpenMUL SDN Suite”. September 2014.