Abstract
The results from event-driven simulations with video services can present limitations because of the cost of developing accurate models. Creating a video server model precise in how streams are transmitted is generally as expensive as the construction of the real server, thus several simplifications are generally introduced to reduce the effort. In this context, the lack of accuracy could be devastating if metrics such as jitter are imprecise. One potential alternative to solve these issues is the combination of real services with Real-Time (R-T) capable network simulators. This paper evaluates R-T simulation capabilities of two of the most popular tools, NS-3 and OPNET to support the performance evaluation of video services using a commodity hardware testbed. Taking a video on demand service as a test case, we have studied the use of NS-3 and OPNET in situations where their more profitable characteristics, such as instance creation simplicity or the use of analytic traffic, could produce the best results. The performed tests show how NS-3 is able to replicate an access network topology with up to 10 MPEG-4 video streams or OPNET has been able to replicate a ring core network with up to 60 of the same streams without affecting important metrics as important as jitter. These results point out the validity of R-T simulation in the context of services that have streams as a main component if their strengths are taken into account.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Network Modelling/Network Simulation. Available at: http://www.opnet.com/solutions/network_rd/modeller.html, accessed 11 May 2013.
The NS-3 network simulator. Available at: http://www.nsnam.org, accessed 11 May 2013.
References
Alvarez A, Orea R, Cabrero S, Pañeda X G, García R and Melendi D (2010). Limitations of network emulation with single-machine and distributed ns-3. In: Proceedings of the 3rd International ICST Conference on Simulation Tools and Techniques, ICST; Malaga, Spain, pp 1–9, 67.
Bhatt S, Fujimoto R, Ogielski A and Perumalla K (1998). Parallel simulation techniques for large-scale networks. IEEE Communication Magazine 36(8): 42–47.
Bullock D and Catarella A (1998). A real-time simulation environment for evaluating traffic signal systems. Transportation Research Record: Journal of the Transportation Research Board 1634(1): 130–135.
Carneiro G, Fontes H and Ricardo M (2011). Fast prototyping of network protocols through ns-3 simulation model reuse. Simulation Modelling Practice and Theory 19(9): 2063–2075.
Fras M, Mohorko J and Cucej Z (2008). Real time ‘system-in-the-loop’ simulation of tactical networks. 16th International Conference on Software, Telecommunications and Computer Networks, SoftCOM 2008; Croatia, pp 105–108.
Handigol N, Heller B, Jeyakumar V, Lantz B and McKeown N (2012). Reproducible network experiments using container-based emulation. In: Proceedings of the 8th International Conference on EmergingNetworking Experiments and Technologies ACM; Nice, France, pp 253–264.
Hemminger S (2005). Network emulation with NetEm. In: Proceedings of the 6th Australia's National Linux Conference (LCA), Canberra, Australia, pp 18–23.
Kristiansen S, Plagemann T and Goebel V (2013). Extending network simulators with communication software execution models. In: Fifth International Conference on Communication Systems and Networks (COMSNETS), IEEE; Bangalore, pp 1–10.
Liu J (2008). A primer for real-time simulation of large-scale networks. 41st Annual Simulation Symposium, ANSS 2008, IEEE; Ottawa, pp. 85–94.
Martinez R, Wu W, McNeill K, Deal J, Haynes T and Bradford D (2003). Hardware and software-in-the-loop techniques using the OPNET modeling tool for JTRS developmental testing. IEEE Military Communications Conference, MILCOM’03, Vol. 1, pp 469–474.
Melendi D, García R, Pañeda X G and García V. (2011). Modelling and simulation of a real Internet radio service. Journal of Simulation 5(2): 111–122.
Nikolaev S et al (2012). Performance of Distributed NS-3 Network Simulator. Lawrence Livermore National Laboratory (LLNL): Livermore, CA.
Office C (2011). ITIL Lifecycle Suite. The Stationery Office: London.
Pozueco L, Pañeda X G, García R, Melendi D and Cabrero S (2013). Adaptable system based on scalable video coding for high-quality video service. Computers and Electrical Engineering 39(3): 775–789.
Renard K, Peri C and Clarke J (2012). A performance and scalability evaluation of the ns-3 distributed scheduler. In: Proceedings of the 5th International ICST Conference on Simulation Tools and Techniques, ICST; Italy, pp 378–382.
Roy A, Yocum K and Snoeren A C (2013). Challenges in the emulation of large scale software defined networks. In: Proceedings of the 4th Asia-Pacific Workshop on Systems, ACM; Singapore, p 1–6, 10.
Salah K, Hamodi J, Baig Z A and Al-Haidari F (2011). Video-on-demand (VoD) deployment over hospitality networks. International Journal of Network Management 22(1): 65–80.
Sarkar N I, Nisar K and Babbage L (2012). Performance studies on campus-wide focus on FTP, video and voip ethernet network. International Journal of Advanced Pervasive and Ubiquitous Computing 4(1): 49–59.
Sarprasatham M (2013). Streaming real-time video using hybrid transport layer protocols in sim-real-sim environment. International Journal of Computer Science 2(1): 7–17.
Sultan F et al (2012). TimeSync: Virtual time for scalable, high-fidelity hybrid network emulation. Military Communications Conference—MILCOM 2012, IEEE; Orlando, pp 1–6.
Tazaki H, Urbani F and Turletti T (2013). DCE cradle: Simulate network protocols with real stacks for better realism. In: Proceedings of the 6th International ICST Conference on Simulation Tools and Techniques, ICST; Brussels, Belgium, pp. 153–158.
Tsugawa M and Fortes J A (2010). Characterizing user-level network virtualization: performance, overheads and limits. International Journal of Network Management 20(3): 149–166.
Van Vorst N, Erazo M and Liu J (2012). PrimoGENI for hybrid network simulation and emulation experiments in GENI. Journal of Simulation 6(3): 179–192.
Zhang L, Zheng L and Soo Ngee K (2002). Effect of delay and delay jitter on voice/video over IP. Computer Communications2 5(9): 863–873.
Zheng Y, Nicol D M, Jin D and Tanaka N (2012). A virtual time system for virtualization-based network emulations and simulations. Journal of Simulation 6(3): 205–213.
This work was partially supported by the University of Oviedo and the Principality of Asturias through the project SV-PA-13- ECOEMP-75
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Álvarez, A., Pozueco, L., Pañeda, X. et al. Limits for the real-time simulation of video services over commodity hardware. J Simulation 10, 251–259 (2016). https://doi.org/10.1057/jos.2015.10
Published:
Issue Date:
DOI: https://doi.org/10.1057/jos.2015.10