Abstract
The Fork-Join program consisting of K parallel tasks is a useful model for a large number of computing applications. When the parallel processor has multi-channels, later tasks may finish execution earlier than their earlier tasks and may join with tasks from other programs. This phenomenon is called exchangeable join (EJ), which introduces correlation to the task’s service time. In this work, we investigate the response time of multiprocessor systems with EJ with a new approach. We analyze two aspects of this kind of systems: exchangeable join (EJ) and the capacity constraint (CC). We prove that the system response time can be effectively reduced by EJ, while the reduced amount is constrained by the capacity of the multiprocessor. An upper bound model is constructed based on this analysis and a quick estimation algorithm is proposed. The approximation formula is verified by extensive simulation results, which show that the relative error of approximation is less than 5%.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Baccelli, F., Liu, Z., 1990. On the execution of parallel programs on multiprocessor systems—a queuing theory approach. Journal of the ACM, 37(2):373–414. [doi:10.1145/77600.77622]
Barry, W., Allen, M., 1998. Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers. Addison-Wesley Publisher, Boston.
Flatto, L., 1985. Two parallel queues created by arrivals with two demands II. SIAM Journal on Adv. Appl. Prob., 45:845–861.
Flatto, L., Hahn, S., 1984. Two parallel queues created by arrivals with two demands. SIAM Journal on Appl. Math., 44(5):1041–1053. [doi:10.1137/0144074]
Glasserman, P., Yao, D.D., 1992. Some guidelines and guarantees for common random numbers. Management Science, 38(6):884–908.
Ko, S.S., Serfozo, R.E., 2004. Response times in M/M/s Fork-Join networks. Adv. Appl. Prob., 36(3):854–871. [doi:10.1239/aap/1093962238]
Medhi, J., 1990. Stochastic Models in Queueing Theory. Academic Press Inc.
Nelson, R., Tantawi, A.N., 1988. Approximate analysis of Fork/Join synchronization in parallel queues. IEEE Transactions on Computers, 37(6):739–743. [doi:10.1109/12.2213]
Taha, M.E., Stidham, S., 1999. Sample-Path Analysis of Queueing Systems. Kluwer Academic Publishers.
Towsley, D., Rommel, C.G., Stankovic, J.A., 1990. Analysis of Fork-Join program response times on multiprocessors. IEEE Transctions on Parallel and Distributed Systems, 1(3):286–303. [doi:10.1109/71.80157]
Wright, P.E., 1992. Two parallel processors with coupled inputs. Adv. Appl. Prob., 24(4):986–1007. [doi:10.2307/1427722]
Author information
Authors and Affiliations
Additional information
Project supported by the National Natural Science Foundation of China (Nos. 60274011 and 60574067), and the Program for New Century Excellent Talents in University (No. NCET-04-0094), China
Rights and permissions
About this article
Cite this article
Wang, Yc., Zhao, Qc. & Zheng, Dz. Fork-Join program response time on multiprocessors with exchangeable join. J. Zhejiang Univ. - Sci. A 7, 927–936 (2006). https://doi.org/10.1631/jzus.2006.A0927
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.2006.A0927