Abstract
The paired comparison (PC) is an easy and effective way to distinguish the nuances among sound stimuli of diesel engine in sound quality subjective evaluation. However, the PC method is inefficient for the subjective evaluation of large quantities of stimulus or to rank the results of overall perception of sound stimuli. To overcome the shortcoming of the PC method, this paper presents a comprehensive evaluation method of diesel engine sound quality based on the PC method, uniform design sampling (UDS), and the improved analytic hierarchy process (AHP). An hierarchical tree of comprehensive evaluation models of diesel engine sound quality is constructed and simplified through UDS to ensure that the sound sample size is in the application range of the PC method or the grouped paired-wise comparison (GPC) method. An improved AHP is developed by introducing a new method calculating the relative weight based on evaluators’ preference order instead of the traditional 1–9 scale method, which reduces subjective liberty and difficulty of the consistency of the judgment matrix meeting the requirement, and the requirements of evaluators’ specialized knowledge. With three diesel engines’ noise stimuli as example, a realization of sound quality comprehensive evaluation based on UDS-AHP method with the GPC method is introduced. The results show that the proposed subjective comprehensive evaluation method can accurately provide the ranks of the sound stimuli over all subjective perception with a significant decrease of the evaluation workload.
目的
提出柴油机噪声品质综合评价方法,解决产品总体噪声品质择优排序问题。
创新点
在噪声品质综合评价模型的研究中,将均匀设计抽样与层次分析法相结合,提出一种考虑多因素、多水平的噪声 品质主观综合评价GPC-UDS-AHP方法,通过对少量的声样本进行主观评价得到声品质综合评价结果;提出基于偏好序和Bradley-Terry模 型的权重计算方法,避免了1-9标度法主观性强和一致性难以满足要求的问题。
方法
针对传统的成对比较法难以在声品质主观评价试验中获得评价对象整体感受择优排序的不足,结合均设 计抽样法“均匀分散”的特点,提出一种基于分组成对比较法的柴油机声品质主观综合评价方法,确定适合于柴油机声品 质主观评价的结构及层次划分,提出基于偏好序和Bradley-Terry模型的各级指标权重计算方法。以采集 到的某3款柴油机共375个噪声样本为评价对象,分别利用该方法和等级评分法计算得出3款柴油机的声品质评价综合值。
结论
提出的柴油机声品质主观综合评价GPC-UDS-AHP方法可在有效地维持成 对比较主观评价试验实施范围的情况下,准确地得到柴油机声品质整体主观感受评价得分的择优排 序,可用于实施不同柴油机或N次改进试验的声品质比较和评判。
Similar content being viewed by others
References
Bradley, R.A., Terry, M.E., 1952. Rank analysis of incomplete block designs: the method of paired comparisons. Biometrika, 39(3-4):324–345. http://dx.doi.org/10.2307/2334029
Chouard, N., Weber, R., 1994. On the influence of the ordering of noise in sequences for paired comparison judgment utilization. INTER-NOISE and NOISE-CON Congress and Conference Proceedings, 6(1):1089–1092.
Chouard, N., Hmpel, T., 1999. A semantic differential design especially developed for the evaluation of interior car sounds. The Journal of the Acoustical Society of America, 105(2):1280. http://dx.doi.org/10.1121/1.426109
David, H.A., 1966. The method of paired comparisons. Biometrics, 22(3):636. http://dx.doi.org/10.2307/2528197
Fang, K.T., Ma, C.X., 2001. Orthogonal and Uniform Experimental Design. Science Press, China (in Chinese).
Fang, K.T., Lu, X., Winker, P., 2003a. Lower bounds for centered and wrap-around L2-discrepancies and construction of uniform designs by threshold accepting. Journal of Complexity, 19(5):692–711. http://dx.doi.org/10.1016/S0885-064X(03)00067-0
Fang, K.T., Lin, D.K.J., Liu, M.Q., 2003b. Optimal mixed level supersaturated design. Metrika, 58(3):279–291. http://dx.doi.org/10.1007/s001840300266
Genuit, K., 2008. Product sound quality of vehicle noise–a permanent challenge for NVH measurement technologies. SAE Technical Paper, No. 2008-36-0517. http://dx.doi.org/10.4271/2008-36-0517
Hickernell, F.J., 1998a. A generalized discrepancy and quadrature error bound. Mathematics of Computation, 67(221):299–322. http://dx.doi.org/10.1090/S0025-5718-98-00894-1
Hickernell, F.J., 1998b. Lattice Rules: How Well Do They Measure Up. Springer New York, 38:109–166. http://dx.doi.org/10.1007/978-1-4612-1702-2_3
Huang, C.M., Lee, Y.J., Lin, D.J.K., et al., 2007. Model selection for support vector machines via uniform design. Computational Statistics & Data Analysis, 52(1): 335–346. http://dx.doi.org/10.1016/j.csda.2007.02.013
Huang, Y., Chen, K.A., Yan, L., et al., 2008. Adaptive grouped paired comparison: theory and selection of seeds. Chinese Journal of Acoustics, 4(3):298–309 (in Chinese). http://dx.doi.org/10.15949/j.cnki.0217-9776.2009.04.003
Jiao, F.L., Liu, K., Mao, D.X., 2005. Subjective assessment of car interior sound quality: applicability of nonmetric multidimensional scaling to sound quality research. Acta Acustica, 30(6):521–529 (in Chinese). http://dx.doi.org/10.15949/j.cnki.0371-0025.2005.06.007
Jing, M.E., Hao, Y., Zhang, J.F., et al., 2005. Efficient parametric yield optimization of VLSI circuit by uniform design sampling method. Microelectronics Reliability, 45(1):155–162. http://dx.doi.org/j.microrel.2004.06.001
Lemaitre, G., Susini, P., Winsberg, S., et al., 2002. Perception of the timbre of car horns. Proceedings of Forum Acusticum.
Ling, M., Milner, B., Smith, D., 2006. Acoustic environment classification. ACM Transactions on Speech & Language Processing, 3(2):1–22. http://dx.doi.org/10.1145/1149290.1149292
Liu, N.N., Wang, Y.S., Ju, J., 2014. Fuzzy comprehensive method for subjective noise annoyance evaluation of subway’s interior noise. Noise and Vibration Control, 34(3):101–106 (in Chinese). http://dx.doi.org/10.3969/j.issn.1006-1335.2014.03.021
Mao, D.X., Yu, W.Z., Wang, Z.M., et al., 2005. Statistical validation and criterion for paired comparison data in sound quality evaluation. Acta Acustica, 30(5):468–472 (in Chinese). http://dx.doi.org/10.15949/j.cnki.0371-0025.2005.05.014
Mao, D.X., Gao, Y.L., Zhou, Y.W., et al., 2006. Grouped pair-wise comparison for subjective sound quality evaluation. Chinese Journal of Acoustics, 25(3):267–276 (in Chinese). http://dx.doi.org/10.15949/j.cnki.0217-9776.2006.03.008
McKay, M.D., Beckman, R.J., Conover, W.J., 1979. A comparison of three methods for selecting values of input variables in analysis of output from a computer codes. Technometrics, 21(1):239–245. http://dx.doi.org/10.1080/00401706.1979.10489755
Parizet, E., Koehl, V., 2011. Application of free sorting tasks to sound quality experiments. Applied Acoustics, 73(1): 61–65. http://dx.doi.org/10.1016/j.apacoust.2011.07.007
Rawlings, J.O., Pantula, S.G., Dickey, D.A., 1998. Applied regression analysis: a research tool. Technometrics, 41(1):82. http://dx.doi.org/10.2307/1271013
Ronacher, A., Hussain, M., Biermayer, W., et al., 1999. Evaluating vehicle interior noise quality under transient driving conditions. SAE Technical Paper, No. 1999-01-1683. http://dx.doi.org/10.4271/1999-01-1683
Satty, T.L., 2008. Decision making with the analytic hierarchy process. International Journal of Services Sciences, 1(1):83–98.
Su, L., Wang, D.F., Jiang, J.G., et al., 2012. Fuzzy comprehensive evaluation of vehicle interior sound quality based on semantic differential method. Journal of Jilin University (Engineering and Technology Edition), 42(2): 309–315 (in Chinese). http://dx.doi.org/10.13229/j.cnki.jdxbgxb2012.02.044
Xu, Z.S., Wei, C.P., 1999. A consistency improving method in the analytic hierarchy process. European Journal of Operational Research, 116(2):443–449. http://dx.doi.org/10.1016/S0377-2217(98)00109-X
Zhang, J.H., Liu, H., Bi, F.R., et al., 2012. Psychoacoustic study on contribution of fan noise to engine noise. Chinese Journal of Mechanical Engineering, 25(4):809–815. http://dx.doi.org/10.3901/CJME.2012.04.809
Zhang, R.C., Wang, Z.J., 1996. Uniform design sampling and its fine properties. Chinese Journal of Applied Probability & Statistics, 12(4):337–347.
Zhou, B., Yao, H.L., Shi, M.H., et al., 2012. An new immune genetic algorithm based on uniform design sampling. Knowledge & Information Systems, 31(2):389–403. http://dx.doi.org/10.1007/s10115-011-0476-3
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported by the National High-Tech R&D Program of China (No. 2016YFD0700701)
ORCID: Wen-yun HE, http://orcid.org/0000-0001-7085-0199
Rights and permissions
About this article
Cite this article
He, WY., Zhang, JH. & Wang, J. A comprehensive evaluation method of diesel engine sound quality based on paired comparison, uniform design sampling, and improved analytic hierarchy process. J. Zhejiang Univ. Sci. A 18, 531–544 (2017). https://doi.org/10.1631/jzus.A1600025
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.A1600025
Keywords
- Sound quality
- Comprehensive evaluation
- Diesel engine
- Paired comparison (PC)
- Uniform design sampling (UDS)
- Analytic hierarchy process (AHP)