A multi-modal dialogue analysis method for medical interviews based on design of interaction corpus
- First Online:
- Cite this article as:
- Koyama, Y., Sawamoto, Y., Hirano, Y. et al. Pers Ubiquit Comput (2010) 14: 767. doi:10.1007/s00779-010-0289-5
- 58 Views
We propose a multi-modal dialogue analysis method for medical interviews that hierarchically interprets nonverbal interaction patterns in a bottom-up manner and simultaneously visualizes the topic structure. Our method aims to provide physicians with the clues generally overlooked by conventional dialogue analysis to form a cycle of dialogue practice and analysis. We introduce a motif and a pattern cluster in the designs of the hierarchical indices of interaction and exploit the Jensen–Shannon divergence (JSD) metric to reduce the number of usable indices. We applied the proposed interpretation method of interaction patterns to develop a corpus of interviews. The results of a summary reading experiment confirmed the validity of the developed indices. Finally, we discussed the integrated analysis of the topic structure and a nonverbal summary.