Modeling and Online Recognition of Surgical Phases Using Hidden Markov Models
The amount of signals that can be recorded during a surgery, like tracking data or state of instruments, is constantly growing. These signals can be used to better understand surgical workflow and to build surgical assist systems that are aware of the current state of a surgery. This is a crucial issue for designing future systems that provide context-sensitive information and user interfaces.
In this paper, Hidden Markov Models (HMM) are used to model a laparoscopic cholecystectomy. Seventeen signals, representing tool usage, from twelve surgeries are used to train the model. The use of a model merging approach is proposed to build the HMM topology and compared to other methods of initializing a HMM. The merging method allows building a model at a very fine level of detail that also reveals the workflow of a surgery in a human-understandable way. Results for detecting the current phase of a surgery and for predicting the remaining time of the procedure are presented.
KeywordsLaparoscopic Cholecystectomy Hide Markov Model Dynamic Time Warping Current Phase Observation Probability
- 1.Plsek, P.: Complexity and the adoption of innovation in health care. In: Accelerating Quality Improvement in Health Care (2003)Google Scholar
- 3.Neumuth, T., Strauß, G., Meixensberger, J., Lemke, H., Burgert, O.: Acquisition of process descriptions from surgical interventions. In: Database and Expert Systems Applications, pp. 602–611 (2006)Google Scholar
- 4.Blum, T., Padoy, N., Feußner, H., Navab, N.: Workflow mining for visualization and analysis of surgeries. In: Computer Assisted Radiology and Surgery (2008)Google Scholar
- 8.Bhatia, B., Oates, T., Xiao, Y., Hu, P.: Real-Time Identification of Operating Room State from Video. Innovative Applications of Artificial Intelligence, 1761–1766 (2007)Google Scholar
- 11.Padoy, N., Blum, T., Feußner, H., Berger, M.-O., Navab, N.: On-line recognition of surgical activity for monitoring in the operating room. In: Innovative Applications of Artificial Intelligence (2008)Google Scholar
- 12.Stolcke, A., Omohundro, S.: Inducing probabilistic grammars by Bayesian model merging. In: Grammatical Inference and Applications, pp. 106–118 (1994)Google Scholar
- 13.Stolcke, A., Omohundro, S.: Best-first model merging for hidden markov model induction. Technical Report TR-94-003, ICSI, Berkeley, CA (1994)Google Scholar