Abstract
A difficult problem in medical image interpretation is that for every image type such as x‐ray and every body organ such as heart, there exist specific solutions that do not allow for generalization. Just collecting all the specific solutions will not achieve the vision of a computerized physician. To address this problem, we develop an intelligent agent approach based on the concept of active fusion and agent‐oriented programming. The advantage of agent‐oriented programming is that it combines the benefits of object‐oriented programming and expert system. Following this approach, we develop a Web‐based multi‐agent system for interpreting medical images. The system is composed of two major types of intelligent agents: radiologist agents and patient representative agents. A radiologist agent decomposes the image interpretation task into smaller subtasks, uses multiple agents to solve the subtasks, and combines the solutions to the subtasks intelligently to solve the image interpretation problem. A patient representative agent takes questions from the user (usually a patient) through a Web‐based interface, asks for multiple opinions from radiologist agents in interpreting a given set of images, and then integrates the opinions for the user. In addition, a patient representative agent can answer questions based on the information in a medical information database. To maximize the satisfaction that patients receive, the patient representative agents must be as informative and timely as communicating with a human. With an efficient pseudo‐natural language processing, a knowledge base in XML, and user communication through Microsoft Agent, the patient representative agents can answer questions effectively.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bigus, J.P. and J. Bigus (1998), Constructing Intelligent Agents with Java, Wiley, New York.
Bradshaw, J.M. (1997), Software Agents, AAAI Press, The MIT Press, Cambridge, MA.
Bray, T. (1999), “An Introduction to XML Processing with Lark and Larval,” http://www.textuality.com/Lark/.
Connolly, D. (1999), “Extensible Markup Language Online,” http://www.w3.org/XML.
Espeset, T. (1996), Kick Ass Java Programming, Coriolis Group Books, Scottsdale, AZ.
Ferber, J. (1999), Multi-Agent Systems, Addison-Wesley, Reading, MA.
Gonzales, R.C. and R.E. Woods (1993), Digital Image Processing, Addison-Wesley, Reading, MA.
IBM (1999), “XML Parser for Java: Another AlphaWorks Technology,” http://www.alphaworks.ibm.com/ formula/XML.
Jennings, N.R. and M.J. Wooldridge (1998), Agent Technology: Foundations, Applications, and Markets, Springer, Berlin.
Kopp-Borotschnig, H. and A. Pinz (1996), “A New Concept for Active Fusion in Image Understanding Applying Fuzzy Set Theory,” In Fuzz-IEEE'96, New Orleans.
Lange, D.B. and M. Oshima (1998), Programming and Deploying Java Mobile Agents with Aglets, Addison-Wesley, Reading, MA.
Microsoft (1999), “Microsoft Agents,” Microsoft MSDN Online Workshop, http://www.microsoft.com/msagent.
Nwana, H.S. and N. Azarmi, Eds. (1997), Software Agents and Soft Computing: Towards Enhancing Machine Intelligence, Springer-Verlag, Berlin.
Pinz, A., M. Prantl, H. Gangster, and H. Kopp-Borotschnig (1999), “Active Fusion - A New Method Applied to Remote Sensing Image Interpretation,” http://www.icg.tu-graz.ac.at/CVGroup/Projects/ ActiveFusion/activefusion.html.
Pope, A. (1998), The CORBA Reference Guide, Addison-Wesley, Reading, MA.
Prantl, M., H. Gangster, H. Kopp-Borotschnig, D. Siclair, and A. Pinz (1996), “Object Recognition by Active Fusion,” In SPIE Conference on Intelligent Robots and Computer Vision XV, Vol. 2904, San Jose, CA.
Shoham, Y. (1993), “Agent-Oriented Programming,” Artificial Intelligence 60.
Sycara, K., K. Decker, A. Pannu, M. Williamson, and D. Zeng (1996), “Distributed Intelligent Agents,” IEEE Expert.
Weib, G. (1997), “Distributed Artificial Intelligence Meets Machine Learning - Learning in Multi-Agent Environment,” In Lecture Notes in Artificial Intelligence, Vol. 1221, Springer-Verlag, Berlin.
Weib, G. and S. Sandip (1996), “Adaption and Learning in Multiagent Systems,” In Lecture Notes in Artificial Intelligence, Vol. 1042, Springer-Verlag, Berlin. xml.com (1999), “XML.COM Online,” http://www.xml.com.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Shang, Y., Shi, H. A Web‐based multi‐agent system for interpreting medical images. World Wide Web 2, 209–218 (1999). https://doi.org/10.1023/A:1019261025204
Issue Date:
DOI: https://doi.org/10.1023/A:1019261025204