Opportunity Knocks: A System to Provide Cognitive Assistance with Transportation Services

  • Donald J. Patterson
  • Lin Liao
  • Krzysztof Gajos
  • Michael Collier
  • Nik Livic
  • Katherine Olson
  • Shiaokai Wang
  • Dieter Fox
  • Henry Kautz
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3205)


We present an automated transportation routing system, called “Opportunity Knocks,” whose goal is to improve the efficiency, safety and independence of individuals with mild cognitive disabilities. Our system is implemented on a combination of a Bluetooth sensor beacon that broadcasts GPS data, a GPRS-enabled cell-phone, and remote activity inference software. The system uses a novel inference engine that does not require users to explicitly provide information about the start or ending points of their journeys; instead this information is learned from users’ past behavior. Futhermore, we demonstrate how route errors can be detected and how the system helps to correct the errors with real-time transit information. In addition we present a novel solution to the problem of labeling positions with place names.


Geographic Information System Cell Phone Ubiquitous Computing Inference Engine Dynamic Bayesian Network 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Lawton, M.P.: Environment and Other Determinants of Well-Being in Older People. The Gerontologist 23, 349–357 (1983) NLM:0375327;PMID:6352420Google Scholar
  2. 2.
    Lawton, M.P.: Aging and Performance of Home Tasks. Human Factors 32, 527–536 (1990) NLM:0374660;PMID:2074107Google Scholar
  3. 3.
    Consolvo, S., Roessler, P., Shelton, B., LaMarcha, A., Schilit, B., Bly, S.: Technology for Care Networks of Elders. IEEE Pervasive Computing Mobile and Ubiquitous Systems: Successful Aging 3, 22–29 (2004), Google Scholar
  4. 4.
    F.C.C.: U.S. Federal Communication Commission E-911 Website (2004),
  5. 5.
    Socket Communications Inc.: Socket website (2004),
  6. 6.
    King County Department of Transportation: Trip planner (2004),
  7. 7.
    Washington Metro Area Transit Authority: The ride guide (2004),
  8. 8.
    Crabtree, A., Rodden, T., Hemmings, T., Benford, S.: Finding a Place for Ubi- Comp in the Home. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, pp. 208–226. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  9. 9.
    Hightower, J.: From Position to Place. In: Proc. of the 2003 Workshop on Location-Aware Computing (2003) 10–12 part of the 2003 Ubiquitous Computing Conf.Google Scholar
  10. 10.
    Ashbrook, D., Starner, T.: Learning Significant Locations and Predicting User Movement with GPS. In: International Symposium onWearable Computing, Seattle, WA (2002)Google Scholar
  11. 11.
    Patterson, D.J., Liao, L., Fox, D., Kautz, H.: Inferring High-Level Behavior from Low-Level Sensors. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, pp. 73–89. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  12. 12.
    Murphy, K.: Dynamic Bayesian Networks: Representation, Inference and Learning. PhD thesis, UC Berkeley, Computer Science Division (2002)Google Scholar
  13. 13.
    Liao, L., Fox, D., Kautz, H.: Learning and inferring Transportation Routines. In: Proc. of the 19th National Conf. on Artificial Intelligence, AAAI (2004)Google Scholar
  14. 14.
    Doucet, A., de Freitas, J., Murphy, K., Russell, S.: Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks. In: Proc. of the Conf. on Uncertainty in Artificial Intelligence (2000)Google Scholar
  15. 15.
    Bui, H., Venkatesh, S., West, G.: Policy Recognition in the Abstract Hidden Markov Model. Journal of Artificial Intelligence Research (2002)Google Scholar
  16. 16.
    Bui, H.: A General Model for Online Probabilistic Plan Recognition. In: Proc. of the International Joint Conf. on Artifical Intelligence (2003)Google Scholar
  17. 17.
    Doucet, A., de Freitas, N., Gordon, N. (eds.): Sequential Monte Carlo in Practice. Springer, New York (2001)zbMATHGoogle Scholar
  18. 18.
    Rabiner, L.R.: A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. In: Waibel, A., Lee, K.F. (eds.) Readings in Speech Recognition, pp. 267–296. Kaufmann, San Mateo (1990)Google Scholar
  19. 19.
    West, M., Harrison, J.: Bayesian Forecasting and Dynamic Models, 2nd edn. Springer, Heidelberg (1999)Google Scholar
  20. 20.
    Want, R., Schilit, B., Adams, N., Gold, R., Petersen, K., Ellis, J., Goldberg, D., Weiser, M.: The PARCTAB Ubiquitous Computing Experiment. Technical Report CSL-95-1, Xerox Palo Alto Research Center (1995)Google Scholar
  21. 21.
    Schilit, B.N., Adams, N., Gold, R., Tso, M., Want, R.: The ParcTab Mobile Computing System. In: Proc. Fourth Workshop on Workstation Operating Systems (WWOS-IV), pp. 34–39. IEEE, Los Alamitos (1993)CrossRefGoogle Scholar
  22. 22.
    Adams, N., Gold, R., Schilit, B.N., Tso, M., Want, R.: An Infrared Network for Mobile Computers. In: Proc. USENIX Symposium on Mobile & Locationindependent Computing, USENIX Association, pp. 41–52 (1993)Google Scholar
  23. 23.
    Bahl, P., Padmanabhan, V.N.: RADAR: An In-Building RF-Based User Location and Tracking System. INFOCOM (2), 775–784 (2000)Google Scholar
  24. 24.
    Krumm, J., Williams, L., Smith, G.: SmartMoveX on a Graph - An Inexpensive Active Badge Tracker. In: Proc. of the 4th international conference on Ubiquitous Computing, pp. 299–307. Springer, Heidelberg (2002)Google Scholar
  25. 25.
    Abowd, G.D., Atkeson, C.G., Hong, J., Long, S., Kooper, R., Pinkerton, M.: Cyberguide: a Mobile Context-Aware Tour Guide. Wirel. Netw. 3, 421–433 (1997)CrossRefGoogle Scholar
  26. 26.
    Burrell, J., Gay, G.K., Kubo, K., Farina, N.: Context-Aware Computing: A Test Case. In: Proc. of the 4th international conference on Ubiquitous Computing, pp. 1–15. Springer, Heidelberg (2002)Google Scholar
  27. 27.
    Cheverst, K., Davies, N., Mitchell, K., Friday, A., Efstratiou, C.: Developing a Context-Aware Electronic Tourist Guide: Some Issues and Experiences. In: CHI, pp. 17–24 (2000)Google Scholar
  28. 28.
    Schilit, B., LaMarca, A., Borriello, G., Griswold, W., McDonald, D., Lazowska, E., Balachandran, A., Hong, J., Iverson, V.: Challenge: Ubiquitous Location-Aware Computing and the Place Lab Initiative. In: Proc. of WMASH 2003: The First ACM International Workshop on Wireless Mobile Applications and Services on WLAN (2003)Google Scholar
  29. 29.
    Griswold, W.G., Boyer, R., Brown, S.W., Truong, T.M.: A Component Architecture for an Extensible, Highly Integrated Context-Aware Computing Infrastructure. In: Proc. of the 25th International Conf. on Software Engineering, pp. 363–372. IEEE Computer Society, Los Alamitos (2003)CrossRefGoogle Scholar
  30. 30.
    Griswold, W.G., Shanahan, P., Brown, S.W., Boyer, R., Ratto, M., Shapiro, R.B., Truong, T.M.: ActiveCampus - Experiments in Community-Oriented Ubiquitous Computing. Technical Report CS2003-0750, UC San Diego (2003)Google Scholar
  31. 31.
    Krumm, J., Cermak, G., Horvitz, E.: RightSPOT: A Novel Sense of Location for Smart Personal Object. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, Springer, Heidelberg (2003)Google Scholar
  32. 32.
    Hightower, J., Brumitt, B., Borriello, G.: The Location Stack: A Layered Model for Location in Ubiquitous Computing. In: Proc. of the Fourth IEEE Workshop on Mobile Computing Systems and Applications, IEEE Computer Society, Los Alamitos (2002)Google Scholar
  33. 33.
    Hightower, J., Borriello, G.: Accurate, Flexible and Practical Location Estimation for Ubiquitous Computing: A Case Study of Particle Filters. In: Davies, N., Mynatt, E.D., Siio, I. (eds.) UbiComp 2004. LNCS, vol. 3205, Springer, Heidelberg (2004)Google Scholar
  34. 34.
    Patterson, D., Etzioni, O., Fox, D., Kautz, H.: The Activity Compass. In: Proc. of UbiCog 2002: First International Workshop on Ubiquitous Computing for Cognitive Aids, Gothenberg, Sweden (2002)Google Scholar
  35. 35.
    Harniss, M.: Project ACCESS website (2004),

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Donald J. Patterson
    • 1
  • Lin Liao
    • 1
  • Krzysztof Gajos
    • 1
  • Michael Collier
    • 1
  • Nik Livic
    • 1
  • Katherine Olson
    • 1
  • Shiaokai Wang
    • 1
  • Dieter Fox
    • 1
  • Henry Kautz
    • 1
  1. 1.University of Of WashingtonSeattleUSA

Personalised recommendations