Chapter

Interactive Systems. Design, Specification, and Verification

Volume 5136 of the series Lecture Notes in Computer Science pp 252-266

A Middleware for Seamless Use of Multiple Displays

  • Satoshi SakuraiAffiliated withGraduate School of Information Science and Technology, Osaka University
  • , Yuichi ItohAffiliated withGraduate School of Information Science and Technology, Osaka University
  • , Yoshifumi KitamuraAffiliated withGraduate School of Information Science and Technology, Osaka University
  • , Miguel A. NacentaAffiliated withDepartment of Computer Science, University of Saskatchewan
  • , Tokuo YamaguchiAffiliated withGraduate School of Information Science and Technology, Osaka University
  • , Sriram SubramanianAffiliated withDepartment of Computer Science, University of Bristol
  • , Fumio KishinoAffiliated withGraduate School of Information Science and Technology, Osaka University

* Final gross prices may vary according to local VAT.

Get Access

Abstract

Current multi-display environments (MDEs) can be composed of displays with different characteristics (e.g. resolution, size) located in any position and at different angles. These heterogeneous arrangements present specific interface problems: it is difficult to provide meaningful transitions of cursors between displays; it is difficult for users to visualize information that is presented on oblique surfaces; and it is difficult to spread visual information over multiple displays. In this paper we present a middleware architecture designed to support a new kind of perspective-aware GUI that solves the aforementioned problems. Our interaction architecture combines distributed input and position tracking data to generate perspective-corrected output in each of the displays, allowing groups of users to manipulate existing applications from current operating systems across a large number of displays. To test our design we implemented a complex MDE prototype and measured different aspects of its performance.

Keywords

3D interactions graphical user interface server-client VNC