Advances in display technologies are transforming the capabilities—and potential applications—of system interfaces. Previously, the overwhelming majority of systems have utilised rectangular displays; this may soon change with digital devices increasingly designed to be ubiquitous and pervasive, to facilitate frictionless human interaction. At present, software is invariably designed assuming it will be used with a display of a specific shape; however, there is an emerging demand for systems built around interacting with tabletop interfaces to be capable of handling a wide range of potential display shapes. In this paper, the design of software for use on a range of differently shaped tabletop displays is considered, proposing a novel but extensible technique that can be used to minimise the influence of the issues of using different display shapes. Furthermore, we present a study that applies the technique to adapt several software applications to several different display shapes.
Dietz, P.; Raskar, R.; Booth, S.; van Baar, J.; Wittenburg, K.; Knep, B. Multi-projectors and implicit interaction in persuasive public displays. In: Proceedings of the Working Conference on Advanced Visual Interfaces, 209–217, 2004.
Boyd, J. Circular LCD debuts. 2007. Available at https://doi.org/spectrum.ieee.org/computing/hardware/circularlcd-debuts.
Finney, M. D.; Oliver, M. W.; Pierce, P. M.; Sutherland, T. Communication device. U.S. Patent USD600228. 2009.
Battersby, S. J. Non rectangular display device. U.S. Patent 7,253,865. 2007.
Hansen, T. E.; Hourcade, J. P.; Virbel, M.; Patali, S.; Serra, T. PyMT: A post-WIMP multi-touch user interface toolkit. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, 17–24, 2009.
Shen, C.; Vernier, F. D.; Forlines, C.; Ringel, M. DiamondSpin: An extensible toolkit for around-thetable interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 167–174, 2004.
Weiser, M. The computer for the 21st century. Mobile Computing and Communications Review Vol. 3, No. 3, 3–11, 1999.
Greenfield, A. Everyware: The Dawning Age of Ubiquitous Computing. Peachpit Press, 2006.
Mostafa, M.; Crick, T.; Calderon, A. C.; Oatley, G. Incorporating emotion and personality-based analysis in user-centered modelling. In: Research and Development in Intelligent Systems XXXIII. Bramer, M.; Petridis, M. Eds. Springer Cham, 383–389, 2016.
Smith, S. P.; Burd, E.; Rick, J. Developing, evaluating and deploying multi-touch systems. International Journal of Human-Computer Studies Vol. 70, No. 10, 653–656, 2012.
Vernier, F.; Lesh, N.; Shen, C. Visualization techniques for circular tabletop interfaces. In: Proceedings of the Working Conference on Advanced Visual Interfaces, 257–265, 2002.
Kitchenham, B. Procedures for performing systematic reviews. Technical Report TR/SE-0401. Keele University, 2004.
Serrano, M.; Roudaut, A.; Irani, P. Investigating text legibility on non-rectangular displays. In: Proceedings of the CHI Conference on Human Factors in Computing Systems, 498–508, 2016.
Serrano, M.; Roudaut, A.; Irani, P. Visual composition of graphical elements on non-rectangular displays. In: Proceedings of the CHI Conference on Human Factors in Computing Systems, 4405–4416, 2017.
Meskens, J.; Vermeulen, J.; Luyten, K.; Coninx, K. Gummy for multi-platform user interface designs: Shape me, multiply me, fix me, use me. In: Proceedings of the Working Conference on Advanced Visual Interfaces, 233–240, 2008.
Gajos, K.; Weld, D. S. SUPPLE: Automatically generating user interfaces. In: Proceedings of the 9th International Conference on Intelligent User Interfaces, 93–100, 2004.
Waldner, M.; Grasset, R.; Steinberger, M.; Schmalstieg, D. Display-adaptive window management for irregular surfaces. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, 222–231, 2011.
Constantine, L. L.; Lockwood, L. A. D. Software for use: A practical guide to the models and methods of usage-centered design. ACM SIGCHI Bulletin Vol. 32, No. 1, 111–114, 1999.
McNaughton, J.; Crick, T.; Hatch, A. Determining device position through minimal user input. Humancentric Computing and Information Sciences Vol. 7, No. 1, 37, 2017.
Milliron, T.; Jensen, R. J.; Barzel, R.; Finkelstein, A. A framework for geometric warps and deformations. ACM Transactions on Graphics Vol. 21, No. 1, 20–51, 2002.
Shen, C.; Ryall, K.; Forlines, C.; Esenther, A.; Vernier, F. D.; Everitt, K.; Wu, M.; Wigdor, D.; Morris, M. R.; Hancock, M.; Tse, E. Informing the design of direct-touch tabletops. IEEE Computer Graphics and Applications Vol. 26, No. 5, 36–46, 2006.
Scott, S. D.; Sheelagh, M.; Carpendale, T.; Inkpen, K. M. Territoriality in collaborative tabletop workspaces. In: Proceedings of the ACM Conference on Computer- Supported Cooperative Work, 294–303, 2004.
Smith, S. P.; Burd, E. L.; Ma, L.; AlAgha, I.; Hatch, A. Relative and absolute mappings for rotating remote 3D objects on multi-touch tabletops. In: Proceedings of the 25th BCS Conference on Human-Computer Interaction, 299–308, 2011.
Schöning, J.; Brandl, P.; Daiber, F.; Echtler, F.; Hilliges, O.; Hook, J.; Löchtefeld, M.; Motamedi, N.; Muller, L.; Olivier, P.; Roth, T.; von Zadow, U. Multitouch surfaces: A technical guide. Technical Report TUM-I0833. University of Munich, 2008.
Aggarwal, A.; Suri, S. Fast algorithms for computing the largest empty rectangle. In: Proceedings of the 3rd Annual Symposium on Computational Geometry, 278–290, 1987.
Naamad, A.; Lee, D. T. On the maximum empty rectangle problem. Discrete Applied Mathematics Vol. 8, No. 3, 267–277, 1984.
Toussaint, G. T. Computing largest empty circles with location constraints. International Journal of Computer & Information Sciences Vol. 12, No. 5, 347–358, 1983.
Cotting, D.; Gross, M. Interactive environment-aware display bubbles. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, 245–254, 2006.
Raskar, R.; van Baar, J.; Beardsley, P.; Willwacher, T.; Rao, S.; Forlines, C. iLamps: Geometrically aware and self-configuring projectors. ACM Transactions on Graphics Vol. 22, No. 3, 809–818, 2003.
Van Dam, A. User interfaces: Disappearing, dissolving, and evolving. Communications of the ACM Vol. 44, No. 3, 50–52, 2001.
McNaughton, J.; Crick, T.; Joyce-Gibbons, A.; Beauchamp, G.; Young, N.; Tan, E. Facilitating collaborative learning between two primary schools using large multi-touch devices. Journal of Computers in Education Vol. 4, No. 3, 307–320, 2017.
AlAgha, I.; Hatch, A.; Ma, L.; Burd, E. Towards a teacher-centric approach for multi-touch surfaces in classrooms. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, 187–196, 2010.
Kaltenbrunner, M.; Bencina, R. reacTIVision: A computer-vision framework for table-based tangible interaction. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction, 69–74, 2007.
Higgins, S.; Mercier, E.; Burd, L.; Joyce-Gibbons, A. Multi-touch tables and collaborative learning. British Journal of Educational Technology Vol. 43, No. 6, 1041–1054, 2012.
Jung, Y.; Kim, S.; Choi, B. Consumer valuation of the wearables: The case of smartwatches. Computers in Human Behavior Vol. 63, 899–905, 2016.
Ngo, D. C. L.; Teo, L. S.; Byrne, J. G. Formalising guidelines for the design of screen layouts. Displays Vol. 21, No. 1, 3–15, 2000.
Joyce-Gibbons, A.; McNaughton, J.; Tan, E.; Young, N.; Beauchamp, G.; Crick, T. SynergyNet into schools: Facilitating remote inter-group collaborative learning using multi-touch tables. In: Proceedings of the 12th International Conference on Computer Support Collaborative Learning, 2017.
This work was partially funded under the UK’s EPSRC/ERSC Teaching and Learning Research Programme (TLRP) SynergyNet project (RES-139-25-0400). The authors would also like to thank Professor Liz Burd and Dr. Andrew Hatch supervising the primary author’s master degree from which this work originally stems. The authors would also like to thank the members of the Durham University Technology Enhanced Learning Special Interest Group for supporting the redrafting of this manuscript. Source code for the technique’s implementation is available at https://doi.org/github.com/synergynet/synergynet2.1.
James McNaughton is a researcher at Durham University, UK, whose research interests include HCI, natural user interfaces, and augmented reality. His current work involves investigating the use of emerging interaction technologies in classroom environments.
Tom Crick is a professor of digital education & policy at Swansea University, UK. His research interests are interdisciplinary, including data science, intelligent systems, digital public services, software sustainability, and computer science education.
Shamus Smith is a senior lecturer in computer science at the University of Newcastle, Australia. His current research interests include touch-based technologies, mobile technology for augmented reality, and the reuse of gaming technology.
About this article
Cite this article
McNaughton, J., Crick, T. & Smith, S. Resolving display shape dependence issues on tabletops. Comp. Visual Media 4, 349–365 (2018). https://doi.org/10.1007/s41095-018-0124-x
- visual content management
- irregular displays
- screen design
- multi-touch surfaces
- tabletop displays
- ubiquitous computing