BrailleRing: The Shortest Long Braille-Display in the World – A Review of the State-of-the-Art and a New Approach
- 3.6k Downloads
After paying tribute to the ground-breaking invention of the tactile alphabet by Louis Braille, the paper describes the technological development of so-called refreshable Braille-Displays in significant steps from the late 1970s up till now. Despite quite many R&D efforts over these 40 years, all Braille-Displays presently available on the market in principle follow the same construction scheme as disclosed by Tetzlaff in 1981: Piezo-electric benders which move small pins up- and down . In order to overcome several drawbacks of the classical solutions, we propose and investigate a radically new approach, where different combinations of rigid tactile points are placed on the surfaces of rotating cuboids which are arranged inside of a rotating cylinder. The lower half of the cylinder resembles the reading area for the finger, whereas a group of a few actuators by rotating said cuboids produces new text-content in the upper half. This can result not only in a complete new way of mobile and reasonably priced Braille reading equipment but also in a revival of Braille worldwide.
KeywordsBraille Braille-Display Braille reader
When the French teacher, Louis Braille, developed a tactile system of dots to enable his blind students to read and write, he probably had little understanding of how his invention would positively impact literacy among blind people worldwide. With just six tactile dots, arranged in a 2 × 3 matrix, it became possible for blind people to gain literacy, do complicated math and read music notation, among many other things.
Today access to digitally provided text for blind and severely visually impaired people can be achieved in three ways: (i) Printing on thick paper to produce traditional hardcopy Braille, (ii) converting the text into synthetic speech (TTS, speech synthesizer) or (iii) using so called “refreshable Braille-Displays” from which the dot patterns of the Braille characters can be read with the fingertip.
It has to be mentioned that Braille is not a language but a font consisting of 63 different characters (for 6-dot Braille) or 255 characters (for 8-dot Braille) – not counting the “white space”. For this reason Braille can be used for any language on earth as well as for Mathematics, Chemistry, Music and much more. Thus, the requirements for Braille in general and for Braille-Displays in particular have to fulfil the demands of a global market and a “one-size-fits-all” strategy will not necessarily be the best one. Nevertheless, a dot-to-dot spacing of about 2.5 mm and a minimum force of 200 mN (for a single pin pressing against the skin of the fingertip) are readily agreed upon as quasi-standards. What is even more important, above all other mechanical considerations, is the fact that the best and most precise tactile stimulation can only be achieved by sliding the finger across the Braille reading area. Raising and lowering pins beneath a static resting fingertip will not do satisfactorily .
3 A Historic Review of Braille-Displays
Despite all R&D efforts of the past decades, up to now only two technologies for building refreshable Braille-Displays have found their way onto the market.
3.1 Electromagnetic Actuators (Solenoids)
3.2 Piezo-Electric Actuators
Piezo-electric actuators (bimorph benders) for Braille-Displays were introduced in 1979 by Tetzlaff  and still constitute the operating principle of all present commercially available Braille-Displays (Fig. 1, right).
4 The Search for Alternatives
Presently used technologies have some significant drawbacks such as low forces, relatively big volumes, considerable sensitivity to dirt and moisture and especially high manufacturing and service costs. The search for better alternatives was immediately undertaken. A literature search in 2018 for improvements and alternative technologies revealed about 1,000 patents which match “Braille + Display” and also at least the same number of research papers. The main strands of R&D deal with actuator technology, ways to reduce the number of actuators, or tactile stimulation methods which avoid actuators completely by direct stimulation of the fingertip’s skin.
4.1 Alternative Actuators for Forming Single Braille-Dots
Shape Memory Alloys (SMA) are materials which are able to “remember” their shape (length, bending) prior to a deformation and return to this shape after heating. Thus pairs of wires or coils of SMA can be used for moving a Braille-pin up and down. Material fatigue turned out to be the main problem .
Thermal processes like in a steam engine e.g. by heating a small volume of paraffin and using the resulting expansion to drive a pin were proposed by . Drawbacks are heat dissipation and low response times especially for the cooling phase.
Electro Active Polymers (EAP) change their shape when exposed to an electric field. Promising research is under way  but without significant breakthroughs.
Optical/chemical processes like the expansion of liquid crystal carbon nanotube (LC-CNT) when exposed to light stemming from single LEDs or from an entire display surface (tablet-PCs) are proposed by .
Micromachines (MEMS) which can be mass-produced by stereo-lithography are a promising approach to build thermal or ultrasound motors  able to move Braille-pins even to different heights, but not yet ready for commercialization.
Pneumatic or hydraulic drives: Here holes or other cavities are sealed with an elastic film. Raising the pressure in the cavity (by air- or fluid-pressure) will cause the film to form a bubble (blister) which will resemble a single Braille-dot . Often so called Electro-Rheological Fluids (ERF) are used which change from low to high viscosity when an electric field is applied. Thus flow and pressure for forming the “bubbles” can be controlled just by electric fields instead of expensive and complicated mechanical valves .
4.2 Direct Skin Stimulation – No Moving Parts
Electrocutaneous stimulation: The Braille-Display consists of a flat surface with an electrode (monopolar or better bipolar) for every Braille-dot. When the fingertip moves across this surface, active dots (electrodes) will send a well-defined electric current into the user’s skin, causing a feeling comparable to a mechanical stimulus. Unfortunately, many parameters (impedance, conductance and local sensitivity) are subject to temporal and spatial changes and reliable and comfortable stimulation could not easily be achieved .
Electromagnetic radiation by focusing infrared laser light to stimulate deeper skin areas is proposed in .
Electrostatic forces: Locally changing the adhesive shear-forces exerted on the sliding fingertip by applying (well isolated) dot-shaped electrostatic charges .
4.3 Reducing the Number of Actuators by Using Moving Elements
Dots on polygon surfaces: Instead of pins shifting up and down in a hole, these inventions place rigid Braille-dot patterns on the 3 or 8 lateral surfaces of three- or eight-sided prisms. Using eight-sided prisms turned out to be space consuming and unsuitable for 8-dot Braille (Fig. 2, right ). The use of three-sided prisms would allow for displaying dots with two different haptic characteristics – however, the problem of actuating every single dot cannot be avoided this way .
5 State-of-the-Art Display Configurations
5.1 Lines Ranging from 10 to 80 Characters – 6 and 8 Dot Braille
5.2 Multiline and Graphic (Matrix) Displays
Efforts to ease reading by displaying multiple lines or even an entire page of Braille reach back until 1981 with the invention of the “Rose Reader” . Commercialization, however, failed due to enormous complexity and costs. Even more recent developments like the “Hyperbraille” with a 120 × 60 pin matrix (Fig. 3, right) suffer from a price tag between EUR 45,000 and EUR 50,000 .
5.3 Static Single-Cell and Virtual Braille-Displays
To make Braille-Displays more affordable especially for developing countries, several researchers tried to reduce Braille-lines to just one single cell . As pins are raised and lowered below a static resting finger, the missing lateral movements lead to very low reading rates and complete loss of spatial orientation along the line of text.
To overcome the page or line orientation problem, virtual Braille-Displays have been designed, where one  or few  Braille-cells can be moved along a virtual line or across a virtual page showing the contents of the location thus addressed.
6 Striving for a New Approach – The “BrailleRing”
6.1 The Concept
Starting in 2014 with a basic idea for a robust, pocket-sized and reasonably priced Braille-Display, two students from the TU Wien were successful in proving the concept in their theses [25, 26] and in building an enlarged (2.5:1) prototype. Since then, the concept has been refined and pre-tested by blind users with simple mock-ups. A national patent  was granted, international applications are pending.
The BrailleRing strives not to replace existing Braille-lines, just as a “Kindle” cannot replace a PC. Moreover, it should become an alternative for those applications where existing technology is too bulky, too heavy, too delicate or too expensive.
6.3 Features and Benefits
The BrailleRing has a huge potential to significantly increase the mobility of Braille-Displays. The design allows building very compact devices where the line length is completely defined by the user. A later envisaged motor drive could provide even endless lines. The concept will also increase robustness, making the display more suitable for outdoor activities where humidity, sand and dust could be an issue. If built in such a way that the rotating ring can be changed easily, the user would be able to clean the device on his or her own. Different types of rings can be provided according to specific user preferences (e.g. different shaped or sized dots). It should be possible to build a device with much lower production and service costs than conventional piezo-electric Braille-Displays. Therefore, the BrailleRing should also be ideally suited for a market in developing countries.
7.1 Present State of the Development
Presently (March 2018), several mock-ups and simulation devices in real size exist or are under development. These aim to understand the reading experience inside a ring and demonstrate the final size of the device (mobile). As the Braille-dots are not formed by moving pins, the BrailleRing will offer much more degrees of freedom in haptic Braille representation. We intend to invest significant efforts to optimize the tactile user experience before the final design.
Another development goal for the second quarter of 2018 will be the search for optimized actuators that are able to turn the cuboids reliably independent of reading speed and direction while at the same time, minimizing the power consumption, which is crucial for a mobile device.
7.2 User Involvement and Trials
While the discovery of the mechanism with disruptive potential was serendipitous, a user-centric approach is what steers further development. Before IP protection, user involvement was on a nondisclosure basis, so only one single (blind) Braille expert was included from the outset. This was changed after the patent was granted and user studies started immediately. They can be described in two major phases:
First, through local news reports about the invention, a call for user-participation triggered 25 curious responses by blind people. Around half of them were invited to semi-structured interviews conducted in-person. Simple mockups were used to explore the new way of reading and the concept of a truly mobile Braille-Display.
In the second phase, the list of candidates for user studies grew to 50 by word-of-mouth. Here the user trials will focus on usability, ergonomics and especially on tests with different Braille pattern sizes and dimensions. This is crucial, as some first trial- users mentioned that the felt character to character distance is smaller when read from a concave surface. Afterwards, user studies with an adapted mockup will follow where reading speed and error rate compared to conventional flat Braille-Displays will be measured quantitatively.
- 1.Tetzlaff, J.F.: Patent US 4283 178 A (1981)Google Scholar
- 3.Lindenmüller, H.P., Schönherr, K.P.: Patent US 3987 438 (1975)Google Scholar
- 4.Anu, U.S., Thomas, A.M., Krishna, C.R., Akhil, A.N.S.K., Potti, S.S.: A low cost refreshable Braille display; a novel approach for the primary education of blind in India. Int. J. Adv. Technol. Eng. Sci. 5(4), 286–292 (2017)Google Scholar
- 5.Shah, S.: Patent WO 2017 203 536 A1 (2017)Google Scholar
- 6.Chen, X.: Patent WO 2016 197 928 A1 (2016)Google Scholar
- 7.Green, S.R., Gregory, B.J., Gupta, N.K.: Dynamic Braille display utilizing phase-change microactuators. In: Proceedings of IEEE Sensors, pp. 307–310 (2006)Google Scholar
- 8.Bar-Cohen, Y.: Refreshable Braille displays using EAP actuators. In: SPIE Smart Structures and Materials+Nondestructive Evaluation and Health Monitoring, vol. 7642, pp. 764206–764206-5 (2010)Google Scholar
- 11.Wilhelm, E., Schwarz, T., Jaworek, G., Voigt, A., Rapp, B.E.: Towards displaying graphics on a cheap, large-scale Braille display. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds.) ICCHP 2014. LNCS, vol. 8547, pp. 662–669. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-08596-8_102CrossRefGoogle Scholar
- 13.Liu, Z., Luo, Y., Cordero, J., Zhao, N., Shen, Y.: Finger-eye: a wearable text reading assistive system for the blind and visually impaired. In: 2016 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2016, pp. 123–128 (2016)Google Scholar
- 14.Yu, W.J., Brownell, A.A.: Patent US 2014 0022 162 Al (2014)Google Scholar
- 16.Shimamura, Y.: Patent EP 1 5222 983 A1 (2004)Google Scholar
- 17.Roberts, J.W.: Patent US 2002 0045 151 A1 (2002)Google Scholar
- 18.Al-Qudsi, M.: Patent US 2013 0203 022 A1 (2013)Google Scholar
- 19.Campos de Leon, G.M.: Patent US 9524 655 B1 (2016)Google Scholar
- 20.Ramstein, C.: Combining haptic and braille technologies: design issues and pilot study. In: Annual ACM Conference on Assistive technologies, pp. 37–44 (1996)Google Scholar
- 21.Rose, L., Rose, S.E.: Patent US 4 226 936 (1981)Google Scholar
- 22.Esteve, J.: Towards smart tactile tablets for the visually impaired persons. In: EPoSS Annual Forum (2011)Google Scholar
- 25.Treml, M.: Grobkonzeption und Steuerung eines Brailledisplays mit gruppierten Punkten. Diplomarbeit TU Wien (2016)Google Scholar
- 26.Busse, D.: Konstruktion eines Braille-Displays. Diplomarbeit TU Wien (2016)Google Scholar
- 27.Treml, M., Zagler, W., Busse, D.: Vorrichtung zur Darstellung von tastbaren Zeichen. Patent AT 518 530 A4 (2016)Google Scholar
<SimplePara><Emphasis Type="Bold">Open Access</Emphasis> This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.</SimplePara> <SimplePara>The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.</SimplePara>