Generating American Sign Language animation: overcoming misconceptions and technical challenges

Misconceptions about the English literacy rates of deaf Americans, the linguistic structure of American Sign Language (ASL), and the suitability of traditional machine translation (MT) technology to ASL have slowed the development of English-to-ASL MT systems for use in accessibility applications. This article traces the progress of a new English-to-ASL MT project targeted to translating texts important for literacy and user-interface applications. These texts include ASL phenomena called “classifier predicates.” Challenges in producing classifier predicates, novel solutions to these challenges, and applications of this technology to the design of user-interfaces accessible to deaf users will be discussed.     

Technology for supporting web information search and learning in Sign Language

Sign Languages (SL) are underrepresented in the digital world, which contributes to the digital divide for the Deaf Community. In this paper, our goal is twofold: (1) to review the implications of current SL generation technologies for two key user web tasks, information search and learning and (2) to propose a taxonomy of the technical and functional dimensions for categorizing those technologies. The review reveals that although contents can currently be portrayed in SL by means of videos of human signers or avatars, the debate about how bilingual (text and SL) versus SL-only websites affect signers’ comprehension of hypertext content emerges as an unresolved issue in need of further empirical research. The taxonomy highlights that videos of human signers are ecological but require a high-cost group of experts to perform text to SL translations, video editing and web uploading. Avatar technology, generally associated with automatic text-SL translators, reduces bandwidth requirements and human resources but it lacks reliability. The insights gained through this review may enable designers, educators or users to select the technology that best suits their goals.     

How level and type of deafness affect user perception of multimedia video clips

Our research investigates the impact that hearing has on the perception of multimedia, with and without captions, by discussing how hearing loss, captions and deafness type affect user quality of perception (QoP). QoP encompasses both the users level of satisfaction and their ability to assimilate informational content of multimedia.Experimental results show that hearing has a significant effect on participants ability to assimilate information, independent of video type or use of captions. It is shown that captioned video does not necessarily provide deaf users with a greater level of information but changes user QoP, providing a greater level of video contextualisation.     

A comparative study of mobile map displays in a geographic orientation task

In an ergonomic experiment, different mobile map displays were compared in a simulated geographical orientation task. Subjects had to cross mazes while the corresponding maps were presented on a hand-held display, two helmet-mounted displays (a retinal scanning and a liquid crystal display) or on paper. The simulated mazes were projected on a backlit screen and the subjects could cross them using a joystick. The displays were compared with regard to subjects' speed when crossing the mazes, experienced task difficulty, visual fatigue and simulator sickness. The results show that speed was lowest with the paper map and experienced task difficulty was highest, whereas no significant differences were found between the electronic displays. Visual fatigue and simulator sickness were low and no significant differences were observed between all displays. The conclusion is drawn that all electronic map displays can be used for short time periods (15 – 30 minutes); however, long term effects have to be analysed in future experimental studies.     

Improving deaf users' accessibility in hypertext information retrieval: are graphical interfaces useful for them?

This paper explores the effect of substituting textual links for graphical ones on the performance of deaf signers in hypertext information retrieval (HIR). Both deaf and hearing users found more targets, were faster and became less disoriented in the verbal hypertext interface than in the graphical one. Deaf users were outperformed by hearing users in all conditions except in short paths with the graphical interface. The results and its applied consequences, which would be also relevant to other users with similar problems than those of deaf signers (elderly people, people with dyslexia, people navigating in a website using a foreign language or people with low literacy) are discussed in relation to the CoLiDeS model of web interaction (Kitajima et al. 2000) and to the overgeneralisation of 'Picture superiority effect' (Nelson et al. 1976).