Visualizing for the Non‐Visual: Enabling the Visually Impaired to Use Visualization

The majority of visualizations on the web are still stored as raster images, making them inaccessible to visually impaired users. We propose a deep‐neural‐network‐based approach that automatically recognizes key elements in a visualization, including a visualization type, graphical elements, labels, legends, and most importantly, the original data conveyed in the visualization. We leverage such extracted information to provide visually impaired people with the reading of the extracted information. Based on interviews with visually impaired users, we built a Google Chrome extension designed to work with screen reader software to automatically decode charts on a webpage using our pipeline. We compared the performance of the back‐end algorithm with existing methods and evaluated the utility using qualitative feedback from visually impaired users.     

Reading and writing mathematics: The MAVIS1 Project

One of the greatest challenges to the visually impaired student in science and mathematics disciplines is the reading and writing of complex mathematical equations or have convenient access to information based tools such as the world wide web. In research currently underway at New Mexico State University, tools are being built using logic programming to facilitate access to complex information in a variety of formats. On top of the logic based tools, new interfaces are being designed to permit more convenient access to information by our visually impaired students.     

AudioBrowser: a mobile browsable information access for the visually impaired

Although a large amount of research has been conducted on building interfaces for the visually impaired that allows users to read web pages and generate and access information on computers, little development addresses two problems faced by the blind users. First, sighted users can rapidly browse and select information they find useful, and second, sighted users can make much useful information portable through the recent proliferation of personal digital assistants (PDAs). These possibilities are not currently available for blind users. This paper describes an interface that has been built on a standard PDA and allows its user to browse the information stored on it through a combination of screen touches coupled with auditory feedback. The system also supports the storage and management of personal information so that addresses, music, directions, and other supportive information can be readily created and then accessed anytime and anywhere by the PDA user. The paper describes the system along with the related design choices and design rationale. A user study is also reported.     

Computer access for persons who are blind or visually impaired: human factors issues

Suitably adapted computers hold considerable potential for integrating people who are blind or visually impaired into the mainstream. The principal problems that preclude the achievement of this potential are human factors issues. These issues are discussed, and the problems presented by icon-based interfaces are reviewed. An argument is offered that these issues, which ostensibly pertain to the blind or visually impaired user, are fundamental issues confronting all users. There is reason to hope that the benefits of research into the human factors issues of people with vision impairments will also extend to the sighted user.     

An empirical investigation into the difficulties experienced by visually impaired Internet users

In this paper, an empirical based study is described which has been conducted to gain a deeper understanding of the challenges faced by the visually impaired community when accessing the Web. The study, involving 30 blind and partially sighted computer users, has identified navigation strategies, perceptions of page layout and graphics using assistive devices such as screen readers. Analysis of the data has revealed that current assistive technologies impose navigational constraints and provide limited information on web page layout. Conveying additional spatial information could enhance the exploration process for visually impaired Internet users. It could also assist the process of collaboration between blind and sighted users when performing web-based tasks. The findings from the survey have informed the development of a non-visual interface, which uses the benefits of multimodal technologies to present spatial and navigational cues to the user.     

Barriers common to mobile and disabled web users

World Wide Web accessibility and best practice audits and evaluations are becoming increasingly complicated, time consuming, and costly because of the increasing number of conformance criteria which need to be tested. In the case of web access by disabled users and mobile users, a number of commonalities have been identified in usage, which have been termed situationally-induced impairments; in effect the barriers experienced by mobile web users have been likened to those of visually disabled and motor impaired users. In this case, we became interested in understanding if it was possible to evaluate the problems of mobile web users in terms of the aggregation of barriers-to-access experienced by disabled users; and in this way attempt to reduce the need for the evaluation of the additional conformance criteria associated with mobile web best practice guidelines. We used the Barrier Walkthrough (BW) method as our analytical framework. Capable of being used to evaluate accessibility in both the disabled and mobile contexts, the BW method would also enable testing and aggregation of barriers across our target user groups.We tested 61 barriers across four user groups each over four pages with 19 experts and 57 non-experts focusing on the validity and reliability of our results. We found that 58% of the barrier types that were correctly found were identified as common between mobile and disabled users. Further, if our aggregated barriers alone were used to test for mobile conformance only four barrier types would be missed. Our results also showed that mobile users and low vision users have the most common barrier types, while low vision and motor impaired users experiencing similar rates of severity in the barriers they experienced. We conclude that the aggregated evaluation results for blind, low vision and motor impaired users can be used to approximate the evaluation results for mobile web users.     

Multiple spatial sounds in hierarchical menu navigation for visually impaired computer users

This paper describes a user study on the benefits and drawbacks of simultaneous spatial sounds in auditory interfaces for visually impaired and blind computer users. Two different auditory interfaces in spatial and non-spatial condition were proposed to represent the hierarchical menu structure of a simple word processing application. In the horizontal interface, the sound sources or the menu items were located in the horizontal plane on a virtual ring surrounding the user’s head, while the sound sources in the vertical interface were aligned one above the other in front of the user. In the vertical interface, the central pitch of the sound sources at different elevations was changed in order to improve the otherwise relatively low localization performance in the vertical dimension. The interaction with the interfaces was based on a standard computer keyboard for input and a pair of studio headphones for output. Twelve blind or visually impaired test subjects were asked to perform ten different word processing tasks within four experiment conditions. Task completion times, navigation performance, overall satisfaction and cognitive workload were evaluated. The initial hypothesis, i.e. that the spatial auditory interfaces with multiple simultaneous sounds should prove to be faster and more efficient than non-spatial ones, was not confirmed. On the contrary—spatial auditory interfaces proved to be significantly slower due to the high cognitive workload and temporal demand. The majority of users did in fact finish tasks with less navigation and key pressing; however, they required much more time. They reported the spatial auditory interfaces to be hard to use for a longer period of time due to the high temporal and mental demand, especially with regards to the comprehension of multiple simultaneous sounds. The comparison between the horizontal and vertical interface showed no significant differences between the two. It is important to point out that all participants were novice users of the system; therefore it is possible that the overall performance could change with a more extensive use of the interfaces and an increased number of trials or experiments sets. Our interviews with visually impaired and blind computer users showed that they are used to sharing their auditory channel in order to perform multiple simultaneous tasks such as listening to the radio, talking to somebody, using the computer, etc. As the perception of multiple simultaneous sounds requires the entire capacity of the auditory channel and total concentration of the listener, it does therefore not enable such multitasking.     

Ontology-assisted automatic precise information extractor for visually impaired inhabitants

As the internet grows rapidly, millions of web pages are being added on a daily basis. The extraction of precise information is becoming more and more difficult as the volume of data on the internet increases. Several search engines and information fetching tools are available on the internet, all of which claim to provide the best crawling facilities. For the most part, these search engines are keyword based. This poses a problem for visually impaired people who want to get the full use from online resources available to other users. Visually impaired users require special aid to get?along with any given computer system. Interface and content management are no exception, and special tools are required to facilitate the extraction of relevant information from the internet for visually impaired users. The HOIEV (Heavyweight Ontology Based Information Extraction for Visually impaired User) architecture provides a mechanism for highly precise information extraction using heavyweight ontology and built-in vocal command system for visually impaired internet users. Our prototype intelligent system not only integrates and communicates among different tools, such as voice command parsers, domain ontology extractors and short message engines, but also introduces an autonomous mechanism of information extraction (IE) using heavyweight ontology. In this research we designed domain specific heavyweight ontology using OWL 2 (Web Ontology Language 2) and for axiom writing we used PAL (Protégé Axiom Language). We introduced a novel autonomous mechanism for IE by developing prototype software. A series of experiments were designed for the testing and analysis of the performance of heavyweight ontology in general, and our information extraction prototype specifically.     

Developing Electronic Commerce Web Sites for the Visually Impaired

The visually impaired have unique demands for accessing E-commerce Web sites, and designing a site with which they can interact easily is a challenge for developers. This article presents a practical development methodology and guidelines for superior equal access multimedia electronic commerce interfaces for use on the World Wide Web.     

Municipal web sites accessibility and usability for blind users: preliminary results from a pilot study

Despite the existing regulations and standards at national and international level, web content is still difficult to use, if not completely unusable, for visually impaired people. This paper presents the evaluation results for three municipal web sites. A combined method, based on conformance review and expert review, was employed. Overall, the results reveal a low conformance to WCAG2 and many accessibility and usability problems. The content is not properly structured, and this reduces usability even for sighted user. The analysis of the evaluation data suggests that many accessibility barriers could be avoided by adopting a user-centered approach during web design.     

Assisting Visually Impaired People to Acquire Targets on a Large Wall-Mounted Display

Large displays have become ubiquitous in our everyday lives, but these displays are designed for sighted people.This paper addresses the need for visually impaired people to access targets on large wall-mounted displays. We developed an assistive interface which exploits mid-air gesture input and haptic feedback, and examined its potential for pointing and steering tasks in human computer interaction（HCI）. In two experiments, blind and blindfolded users performed target acquisition tasks using mid-air gestures and two different kinds of feedback（i.e., haptic feedback and audio feedback）. Our results show that participants perform faster in Fitts＇ law pointing tasks using the haptic feedback interface rather than the audio feedback interface. Furthermore, a regression analysis between movement time（MT） and the index of difficulty（ID）demonstrates that the Fitts＇ law model and the steering law model are both effective for the evaluation of assistive interfaces for the blind. Our work and findings will serve as an initial step to assist visually impaired people to easily access required information on large public displays using haptic interfaces.     

用户体验设计——网页界面设计的重中之重

国内目前的网页设计,大多以视觉效果作为网页界面设计的首要考量,因而容易忽视网页设计的可用性。而网页界面设计,不仅应当给使用者带来视觉上的愉悦,更应当很好地帮助用户浏览网页内容,引导用户操作以完成网页服务。转变设计师以视觉效果为首要考量的固有设计习惯,将用户体验作为设计的重点,才是设计出具有良好互动性的网页的开端。     

Evaluation of a university website’s usability for visually impaired students

Today websites are the tools most commonly used to access information. People with disabilities face difficulties accessing or using information, and the importance of website usability in their lives needs to be recognized. Visually impaired students need to be able to use university websites that inform them about the opportunities and events taking place on campus. This study aims to evaluate the usability of a university website by visually impaired students. In this research, six visually impaired students were interviewed. The assistive technologies they use, as well as the various web pages they wished to use unaided were identified. Following data collection, usability tests were conducted and satisfaction surveys were completed. The usability test was done with five visually impaired students. They were asked to think aloud while performing 11 tasks involving their university’s web pages, including the main page and the pages of student affairs, library and departments and then to accomplish these tasks. In this test, five tasks were not successfully completed by all students. According to the test results, finding final exam dates on the academic calendar posed major difficulties, and accessing the course schedule web page was the task that required the most time. The test results indicated the need for a search engine on each page, a text version for all pages, rearrangement of the web link sequences with tabs and more information about visuals. Suggestions related to the visually impaired students’ needs were offered.     

Iconic hyperlinks on e-commerce websites

The proper use of iconic interfaces reduces system complexity and helps users interact with systems more easily. However, due to carelessness, inadequate research, and the web's relatively short history, the icons used on web sites often are ambiguous. Because non-identifiable icons may convey meanings other than those intended, designers must consider whether icons are easily identifiable when creating web sites. In this study, visual icons used on e-business web sites were examined by population stereotypy and categorized into three groups: identifiable, medium, and vague. Representative icons from each group were tested by comparing selection performance in groups of student volunteers, with identifiable and medium icons improving performance. We found that only easily identifiable icons can reduce complexity and increase system usability.     

Developing a navigation aid for the frail and visually impaired

This paper describes the development of a new navigational aid for the frail, elderly, and visually impaired person. The users were involved both in the user requirements study and in the evaluation of different prototypes. The results show that the users were able to provide information on their current aid, the use situation, and their preference regarding different solutions, but they had difficulties to provide the detailed answers on technical solutions required by the technical development team. Further, prototype evaluations with users enabled the technical team to understand the users and their use situation.     

Web designers and web users: Influence of the ergonomic quality of the web site on the information search

Despite rapid growth in the number of web sites, there is still a significant number of ergonomic problems which hinder web users. Many studies focus on analysing cognitive processes and difficulties experienced by web users, but very few are interested in web designers’ difficulties or in comparing their respective activities. Towards this end, the two experimental studies presented in this article compare the strategies developed both by professional web designers and (novice vs. experienced) web users while searching for information on web sites of varying ergonomic quality. More precisely, we investigated whether web designers can effectively use their own strategies as web users when designing web sites. We presented a comparison of novice web users, experienced web users and professional web designers searching behavior and cognitive load when using ergonomic and non-ergonomic web sites. In addition, we asked web designers to predict the strategy used by novice web users. Based on the results obtained in the two experiments, we conclude that web designers are not able to predict strategies of novice users and do not behave like novice users. Consequently, ways for supporting web designers in developing a user-centered activity are necessary, and certain ways are suggested at the end of this article.     

AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface

In this paper we describe a prototype spatial audio user interface for a Global Positioning System (GPS). The interface is designed to allow mobile users to carry out location tasks while their eyes, hands or attention are otherwise engaged. Audio user interfaces for GPS have typically been designed to meet the needs of visually impaired users, and generally, though not exclusively, employ speech-audio. In contrast, our prototype system uses a simple form of non-speech, spatial audio. This paper analyses various candidate audio mappings for location and distance information. A variety of tasks, design considerations, design trade-offs and opportunities are considered. The findings from pilot empirical testing are reported. Finally, opportunities for improvements to the system and for future evaluation are explored.     

Evaluating interface layout for visually impaired and mobility-impaired users through simulation

The authors have developed a simulator to help with the design and evaluation of assistive interfaces. The simulator can predict possible interaction patterns when undertaking a task using a variety of input devices and estimate the time to complete the task in the presence of different disabilities. This paper presents a study to evaluate the simulator by considering a representative application of searching icons, which was being used by able-bodied, visually impaired and mobility-impaired people. The simulator predicted task completion times for all three groups with statistically significant accuracy. The simulator also predicted the effects of different interface designs on task completion time accurately. The simulator is used to develop inclusive digital TV interfaces. A case study is presented to investigate accessibility requirements of a representative digital TV interface.     

Understanding user interface needs of e-commerce web sites

With the growth in the number of web sites, users must choose among many alternative web sites and designers must face the challenge of keeping the user's duration. Web site design is an iterative process of fine-tuning to enhance user satisfaction. According to the hygiene–motivation theory, the emotions of satisfaction and dissatisfaction are caused by two different categories of characteristics. Lack of dissatisfaction does not mean satisfaction, and lack of satisfaction does not mean dissatisfaction. This study proposes a parsimonious and effective multidimensional evaluation tool: a max–min approach to combine the hygiene–motivation factors and thereby provide a strategy to compare the competitive position of different web sites. The interfaces of eight e-retailer web sites for computer and communication products were targeted for evaluation. Four hygiene factors (navigation, information display, ease of learning and response time) and five motivation factors (interaction with people, screen complexity, user empowerment, visual appearance and achievement) are measured. The evaluations on hygiene and motivation factors were transformed into max and min effectiveness scores using the proposed models. Three zones (zone of intolerance, zone of efficiency and zone of satisfaction) were described to illustrate the role of strategic planning of a site interface in shaping a competitive position among the observed web sites.     

Accessible smartphones for blind users: A case study for a wayfinding system

While progress on assistive technologies have been made, some blind users still face several problems opening and using basic functionalities when interacting with touch interfaces. Sometimes, people with visual impairments may also have problems navigating autonomously, without personal assistance, especially in unknown environments. This paper presents a complete solution to manage the basic functions of a smartphone and to guide users using a wayfinding application. This way, a blind user could go to work from his home in an autonomous way using an adaptable wayfinding application on his smartphone. The wayfinding application combines text, map, auditory and tactile feedback for providing the information. Eighteen visually impaired users tested the application. Preliminary results from this study show that blind people and limited vision users can effectively use the wayfinding application without help. The evaluation also confirms the usefulness of extending the vibration feedback to convey distance information as well as directional information. The validation was successful for iOS and Android devices.