Effects of Luminosity Contrast and Stimulus Duration on User Performance and Preference in a P300-Based Brain–Computer Interface

Brain–computer interfaces (BCI) have potential to provide a new channel of communication and control for people with severe motor disabilities. Although many empirical studies exist, few have specifically evaluated the impact of contributing factors on user performance and perception in BCI applications, especially for users with motor disabilities. This article reports the effects of luminosity contrast and stimulus duration on user performance and usage preference in a P300-based BCI application, P300 Speller. Ten participants with neuromuscular disabilities (amyotrophic lateral sclerosis and cerebral palsy) and 10 able-bodied participants were asked to spell six 10-character phrases in the P300 Speller. The overall accuracy was 76.5% for the able-bodied participants and 26.8% for participants with motor disabilities. The results showed that luminosity contrast and stimulus duration have significant effects on user performance. In addition, participants preferred high luminosity contrast with middle or short stimulus duration. However, these effects on user performance and preference varied for participants with and without motor disabilities. The results also indicated that although most participants with motor disabilities can establish BCI control, BCI illiteracy does exist. These results of the study should provide insights into the future research of the BCI systems, especially the real-world applicability of the BCI applications as a nonmuscular communication and control system for people with severe motor disabilities.     

A Rate Index for Augmentative and Alternative Communication

Individuals with severe speech disability can benefit from the use of augmentative and alternative communication (AAC) speech output assistive technology. The recent development of tools and methods for measuring AAC performance through the collection and analysis of language samples has advanced the clinical practice of this field. The definition of a new summary measure for characterizing performance of AAC systems in use is presented. The summary measure, here named rate index, is the average communication rate (in words per minute) divided by the selection rate (in bits per second) for the language sample. Thus the unit of measure for the rate index is words per bit. The rate index provides for the comparison of communication rates adjusted for differences in selection rates. Rate index comparisons can be made between individuals using similar or different systems or for one individual under different conditions. The clinical value of the rate index is the identification of opportunity for improved communication performance. Demonstrated rate index data also can serve as evidence to be used in the selection of AAC systems. The language sample data reported in this paper were collected using automated language activity monitoring (LAM).     

Using Personas to Support Augmentative Alternative Communication Device Design: A Validation and Evaluation Study

Interactive computing devices are increasingly being deployed to support individuals in improving and managing health, aging in place, and as assistive devices for those with functional limitations. Augmentative Alternative Communication (AAC) aids are devices that help individuals with speech impairments communicate. They are typically prescribed by clinicians (speech–language pathologists) based on a specific individual’s physical needs and disease classification. While personas have been used in the design of other consumer technologies, they have not been frequently deployed in the design of clinically oriented technologies, including AAC devices. Instead, a clinical/rehabilitation engineering approach to AAC design is typically used, focusing on the physical and symptomatic needs of a diverse group of individuals, and involving the consumer on the level of making feature recommendations and/or testing the technology near the end of the design and production process. To address this challenge, three personas of individuals with amyotrophic lateral sclerosis were developed, intended for use in AAC device design. This article presents results from two studies which evaluated the personas. In the first study, personas were validated using an online survey of eight speech–language pathologists, and interviews of seven individuals with ALS that were not involved in the development of personas. In the second study, AAC device designers were asked to assess the potential utility of the personas for AAC device design. Results showed that developed personas had validity in representing individuals with ALS and that the personas would be useful for AAC device designers. The methods used can be extended for validation and assessment of personas developed for other purposes.     

Augmentative and alternative communication devices for aphasia: the emerging role of “smart” mobile devices

Recent advances in mobile technology offer new directions for augmentative and alternative communication (AAC); however, it remains unclear whether they meet the needs of individuals with aphasia. This paper reports on research seeking to understand this changing landscape. A Web-based survey of aphasia-oriented clinicians helped illuminate device adoption trends. Observations of group therapy sessions featuring high-tech AAC use and focus groups with the clinicians from those sessions provided further nuance and insight into usage and adoption. It was shown that “smart” mobile devices are garnering acceptance as a promising platform for high-tech AAC; however, contrary to the authors’ expectations, these devices are not being paired with mobile versions of traditional picture dictionaries. Rather, clinicians reported appropriating generic applications to complement other (non-high-tech) communication strategies, suggesting new opportunities for design.     

Towards the improvement of Augmentative and Alternative Communication through the modelling of conversation

Non-speaking people who use Augmentative and Alternative Communication (AAC) systems typically have low rates of communication which reduces their ability to interact with others. Research and development continues in the quest to improve the effectiveness of AAC systems in terms of communication rate and impact. One strategy involves making the basic unit of communication an entire utterance, and designing the AAC system to make the storage, retrieval and production of utterances as easy and efficient as possible. Some approaches take this further and include texts, narratives and/or multimedia material for use in conversation. AAC systems operating in such a manner require a structure for containing and managing conversational material and supporting the production of output during conversation. Ideally such a structure should be modelled on the way actual conversations proceed. A number of partial models for this have been presented thus far. These are reviewed in the paper and an integrated model is then proposed that includes both the structure of a conversation and the way in which an AAC system might produce conversational output (e.g. utterances, texts, multimedia items or combinations of these). Modelling the process in this way gives a structure with which an AAC system can organize the support and guidance that it offers to the person using the system. The paper concludes with consideration of three areas of development for further investigation.     

Brain-Computer Interfacing for Intelligent Systems

Advances in cognitive neurosci- ence and brain-imaging technologies give us the unprecedented ability to interface directly with brain activity. These technologies let us monitor the physical processes in the brain that correspond with certain forms of thought. Driven by society's growing recognition of the needs of people with physical disabilities, researchers have begun using these technologies to build brain-computer interfaces (BCIs)communication systems that don't depend on the brain's normal output pathways of peripheral nerves and muscles. In BCIs, users explicitly manipulate their brain activity instead of motor movements to produce signals that control computers or communication devices. This research has extremely high impact, especially for disabled individuals who can't otherwise physically communicate.     

Focus groups as a requirements gathering method with adults with severe speech and physical impairments

Technological supports have the potential to greatly improve the quality of life and independence of adults with severe speech and physical impairments (SSPI). In particular, augmentative and alternative communication (AAC) devices can enable people with little or no speech to communicate with others. However, the rate of rejection of AAC devices is estimated to be as high as 53.3%. It is suggested that a major reason for this rejection is a lack of user-centred design in the development of these devices. As part of a wider study looking at involving adults with SSPI in all stages of user-centred design, this paper looks at the use of focus groups in requirements gathering with this user group.     

Event-related (De)synchronization (ERD/ERS) during motor imagery tasks: Implications for brain-computer interfaces

The primary aims of this research were to examine (1) mu and beta event-related desynchronization/synchronization (ERD/ERS) during motor imagery tasks with varying movement duration and (2) the potential impacts of movement duration on ERD/ERS patterns. Motor imagery tasks included brief and continuous imagined hand movements. During an imagery task, participants imagined an indicated movement for 1 s (i.e., brief movement imagery) or 5 s (i.e., continuous movement imagery). The results of the study support (1) that mu and beta ERD/ERS patterns are elicited during imagined hand movements and (2) that movement duration affects ERS and does not affect ERD patterns, during motor movement imagery. Additionally, brief movement imagery had a greater impact on mu and beta ERD; continuous movement imagery had a greater impact on mu and beta ERS. This research will be useful for designing future brain-computer interfaces as it provides valuable insight into the dynamics of electroencephalographic (EEG) oscillatory changes during motor imagery tasks with varying movement duration.

Relevance to industry

: Brain-computer interfaces (BCIs) have gained considerable interests by both research and industry communities who want to improve the quality of life for those who suffer from severe motor disabilities, such as amyotrophic lateral sclerosis (ALS), brainstem stroke, and cerebral palsy (CP). The results of this study should be applied to EEG-based BCI system design in order to enhance accuracy and classification performance for BCI system control.     

Developing a limb repositioning robotic interface for persons with severe physical disabilities

Limb repositioning is necessary for individuals with severe physical disabilities to sustain muscle strength and prevent pressure sores. As robotic technologies become ubiquitous, these tools offer promise to support the repositioning process. However, research has yet to focus on ways in which individuals with severe physical disabilities can control robots for these tasks. This paper presents a study that examines the needs and attitudes of potential users with physical disabilities to control a robotic aid for limb repositioning. Subjects expressed interest in using brain–computer interface (BCI) and speech recognition technologies for purposes of executing robotic tasks. The performance of four subjects controlling arm movements on an avatar through the keyboard, mouse, BCI, and Dragon NaturallySpeaking speech recognition was evaluated. Although BCI and speech technologies may limit physical fatigue, more challenges were faced using BCI and speech conditions compared to the keyboard and mouse. This research promotes accessibility into mainstream robotic technologies and represents the first step in the development of a robotic prototype using a BCI and speech recognition technologies for limb repositioning.     

A ‘sweet spot’ change strategy for a least developed country: leveraging e-Government in Bangladesh

Information systems have the potential to improve societal conditions in developing countries, and yet design theory to inform interventions to encourage uptake and use of these systems is sparse. This paper reports on an action design research project that addressed the problem of limited adoption of e-Government in Bangladesh. Inadequate knowledge of the nature of e-Government systems had been identified as an underlying cause of many other problems in this ‘wicked’ problem context. The project aimed to reduce knowledge deficiencies among key decision makers through activities that included the delivery of a custom-made training program and a handbook targeted at senior government officers. The project had modest resources and yet yielded significant outcomes. Critical reflection established a number of design principles for a ‘sweet spot change strategy’ for interventions of this type, with the most important principle being to first identify a ‘sweet spot’, a point of maximum leverage, and then to act on it.     

SymbolChat: A flexible picture-based communication platform for users with intellectual disabilities

Persons with intellectual disabilities benefit from participating in the modern information society, especially the World Wide Web, social media and Internet-mediated communication services. Although several computer-based prototypes and commercial systems have been introduced for accessible in-person communication, currently few applications and services exist to support synchronous remote communication for this user group. We introduce SymbolChat, a software platform that supports the creation of multimodal communication applications utilizing picture-based instant messaging. End users and their support personnel can customize the input and output features of the application based on their individual needs and abilities. The interaction is based on touchscreen input and speech output using speech synthesis technology. The SymbolChat platform was developed together with the prospective end users and practitioners in the field of special needs care.We evaluated the prototype application in a field study with nine users with varying degrees of intellectual and other disabilities. The results clearly indicate that the participants were able to express themselves in spontaneous communication using a large-scale picture-based vocabulary (around 2000 symbols) even without prior training in the use of symbols. This finding was supported in the constructive feedback gathered from professionals working in the area. We also successfully applied methodology from other settings, such as child-computer interaction to evaluate interaction in this challenging context.Overall, the results show that social inclusion for people with intellectual disabilities can be improved with customizable communication tools. The implemented communication platform forms a solid basis for further improvements and new communication services. In addition, we found that users with motor impairments would greatly benefit from alternative input and output methods for symbol browsing and selection.     

A TRIZ-inspired knowledge-driven approach for user-centric smart product-service system: A case study on intelligent test tube rack design

With the advancement of information and communication technologies, smart product-service system (PSS) has attracted increasing research attention to integrate diverse providers/stakeholders and deliver value-added services. Many studies have thusly been conducted to design and develop the smart PSS, while i) how to identify multi-source requirements through reviewing the entire service interaction cycle, ii) how to define and deduce the innovative smart connected products (SCPs) features under contradictory interests, and iii) how to specify the functional and data service configuration solutions are still unclear. To tackle these problems, a knowledge-driven approach was introduced to better organize the multi-source design knowledge and deduce service recommendations for personalized user demands. Specifically, a user journey map-based method was proposed for knowledge elicitation of the specific user demands. To organize the user knowledge for better understanding, hierarchical personalized user requirements (PURs) analytics were proposed to quantitively transfer PURs into proper design engineering parameters. To inspire the problem-solving logic for design solution generation, TRIZ inventive principles were retrieved and referred to. With the generated design concept, the service logic diagrams were structured to define the personalized service content of SCPs. Having the service logic and SCPs, the overall service network of the user-centric smart PSS can be outlined. The proposed approach was demonstrated and validated in the digital health area via a case study on smart test tube rack (STTR) design, and it was validated from an economic feasibility perspective. It showed that the STTR was promising to reduce manual work, improve the nurses' performance, and enhance patients’ medical experience. Furthermore, it was suggested that the proposed approach can effectively guide the innovative SCPs creation in a straightforward and instructive manner, and is promising to process the service solution deduction and improve the efficiency of service creation in real practice.     

Towards consistent modes of e‐health implementation: structurational analysis of a telecare programme's limited success

Telecare is the use of information and communication systems to facilitate care delivery to individuals in their homes. Although the expectations of telecare are high, its implementation has proved complex. This case study demonstrates this complexity through a structurational analysis of a telecare implementation process. The paper shows how structuration concepts enable a combined analysis of actors' interactions with a technology and of the interaction among these actors from different institutional contexts. In this example, fragmented multi‐actor agency induced an inconsistent implementation mode, leading to unsuccessful telecare appropriation. This paper concludes with a preliminary proposal for more consistent telecare implementation modes. These modes may better support the actors' reflexive monitoring and dialogue and inform further research.     

Rehabilitation with Brain-Computer Interface Systems

BCI systems let users convert thoughts into actions that do not involve voluntary muscle movement. The systems offer a new means of communication for those with paralysis or severe neuromuscular disorders. BCI technology is a relatively new, fast-growing field of research and applications with the potential to improve the quality of life in severely disabled people. To date, several BCI prototypes exist, but most work only in a laboratory environment. Before a BCI can be used for communication and control at home, research must solve several problems. An important next step is to establish protocols for easily setting up and using BCI systems in a practical environment. Many features, such as electrode positions and frequency components, must be automatically selectable for particular motor imagery. The system must use the fewest number of recording electrodes possible, striving for the optimal single EEG channel. Finally, training time must decrease, perhaps through game-like feedback and automatic detection of artifacts, such as uncontrolled muscle activity. With these improvements, which are on the horizon, we expect to see practical BCI systems for a wide range of users and applications.     

The significance of the Culture Based Model in designing culturally aware tutoring systems

Designing for culture through intelligent tutoring systems is on the rise. The needs of military personnel to communicate and understand cultures other than their own in deployments, missions, and work-related assignments have strongly encouraged the creation of culturally aware tutoring systems (CATS) that teach about other cultures. This paper critically analyzes three systems (i.e., ELECT-BiLAT, Tactical Iraqi, and VECTOR) and the frameworks that guided the design and development process. The examination reveals that there is a need for comprehensive guidelines to build CATS. Therefore, the Culture Based Model is offered as a framework to guide the design of culture-based information and communication technologies.     

Human language technology and communicative disabilities: requirements and possibilities for the future

For some years now, the Nederlandse Taalunie (Dutch Language Union) has been active in promoting the development of human language technology (HLT) applications for speakers of Dutch with communicative disabilities. The reason is that HLT products and services may enable them to improve their communication skills and verbal autonomy. We sought to identify a minimum common set of HLT resources that is required to develop tools for a wide range of communication disabilities. In order to reach this goal, we investigated the specific needs of communicatively disabled people and related these needs to the underlying HLT software components. By analysing the availability and quality of these essential HLT resources, we were able to identify which of the crucial elements need further research and development to become usable for developing applications for communicatively disabled speakers of Dutch. The results obtained in the current survey can be used to inform policy institutions on how they can stimulate the development of HLT resources for this target group. In the current survey results were obtained for Dutch, but a similar approach can also be applied to other languages.     

Combining ethnography and object-orientation for mobile interaction design: Contextual richness and abstract models

There has been a lot of interest in ethnography within human–computer interaction over the last two decades, and its relevance within systems development is today beyond question. However, one of the challenges reported is that ethnography generates findings and knowledge with such contextual richness that it can be hard to transfer into system design. In the light of recent years' push for the use of ethnography within the area of mobile human–computer interaction, this challenge has resurfaced and is of renewed importance to the research field. In this article we describe an interdisciplinary combination of ethnography with a structured software engineering method supporting the transition from collected data to design and implementation. We explore this combination through two case studies of mobile system development for supporting distributed work activities within industrial process control. We show that when developing mobile systems ethnographic data is a highly valuable source of input for developing object-oriented models by providing contextual richness, and that in turn, objected-oriented analysis is a highly valuable method for working with ethnographic field data in systems development by supporting the creation of abstract models. Combining the two, we have a method where ethnographic field studies inform core system design.     

Moving towards inclusive design guidelines for socially and ethically aware HCI

Most people acknowledge that personal computers have enormously enhanced the autonomy and communication capacity of people with special needs. The key factor for accessibility to these opportunities is the adequate design of the user interface which, consequently, has a high impact on the social lives of users with disabilities.The design of universally accessible interfaces has a positive effect over the socialisation of people with disabilities. People with sensory disabilities can profit from computers as a way of personal direct and remote communication. Personal computers can also assist people with severe motor impairments to manipulate their environment and to enhance their mobility by means of, for example, smart wheelchairs. In this way they can become more socially active and productive. Accessible interfaces have become so indispensable for personal autonomy and social inclusion that in several countries special legislation protects people from ‘digital exclusion’.To apply this legislation, inexperienced HCI designers can experience difficulties. They would greatly benefit from inclusive design guidelines in order to be able to implement the ‘design for all’ philosophy. In addition, they need clear criteria to avoid negative social and ethical impact on users. This paper analyses the benefits of the use of inclusive design guidelines in order to facilitate a universal design focus so that social exclusion is avoided. In addition, the need for ethical and social guidelines in order to avoid undesirable side effects for users is discussed. Finally, some preliminary examples of socially and ethically aware guidelines are proposed.     

Orthogonally persistent object systems

Persistent Application Systems (PASs) are of increasing social and economic importance. They have the potential to be long-lived, concurrently accessed, and consist of large bodies of data and programs. Typical examples of PASs are CAD/CAM systems, office automation, CASE tools, software engineering environments, and patient-care support systems in hospitals. Orthogonally persistent object systems are intended to provide improved support for the design, construction, maintenance, and operation of PASs. Persistence abstraction allows the creation and manipulation of data in a manner, that is independent of its lifetime, thereby integrating the database view of information with the programming language view. This yields a number of advantages in terms of orthogonal design and programmer productivity which are beneficial for PASs. Design principles have been proposed for persistent systems. By following these principles, languages that provide persistence as a basic abstraction have been developed. In this paper, the motivation for orthogonal persistence is reviewed along with the above mentioned design principles. The concepts for integrating programming languages and databases through the persistence abstraction, and their benefits, are given. The technology to support persistence, the achievements, and future directions of persistence research are then discussed.