A generic natural language interface for task planning — application to a mobile robot

This paper presents a generic natural language interface that can be applied to the teleoperation of different kinds of complex interactive systems. Through this interface the operators can ask for simple actions or more complex tasks to be executed by the system. Complex tasks will be decomposed into simpler actions generating a network of actions whose execution will result in the accomplishment of the required task. As a practical application, the system has been applied to the teleoperation of a real mobile robot, allowing the operator to move the robot in a partially structured environment through natural language sentences.     

Towards incorporating personality into the design of an interface: a method for facilitating users’ interaction with the display

A novel user interface (UI) design based on the personality characteristics of users was proposed and examined in a mobile learning context. It was argued that differences in personality can stimulate individuals’ information processing capabilities in according to their display preferences, thus an effective visual experience. The personality characteristics and design preferences of 87 students (37 male, and 50 female) were collected and analysed. The clustering result (using k-means algorithm) revealed two potential personality types, which we call the neuroticism and the extra-conscientiousness groups. Then, an interface was designed for each personality group using the association rules method. An eye-tracking device was used to record changes in participants’ eye-pupil diameter and fixation duration, and thus examine their cognitive load and attention. The participants’ eye movement data of each group showed that their visual experience was significantly improved when using the interface designed based on their personality characteristics. This work offers some important design and practical insights to the human–computer interaction and the design of mobile device UI.     

A human–robot interface for mobile manipulator

This paper presents a remote manipulation method for mobile manipulator through operator’s gesture. In particular, a track mobile robot is equipped with a 4-DOF robot arm to grasp objects. Operator uses one hand to control both the motion of mobile robot and the posture of robot arm via scheme of gesture polysemy method which is put forward in this paper. A sensor called leap motion (LM), which can obtain the position and posture data of hand, is employed in this system. Two filters were employed to estimate the position and posture of human hand so as to reduce the inherent noise of the sensor. Kalman filter was used to estimate the position, and particle filter was used to estimate the orientation. The advantage of the proposed method is that it is feasible to control a mobile manipulator through just one hand using a LM sensor. The effectiveness of the proposed human–robot interface was verified in laboratory with a series of experiments. And the results indicate that the proposed human–robot interface is able to track the movements of operator’s hand with high accuracy. It is found that the system can be employed by a non-professional operator for robot teleoperation.     

Designing for mobile value co-creation—the case of travel counselling

This paper focuses on the development of a mobile service as extension of travel agencies’ sales channels, fundamentally driven by the notion of value co-creation. Design goals are directly linked to the understanding of travel counselling as practical value co-creation and to the concern to progress this understanding throughout the travel customer cycle. Customers as well as travel agencies benefit from a mobile service rooted in value co-creation. Mobile service applications which target a service provision which furthermore is in line with the core competency of a travel agency (advice-giving and continuously accompany the customer) are scarce. Taking this as a starting point, we propose a mobile service and system design which provides a travel customer with continuing support on the trip, suitable to complement a lively, ongoing customer-firm interaction which enables the co-creation of value, ultimately targeting increased customer retention and loyalty.     

Drawing evaluation into design for mobile computing: a case study of the Renwick Gallery’s Hand Held Education Project

We present a detailed case study of the design, launch, and evaluation of a handheld mobile computing guide for visitors to the Smithsonian American Art Museums Renwick Gallery. Of particular emphasis is integrating methods and tools of evaluation into the process of designing for new visitor experiences. Using a method of reflective design and evaluation incorporating interviews, surveys, observation, and clickstream analysis, we uncover assumptions and hypothesis for further testing. Finally, we discuss the cross-over between physical navigation of museum spaces and information navigation of online museum data.     

Accessibility of mobile applications for tourism—is equal access a reality?

Universal Access in the Information Society - With the increasing use of smartphones in people’s daily lives, mobile accessibility has become a key factor for them. Tourism is one of the...     

VoiceXML dialog system of the multimodal IP-Telephony—The application for voice ordering service

The development of IP-Telephony in recent years has been substantial. The improvement in voice quality, the integration between voice and data, especially the interaction with multimedia has made the 3G communication more promising. The value added services of Telephony techniques alleviate the dependence on the phone and provide a universal platform for the multimodal telephony applications. For example, the web-based application with VoiceXML has been developed to simplify the human–machine interaction because it takes the advantage of the speech-enabled services and makes the telephone-web access a reality. However, it is not cost-efficient to build voice only stand-alone web application and is more reasonable that voice interfaces should be retrofitted to be compatible or collaborate with the existing HTML or XML-based web applications. Therefore, this paper considers that the functionality of the web service should enable multiple access modalities so that users can perceive and interact with the site in either visual or speech response simultaneously. Under this principle, our research develops a prototype system of multimodal VoIP with the integrated web-based Mandarin dialog system which adopts automatic speech recognition (ASR), text-to-speech (TTS), VoiceXML browser, and VoIP technologies to create user friendly graphic user interface (GUI) and voice user interface (VUI). The users can use traditional telephone, cellular phone, or even VoIP connection via personal computer to interact with the VoiceXML server. In the mean time, the users browse the web and access the same content with common HTML or XML-based browser. The proposed system shows excellent performance and can be easily incorporated into voice ordering service for a wider accessibility.     

Naïve and experienced judgments of stimuluS—Response compatibility: implications for interface design

Many design guidelines encourage maintaining stimulus—response compatibility whenever possible. Payne found that naïve judgments for different stimulus—response (S—R) mappings were not very accurate, and suggested that designers may not be able to predict whether a particular display-control configuration will lead to better performance than another. Three experiments were conducted to determine whether naïve judgments for two-choice tasks in which stimuli and responses involve left—right spatial information are sensitive to (a) the influence of S—R mode relations and (b) pure versus mixed presentation of compatible and incompatible mappings. Initial performance judgments for these conditions were not very accurate, nor were those for four-choice tasks of the type studied by Payne, but subjects' estimates of performance improved with relatively little experience using the different S—R configurations.     

Will mobile video become the killer application for 3G mobile Internet? a model of media convergence acceptance

We propose and empirically test a model of user acceptance of digital media convergence. Integrating information system research, particularly the paradigm of task–technology fit and the platform–application dichotomy, and theories from media psychology and human–computer interaction, we theorize the fit between the content applications and the media platform as the key determinant of user evaluation and acceptance of digital media convergence. We empirically tested our theory in the context of mobile video entertainment services. Specifically, we hypothesize that both the duration of the video content (i.e., the characteristic of the content) and the attentional constraint of the mobile media platform (i.e., the characteristic of the media platform) jointly determine users’ attentional involvement (i.e., reflecting the fit) in the video content. Such involvement in turn influences users’ emotional enjoyment and satisfaction with the mobile video entertainment service. The empirical results support most of our hypotheses. Two key findings are: (1) in the case of media convergence, the attentional constraint of the target media platform significantly influences user experience during content delivery that may lead to the rejection of media convergence; and (2) the duration of the content interacts with both the attentional constraint of the media platform and the type of interruptions from the environment in determining attentional involvement and emotional enjoyment. We discuss the theoretical contributions and practical implications from our empirical findings.     

IP mobility issues for a mobile tele-robotic system—NEPWAK

The network-centric applied research team (N-CART) is continuing its work on an ambitious project known as the network-enabled powered wheelchair adaptor kit (NEPWAK). It introduces techniques for modifying and using powered wheelchairs as mobile platforms enabling communication and remote control. The wheelchair is equipped with a laptop computer, a CCD camera and a wireless network interface card (NIC) for 802.11b Internet access. The laptop acts as a server allowing network clients to gain access through a custom control interface on the chair. The remote controlling client receives a video and audio feed from the chair and sends control signals for maneuvering. While traveling, the chair is able to change its network association from one access point (AP) to another within the same subnet–the process is known as handoff. However, there is no inter-network handoff mechanism presently available in IP networks. This restricts the mobility of the wheelchair to within the coverage area of the subnet APs. This paper shows that the Internet engineering task force’s(IETF) network layer mobility protocol—Mobile IP[1] suffers from large handoff latencies that can hinder communication between the client and the wheelchair during handoff. Mobile IP alone is not a suffcient solution for a mobile telebotic system such as NEPWAK. An interesting solution to the handoff latency problem comes from the Fast-handover protocol[2] described in Section 4.4 with simulation results in Section 6.2.     

On the design of a reduced-order H ∞ controller for nonlinear sampled-data systems

In this paper, the problem of designing reduced-order H ^∞ controllers is studied for nonlinear continuous-time systems with sampled measurements. Using the concepts of dissipativity and differential game, sufficient conditions are derived for the existence of such reduced-order H ^∞ controllers. These conditions are expressed in terms of the solutions of two Hamilton–Jacobi inequalities, comprising a standard Hamilton–Jacobi inequality and a differential Hamilton–Jacobi inequality with jumps. These Hamilton–Jacobi inequalities are exactly those used in the construction of full-order H ^∞ controllers. When these conditions hold, state-space formulae are also given for such reduced-order controllers. An illustrative example is also included.     

Continuous simulation for design flood estimation—a review

Developments of systems for continuous simulation of streamflow are traced from manual systems in the middle of the 20th century to present day computer-based systems. A profusion of different systems from very simple to very complex are in use. Systems in operational use in UK/Europe, USA, South Africa and Australia are reviewed. There are several different runoff generation processes used in these systems such as saturation overland flow, subsurface stormflow and infiltration excess. These processes demonstrate different approaches to hydrological modelling in different areas. Other differences include the use of processes such as snowmelt and transmission loss that are significant in some areas but not in others. A feature of many modern systems is the use of stochastic rainfall generators that allow for very long streamflow sequences to be generated from which long-term flood statistics can be extracted. Only a few studies have compared continuous simulation with other methods of design flood estimation, and no significant studies have been made comparing different continuous simulation systems. Most of the available systems use recorded streamflow data for calibration and there is little information available for the use of continuous simulation systems on ungauged catchments.     

Effects of the design of mobile security notifications and mobile app usability on users’ security perceptions and continued use intention

The explosive global adoption of mobile applications (i.e., apps) has been fraught with security and privacy issues. App users typically have a poor understanding of information security; worse, they routinely ignore security notifications designed to increase security on apps. By considering both mobile app interface usability and mobile security notification (MSN) design, we investigate how security perceptions of apps are formed and how these perceptions influence users’ intentions to continue using apps. Accordingly, we designed and conducted a set of controlled survey experiments with 317 participants in different MSN interface scenarios by manipulating the types of MSN interfaces (i.e., high vs. low disruption), the context (hedonic vs. utilitarian scenarios), and the degree of MSN intrusiveness (high vs. low intrusiveness). We found that both app interface usability and the design of MSNs significantly impacted users’ perceived security, which, in turn, has a positive influence on users’ intention to continue using the app. In addition, we identified an important conundrum: disruptive MSNs—a common approach to delivering MSNs—irritate users and negatively influence their perceptions of app security. Thus, our results directly challenge current practice. If these results hold, current practice should shift away from MSNs that interrupt task performance.     

Naïve and experienced judgments of stimulus-response compatibility: implications for interface design

Many design guidelines encourage maintaining stimulus-response compatibility whenever possible. Payne found that na?ve judgments for different stimulus-response (S-R) mappings were not very accurate, and suggested that designers may not be able to predict whether a particular display-control configuration will lead to better performance than another. Three experiments were conducted to determine whether na?ve judgments for two-choice tasks in which stimuli and responses involve left-right spatial information are sensitive to (a) the influence of S-R mode relations and (b) pure versus mixed presentation of compatible and incompatible mappings. Initial performance judgments for these conditions were not very accurate, nor were those for four-choice tasks of the type studied by Payne, but subjects' estimates of performance improved with relatively little experience using the different S-R configurations.     

Hardware-in-the-loop simulation for the design and verification of the control system of a series–parallel hybrid electric city-bus

Hybrid electric buses have been a promising technology to dramatically lower fuel consumption and carbon dioxide (CO₂) emission, while energy management strategy (EMS) is a critical technology to the improvements in fuel economy for hybrid electric vehicles (HEVs). In this paper, a suboptimal EMS is developed for the real-time control of a series–parallel hybrid electric bus. It is then investigated and verified in a hardware-in-the-loop (HIL) simulation system constructed on PT-LABCAR, a commercial real-time simulator. First, an optimal EMS is obtained via iterative dynamic programming (IDP) by defining a cost function over a specific drive cycle to minimize fuel consumption, as well as to achieve zero battery state-of-charge (SOC) change and to avoid frequent clutch operation. The IDP method can lower the computational burden and improve the accuracy. Second, the suboptimal EMS for real-time control is developed by constructing an Elman neural network (NN) based on the aforementioned optimal EMS, so the real-time suboptimal EMS can be used in the vehicle control unit (VCU) of the hybrid bus. The real VCU is investigated and verified utilizing a HIL simulator in a virtual forward-facing HEV environment consisting of vehicle, driver and driving environment. The simulation results demonstrate that the proposed real-time suboptimal EMS by the neural network can coordinate the overall hybrid powertrain of the hybrid bus to optimize fuel economy over different drive cycles, and the given drive cycles can be tracked while sustaining the battery SOC level.     

Velocity planning for a mobile robot to track a moving target — a potential field approach

Potential field method has been widely used for mobile robot path planning, but mostly in a static environment where the target and the obstacles are stationary. The path planning result is normally the direction of the robot motion. In this paper, the potential field method is applied for both path and speed planning, or the velocity planning, for a mobile robot in a dynamic environment where the target and the obstacles are moving. The robot’s planned velocity is determined by relative velocities as well as relative positions among robot, obstacles and targets. The implementation factors such as maximum linear and angular speed of the robot are also considered. The proposed approach guarantees that the robot tracks the moving target while avoiding moving obstacles. Simulation studies are provided to verify the effectiveness of the proposed approach.     

Effect of disk support system dynamics on the stability of head–disk interface during an operational shock in a mobile hard disk drive

There has been a substantial increase in the demand of hard disk drives (HDD) for mobile electronic devices like laptop, camcorders, etc. Mobile HDDs are often subjected to harsh working environments and hence require higher shock resistance for better reliability performance. In this paper, we develop a model for the mobile disk drive to numerically investigate the dynamics of the head–disk interface (HDI) during an operational shock. The results show that the disk and its support system design have a strong influence on the shock resistance. This study can help improve the HDD components and air bearing design for a better shock performance.