Modeling the user state for context-aware spoken interaction in ambient assisted living

Ambient Assisted Living (AAL) systems must provide adapted services easily accessible by a wide variety of users. This can only be possible if the communication between the user and the system is carried out through an interface that is simple, rapid, effective, and robust. Natural language interfaces such as dialog systems fulfill these requisites, as they are based on a spoken conversation that resembles human communication. In this paper, we enhance systems interacting in AAL domains by means of incorporating context-aware conversational agents that consider the external context of the interaction and predict the user’s state. The user’s state is built on the basis of their emotional state and intention, and it is recognized by means of a module conceived as an intermediate phase between natural language understanding and dialog management in the architecture of the conversational agent. This prediction, carried out for each user turn in the dialog, makes it possible to adapt the system dynamically to the user’s needs. We have evaluated our proposal developing a context-aware system adapted to patients suffering from chronic pulmonary diseases, and provide a detailed discussion of the positive influence of our proposal in the success of the interaction, the information and services provided, as well as the perceived quality.     

Ubiquitous enterprise service adaptations based on contextual user behavior

Recent advances in mobile technologies and infrastructures have created the demand for ubiquitous access to enterprise services from mobile handheld devices. Further, with the invention of new interaction devices, the context in which the services are being used becomes an integral part of the activity carried out with the system. Traditional human–computer interface (HCI) theories are now inadequate for developing these context-aware applications, as we believe that the notion of context should be extended to different categories: computing contexts, user contexts, and physical contexts for ubiquitous computing. This demands a new paradigm for system requirements elicitation and design in order to make good use of such extended context information captured from mobile user behavior. Instead of redesigning or adapting existing enterprise services in an ad hoc manner, we introduce a methodology for the elicitation of context-aware adaptation requirements and the matching of context-awareness features to the target context by capability matching. For the implementation of such adaptations, we propose the use of three tiers of views: user interface views, data views, and process views. This approach centers on a novel notion of process views to ubiquitous service adaptation, where mobile users may execute a more concise version or modified procedure of the original process according to their behavior under different contexts. The process view also serves as the key mechanism for integrating user interface views and data views. Based on this model, we analyze the design and implementation issues of some common ubiquitous access situations and show how to adapt them systematically into a context-aware application by considering the requirements of a ubiquitous enterprise information system.

Utilizing contextual ontological user profiles for personalized recommendations

As users may have different needs in different situations and contexts, it is increasingly important to consider user context data when filtering information. In the field of web personalization and recommender systems, most of the studies have focused on the process of modelling user profiles and the personalization process in order to provide personalized services to the user, but not on contextualized services. Rather limited attention has been paid to investigate how to discover, model, exploit and integrate context information in personalization systems in a generic way. In this paper, we aim at providing a novel model to build, exploit and integrate context information with a web personalization system. A context-aware personalization system (CAPS) is developed which is able to model and build contextual and personalized ontological user profiles based on the user’s interests and context information. These profiles are then exploited in order to infer and provide contextual recommendations to users. The methods and system developed are evaluated through a user study which shows that considering context information in web personalization systems can provide more effective personalization services and offer better recommendations to users.     

Personalization and Context Management

Supporting the individual user in his working, learning, or information access is one of the main goals of user modeling. Personal or group user models make it possible to represent and use information about preferences, knowledge, abilities, emotional states, and many other characteristics of a user to adapt the user experience and support. Nowadays, the disappearing computer enables the user to access her information from a variety of personal and public displays and devices. To support a new generation of contextualized and personalized information and services, this paper addresses the problem of context management. Context management is a new approach to the design of context-aware systems in ubiquitous computing that combines personalization and contextualization. The presented framework for context management integrates user modeling and context modeling, which can benefit from each other and give rise to more valid models for personalized and contextualized information delivery. The paper will introduce a base framework and tools for designing context-aware applications and decompose the underlying framework into its foundational components. As two illustrative application cases, the paper discusses implementations of an intelligent advertisement board and an audio-augmented museum environment.     

Interactive Paper as a Mobile Client for a Multi-channel Web Information System

We describe how interactive paper can be used together with a multi-channel web information system to build a platform for experimenting with multi-modal context-aware mobile information services. As an application, we present a tourist guide for visitors to an international festival that was developed to investigate alternative modes of information delivery and interaction in mobile environments. The guide is based around a set of interactive paper documents—an event brochure, map and bookmark. The brochure and map are augmented with digital services by using a digital pen to activate links and a text-to-speech engine for information delivery. The digital pen is also used for data capture of event ratings and reviews. The bookmark provides access to advanced searches and ticket reservations. We describe the architecture and operation of the system, highlighting the challenges of extending a web information system to support both the generation of the paper documents and the interaction from these documents, alongside more traditional access channels. Finally, we discuss the range of context-aware interactions that is supported by our platform.     

Providing user context for mobile and social networking applications

The processing capabilities of mobile devices coupled with portable and wearable sensors provide the basis for new context-aware services and applications tailored to the user environment and daily activities. In this article, we describe the approach developed within the UPCASE project, which makes use of sensors available in the mobile device as well as sensors externally connected via Bluetooth to provide user contexts. We describe the system architecture from sensor data acquisition to feature extraction, context inference and the publication of context information in web-centered servers that support well-known social networking services. In the current prototype, context inference is based on decision trees to learn and to identify contexts dynamically at run-time, but the middleware allows the integration of different inference engines if necessary. Experimental results in a real-world setting suggest that the proposed solution is a promising approach to provide user context to local mobile applications as well as to network-level applications such as social networking services.     

iConAwa - An intelligent context-aware system

Context-awareness becomes an increasingly important concept in the development of mobile and ubiquitous systems. Applications and services, which run in these kinds of highly dynamic environments, should be aware of and adapt to their contexts. Context-aware applications improve and enrich people’s interactions with devices, computers and other people.In this paper, design and development of iConAwa, which is an intelligent context-aware multi-agent system proactively providing mobile users with context-aware information and services, is described. In iConAwa, mobile users can get information and services about nearby resources (attraction points) according to their context and also communicate with each other by exchanging messages. Context and point of interest ontologies are developed in OWL. Context and points of interest are modelled in a flexible and extensible way by the developed ontology models. Knowledge sharing and knowledge reuse are also provided by using these ontology models. iConAwa makes use of rule-based context reasoning which provides derivation of high level implicit context from low level explicit context. With this approach context reasoning is decoupled from the source code of the system. JADE agent development framework is used to develop the agents and Jena semantic web framework is used to manipulate ontologies and for rule based reasoning.     

Context data management: an architectural framework for context-aware services

Mobile devices are equipped with increasing processing power and sensing capabilities, and mobile services can benefit from these features to provide a more personalized and context-aware experience to final users. To efficiently collect and deliver context information, a proper architecture is required, where heterogeneous context information can be processed to provide higher-level context information, context data are represented uniformly, and applications can process context data with high-level queries. This paper fulfils this goal of interoperability and domain independence by defining a framework for context data management relying on open standards (XMPP and REST), acting as an enabler for third-party context-aware applications; other main novelties of our work are the definition of a ContextML for standard context data representation, and a Context Query Language (CQL) to access context information based on high-level data filtering.     

Adaptive interaction support in ambient-aware environments based on quality of context information

Ambient-aware environments are technologically augmented with myriad sensors, devices and other emerging services in order to support users. However, users find it complex in interacting with such environments due to the presence of numerous devices and services. In this situation, providing context-aware implicit or automatic interaction support may help reducing the cognitive load of the users and facilitate easy access of the available devices and services. However, due to the imprecision in context information, implicit interactions performed by the environment often leads to mis-automation. The result of such impaired implicitness causes distrust and dissatisfaction to the user. In order to address this issue, we propose a system that considers quality of information to dynamically adjust the level of implicit interaction and allows a system to operate in different modes such as full-automation, action suggestion, simple notification, or null action. We conduct experiment in a smart home scenario in order to elicit users’ acceptance and trust regarding the proposed system. Our experiment shows that dynamic and alternative mode of interaction not only increases the satisfaction of users but also helps to avoid distrust in automated actions carried out by the environment under varying contexts.     

Context-Aware Web Service Composition based on AI Planning

A web service is an application that is published on the web and can be discovered and used automatically. In many cases, a web service cannot provide the capability that the user has requested. Therefore, according to the user request, it should be possible to combine various services and produce a new composite service for the user request. Context is the information that can be used to characterize the situation of an entity. In this paper, we present our context model for web service composition and implement the newly proposed framework for context-aware web service composition and show how the newly proposed framework reduces the number of failures and composition time.     

A JESS-enabled context elicitation system for providing context-aware Web services

Providing context-aware Web services is an adaptive process of delivering contextually matched Web services to meet service requesters’ needs. We define the term “context” from two perspectives: one from service requesters; and the other from Web services. From the former perspective, context is defined as the surrounding environment affecting requesters’ services discovery and access, such as requesters’ preferences, locations, activities, and accessible network and devices. From the latter perspective, context is defined as the surrounding environment affecting Web services delivery and execution, such as networks and protocols for service binding, devices and platforms for service execution, and so on. This paper presents a Java Expert System Shell (JESS)-enabled context elicitation system featuring an ontology-based context model that formally describes and acquires contextual information pertaining to service requesters and Web services. Based on the context elicitation system, we present a context-aware services-oriented architecture for providing context-aware Web service request, publication, and discovery. Implementation details of the context elicitation system and the evaluation results of context-aware service provision are also reported.     

User needs for location-aware mobile services

Mobile contexts of use vary a lot, and may even be continuously changing during use. The context is much more than location, but its other elements are still difficult to identify or measure. Location information is becoming an integral part of different mobile devices. Current mobile services can be enhanced with location-aware features, thus providing the user with a smooth transition towards context-aware services. Potential application fields can be found in areas such as travel information, shopping, entertainment, event information and different mobile professions. This paper studies location-aware mobile services from the user's point of view. The paper draws conclusions about key issues related to user needs, based on user interviews, laboratory and field evaluations with users, and expert evaluations of location-aware services. The user needs are presented under five main themes: topical and comprehensive contents, smooth user interaction, personal and user-generated contents, seamless service entities and privacy issues.     

Preprocessing techniques for context recognition from accelerometer data

The ubiquity of communication devices such as smartphones has led to the emergence of context-aware services that are able to respond to specific user activities or contexts. These services allow communication providers to develop new, added-value services for a wide range of applications such as social networking, elderly care and near-emergency early warning systems. At the core of these services is the ability to detect specific physical settings or the context a user is in, using either internal or external sensors. For example, using built-in accelerometers, it is possible to determine whether a user is walking or running at a specific time of day. By correlating this knowledge with GPS data, it is possible to provide specific information services to users with similar daily routines. This article presents a survey of the techniques for extracting this activity information from raw accelerometer data. The techniques that can be implemented in mobile devices range from classical signal processing techniques such as FFT to contemporary string-based methods. We present experimental results to compare and evaluate the accuracy of the various techniques using real data sets collected from daily activities.     

A Context-Aware Infrastructure for Supporting Applications with Pen-Based Interaction

Pen-based user interfaces which leverage the affordances of the pen provide users with more flexibility and natural interaction.However,it is difficult to construct usable pen-based user interfaces because of the lack of support for their development.Toolkit-level support has been exploited to solve this problem,but this approach makes it hard to gain platform independence,easy maintenance and easy extension.In this paper a context-aware infrastructure is created,called WEAVER,to provide pen interaction services for both novel pen-based applcations and legacy GUI-based applications.WEAVER aims to support the pen as another standard interactive device along with the keyboard and mouse and present a high-level access interface to pen input.It emplolys application context to tailor its sevice to different applications.By modeling the application context and egistering the relevant action adapters,WEAVER can offer servicxes,such as gesture recognition,continuous handwriting and other fundamental ink manipulations,to appropriate applications.One of the distinct features of WEAVER is that off-the-shelf GUI-based software packages can be easily enhanced with pen interaction without modifying the existing code.In this paper,the architecture and components of WEAVER are described.In addition ,examples and feedbacks of its use are presented.     

XCML: providing context-aware language extensions for the specification of multi-device web applications

There is a vast body of research dealing with the development of context-aware web applications that can adapt to different user, platform and device contexts. However, the range and growing diversity of new devices poses two significant problems to existing approaches. First, many techniques require a number of additional design processes and modelling steps before applications can be adapted. Second, the new generation of platforms and technologies underlying these devices as well as upcoming web standards HTML5 and CSS3 have partly changed the way in which web applications are implemented nowadays and often limit the way in which they can be adapted. In this paper, we present XCML as one example of a domain-specific language that tightly integrates context-aware concepts and adaptivity mechanisms to support developers in the specification and implementation of multi-channel web applications. In contrast to most existing approaches, the objective is to use a more lightweight approach to adaptation that can dynamically evolve and support new requirements as they emerge. Our solution builds on versioning principles in combination with a context matching process based on a declaration of context-dependent variants of content, navigation and presentation in terms of context expressions at different levels of granularity that are specific to the application. To support this, a formally defined context algebra is used to parse and resolve the context expressions at compile-time and to determine the best-matching variants with respect to the client context at run-time. We present the language concepts and a possible execution environment together with context-aware developer tools for the authoring and testing of adaptive features and behaviour. We also report on two case studies: the first shows how our general approach allows for integration with existing technologies to leverage advanced context-aware mechanisms in applications developed using other platforms and languages and the second how existing web interfaces can be systematically extended to support new adaptation scenarios.     

基于uSD的情境感知系统设计与实现*

基于移动终端、情境感知以及无线传感器网络的结合需求,提出了一种应用于移动终端的情境感知系统,包括若干无线传感器节点、情境感知及处理终端、应用服务及执行装置等。针对移动电子设备一般都不具备接入无线传感器网络所需功能单元的现状,利用uSD概念为移动终端设计了一个ZigBee通信功能扩展模块,使移动终端能够从无线传感器网络中获取情境信息,并提供相应的情境感知和处理功能。最后,设计了包含位置等信息的情境感知服务演示系统,初步验证了基于uSD的情境感知系统在移动终端上应用的新颖性和有效性。     

Context-aware middleware for resource management in the wireless Internet

The provisioning of Web services over the wireless Internet introduces novel challenging issues for service design and implementation: from user/terminal mobility during service execution, to wide heterogeneity of portable access devices and unpredictable modifications in accessible resources. In this scenario, there are frequent provision-time changes in the context, defined as the logical set of accessible resources depending on client location, access terminal capabilities, and system/service management policies. The development of context-dependent services requires novel middlewares with full context visibility. We propose a middleware for context-aware resource management, called CARMEN, capable of supporting the automatic reconfiguration of wireless Internet services in response to context changes without any intervention on the service logic. CARMEN determines the context on the basis of metadata, which include declarative management policies and profiles for user preferences, terminal capabilities, and resource characteristics. In addition, CARMEN exploits the mobile agent technology to implement mobile middleware components that follow the provision-time movement of clients to support locally their customized service access. The proposed middleware shows how metadata and mobile agents can favor component reusability and automatic service reconfiguration, by reducing the development/ deployment complexity.     

Model-driven development of composite context-aware web applications

Context-awareness constitutes an essential aspect of services, especially when interaction with end-users is involved. In this paper a solution for the context-aware development of web applications consisting of web services is presented. The methodology proposes a model based approach and advocates in favour of a complete separation of the web application functionality from the context adaptation at all development phases (analysis, design, implementation). In essence, context adaptation takes place on top of and is transparent to the web application business functionality. Starting from UML diagrams of independent web services and respective UML context models, our approach can produce a functional composite context-aware application. At execution level this independence is maintained through an adaptation framework based on message interception.     

Usability study of ME2.0

Mobile context-aware applications execute in the background of hosts mobile devices. The applications source process and aggregate hosts’ contextual and personal information. This information is disclosed to ubiquitously pervasive services that adapt their offerings to individual preferences. Unfortunately, many developers continue to ignore the user perspective in context-aware application designs as they complicate their overall task and generate exponential requirements. The additional incorporation of privacy mechanisms in context-aware applications to safeguard context and personal information disclosures also complicates users’ tasks resulting to misconfigured or completely abandoned applications. Misconfigured applications give end-users a false assurance of privacy exposing them to comprising services. We present a usability study on Mobile Electronic Personality Version 2 a privacy enhanced context-aware mobile application for personalising ubiquitous services and adapting pervasive smart-spaces. We draw conclusions on key issues related to user needs, based on user interviews, surveys, prototypes and field evaluations. Users’ needs are evaluated against five themes, learn-ability, efficiency, memorability, errors, satisfaction and privacy contention. In addition, design layout preferences, privacy manageability and consensus design comprehension are also evaluated. Clarity of priorities in context-aware mobile applications shaped by usability studies effectively increases the acceptance of levels of potential users.     

情景感知的物联网服务推荐方法研究

如何根据用户实时的情景高效地为其推荐最为合适的物联网服务,已经成为当前服务计算与物联网领域亟需解决的关键问题之一。针对这一问题,提出了一种基于情景感知的物联网服务推荐方法。首先基于改进的FolkRank算法生成当前用户可用的物联网服务列表;之后,依据用户当前关键的情景构建用户情景信息模型,根据用户的情景模型从服务列表中筛选出最能满足用户当前情景的物联网服务。实验结果表明,所提出的情景感知的物联网服务推荐方法是可行的与有效的。