Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents

Building a collaborative trusting relationship with users is crucial in a wide range of applications, such as advice-giving or financial transactions, and some minimal degree of cooperativeness is required in all applications to even initiate and maintain an interaction with a user. Despite the importance of this aspect of human–human relationships, few intelligent systems have tried to build user models of trust, credibility, or other similar interpersonal variables, or to influence these variables during interaction with users. Humans use a variety of kinds of social language, including small talk, to establish collaborative trusting interpersonal relationships. We argue that such strategies can also be used by intelligent agents, and that embodied conversational agents are ideally suited for this task given the myriad multimodal cues available to them for managing conversation. In this article we describe a model of the relationship between social language and interpersonal relationships, a new kind of discourse planner that is capable of generating social language to achieve interpersonal goals, and an actual implementation in an embodied conversational agent. We discuss an evaluation of our system in which the use of social language was demonstrated to have a significant effect on users’ perceptions of the agent’s knowledgableness and ability to engage users, and on their trust, credibility, and how well they felt the system knew them, for users manifesting particular personality traits.This revised version was published online in July 2005 with corrections to the author name Bickmore.     

oDect: an RFID‐based object detection API to support applications development on mobile devices

The RFID technology is becoming ever more popular in the development of ubiquitous computing applications. A full exploitation of the RFID potential requires the study and implementation of human–computer interaction (HCI) modalities to be able to support wide usability by the target audience. This implies the need for programming methodologies specifically dedicated to support the easy and efficient prototyping of applications to have feedback from early tests with users. On the basis of our field‐working experience, we have designed oDect, a high‐level language and platform‐independent application programming interface (API), ad hoc designed to meet the needs of typical applications for mobile devices (smart phones and PDAs). oDect aims at allowing application developers to create their prototypes focusing on the needs of the final users, without having to care about the low‐level software that interacts with the RFID hardware. Further, in an end‐user developing (EUD) approach, oDect provides specific support for the application end‐user herself to cope with typical problems of RFID applications in detecting objects. We describe in detail the features of the API and discuss the findings of a test with four programmers, where we analyse and evaluate the use of the API in four sample applications. We also present results of an end‐user test, which investigated strengths and weaknesses of the territorial agenda (TA) concept. The TA is an RFID‐based citizen guide that aids—through time‐ and location‐based reminders—users in their daily activities in a city. The TA directly exploits EUD features of oDect, in particular concerning the possibility of linking detected objects with custom actions. Copyright © 2008 John Wiley & Sons, Ltd.     

Human–battery interaction on mobile phones

Mobile phone users have to deal with limited battery lifetime through a reciprocal process we call human–battery interaction. We conducted three user studies in order to understand human–battery interaction and discover the problems in existing designs that prevent users from effectively dealing with the limited battery lifetime. The studies include a large-scale international survey, two long-term field trials including quantitative battery logging and qualitative inquiries, and structured interviews with twenty additional mobile phone users. We evaluated various aspects of human–battery interaction, including charging behavior, battery indicators, user interfaces for power-saving settings, user knowledge, and user reaction. We find that mobile phone users can be categorized into two types regarding human–battery interaction and often have inadequate knowledge regarding phone power characteristics. We provide qualitative and quantitative evidence that problems in state-of-the-art user interfaces have led to under-utilized power-saving settings, under-utilized battery energy, and dissatisfied users. Our findings provide insights into improving mobile phone design for users to effectively deal with the limited battery lifetime. Our work is the first to systematically address human–battery interaction on mobile phones and is complementary to the extensive research on energy-efficient design for a longer battery lifetime.     

The role of social interaction on users motivation to exercise: A persuasive web framework to enhance the self-management of a healthy lifestyle

The current research guidelines of the European community suggest the importance of the development of systems that help users manage their health themselves. The increasing amount of communication technologies and devices from which users can access information, and the possibility to interact through social media channels, play an important role in this scenario. Based on these considerations, in this paper we present an innovative persuasive web application, designed both to exploit social networking sites and to cooperate with a mobile application that already operates in the e-health and motivational domains. In particular, the innovative aspects introduced by the web application are the possibility to access also from a web browser some features previously available only through a mobile application and a more direct and user-friendly integration of social network sites. Indeed, thanks to an extensive interaction with the Facebook social network, users are allowed to share their experience with the application. This generates a strong social influence effect, which inspires and motivates other users to improve their exercising activity. Experimental results put in evidence that our web application, also thanks to social interactions, is favoring an enhancement of users’ motivation to a more active lifestyle. This is mainly due to its capability to have an impact on the other users thanks to the posts generated on the Facebook social network.     

Needs identification methodology for inclusive design

Identification of user needs is an essential phase in the early stages of every design project. Many needs identification methodologies are described in the literature. When targeting users with special needs, the task becomes more challenging for different reasons (difficulty of retrieving information, performing prototype testing, etc.). This article presents a novel methodology, Needs Identification Methodology for Inclusive Design (NIMID), that guides the process of needs identification in the inclusive design scenario considering users’ physical, sensorial and cognitive capabilities. NIMID is grounded in Abowd and Beale's human–computer interaction framework and uses WHO's International Classification of Functionalities as the taxonomy that provides a common language. We exemplify the application of the methodology in the design of a smart oven for elderly people. We also compare NIMID with other methodologies evidencing its strong points: universality (common international classification of functioning language), systematicity (clearly defined phases and outcomes) and rationality (grounded in well-established interaction theory).     

Exception handling in the spreadsheet paradigm

Exception handling is widely regarded as a necessity in programming languages today and almost every programming language currently used for professional software development supports some form of it. However, spreadsheet systems, which may be the most widely used type of “programming language” today in terms of number of users using it to create “programs” (spreadsheets), have traditionally had only extremely limited support for exception handling. Spreadsheet system users range from end users to professional programmers and this wide range suggests that an approach to exception handling for spreadsheet systems needs to be compatible with the equational reasoning model of spreadsheet formulas, yet feature expressive power comparable to that found in other programming languages. We present an approach to exception handling for spreadsheet system users that is aimed at this goal. Some of the features of the approach are new; others are not new, but their effects on the programming language properties of spreadsheet systems have not been discussed before in the literature. We explore these properties, offer our solutions to problems that arise with these properties, and compare the functionality of the approach with that of exception handling approaches in other languages     

Nenek: a cloud-based collaboration platform for the management of Amerindian language resources

This article presents Nenek: A cloud-based collaboration platform for language documentation of underresourced languages. Nenek is based on a crowdsourcing scheme that supports native speakers, indigenous associations, government agencies and researchers in the creation of virtual communities of minority language speakers on the Internet. Nenek includes a set of web tools that enables users to work collaboratively on language documentation tasks, build lexicographic assets and produce new language resources. This platform includes a three-stage management model to control the acquisition of existent language resources, the manufacturing of new resources, as well as their distribution within the virtual community and to the general public. In the acquisition stage, existent language resources are either automatically extracted from the web by a crawler or received through donations from users who participate in a monolingual social network. In the manufacturing stage, lexicographic and collaborative tools enable users to build new resources while the acquired and manufactured resources are published in the diffusion stage, either within the virtual community or publicly. We present a life cycle mapping scheme that registers the transformations of the language resources at each of the three stages of language resource management. This scheme also traces the utilization and diffusion of each resource produced by the virtual community. The paper includes a case study in which we present the use of the Nenek platform in a language documentation project of a Mayan language spoken in Mexico's Gulf coast region called Huastec. This case study reveals Nenek's efficiency in terms of acquisition, annotation, manufacturing and diffusion of language resources; it also discusses the participation of the members of the virtual community.     

VRMosaic: Web access from within a virtual environment

For the foreseeable future, users of virtual reality systems will likely spend more time in the “real” environment than in a virtual environment. In the “real” environment, users access much of their data using flat screen applications, which include tools such as authoring and analysis programs and even hyperlinked browsers. We believe that users will find VEs more appealing if they can import their flat screen applications. We also believe that the World Wide Web infrastructure, and supporting tools such as NCSA Mosaic, Netscape's Navigator, and Sun's HotJava, have become a de facto standard both for making data available and allowing limited interaction with that data. These beliefs motivated us to develop a technology for porting flat screen applications based on the 3.1 version of the InterViews toolkit into VR. NCSA Mosaic provided us with a real application that would: (1) test our infrastructure effectively; and (2) provide a compelling application example. We used our “2D interface in VR” infrastructure to port Mosaic into RealEyes, our VR system. Dubbed “VRMosaic”, this application lets users familiar with Mosaic access the Web from within an immersive VE. But VRMosaic is not just an embedded version of NCSA Mosaic-it also allows for VR specific features such as navigation within the VE     

A unified interaction scheme for information sources

Commonly, for retrieving the desired information from an information source (knowledge base or information base), the user has to use the query language that is provided by the system. This is a big barrier for many ordinary users and the resulting interaction style is rather inflexible. In this paper we give the theoretical foundations of an interaction scheme that allows users to retrieve the objects of interest without having to be familiar with the conceptual schema of the source or with the supported query language. Specifically, we describe an interaction manager that provides a quite flexible interaction scheme by unifying several well-known interaction schemes. Furthermore, we show how this scheme can be applied to taxonomy-based sources by providing all needed algorithms and reporting their computational complexity.     

RELOOP, an algebra based query language for an object-oriented database system

In most object-oriented databases, as opposed to value-oriented databases, data are accessed by a programming language instead of a declarative query language. End users do not have a simple tool to perform their queries. This paper is concerned with the definition of an SQL-like query language on top of the O₂ object-oriented database system. We study the influence of the object-oriented paradigm on a query language, describe our language through examples, define its semantics by means of an algebra and sketch the compilation of RELOOP in one of the languages supported by the O₂ system.     

Experiences of usability evaluation of the IMAGINE speech-based interaction system

IMAGINE is a recently completed multi-partner, multi-national European 5th Framework project aimed at developing systems for interaction with e-business applications through a multilingual natural language interface from mobile and other devices. The vision embodied in IMAGINE is universal access to electronic services by anyone (including disabled users) at any time. Since this long-term vision is not achievable with current capabilities in speech and natural language technologies, we have concentrated initially on a monolingual (English) application, namely a speech-enabled interface to an Online Shop. This paper is primarily concerned with usability evaluation of a prototype system for this application. The principal finding is that considerable challenges and barriers remain against the successful deployment of speech systems in real applications. The problems are not just technical, but systemic (to do with the nature of speech) and are exacerbated by lack of shared background and difficulties of communication between different professionals involved in the design, commissioning and maintenance of speech systems. Formerly Royal National Institute of the Blind.     

Modeling the user state for context-aware spoken interaction in ambient assisted living

Ambient Assisted Living (AAL) systems must provide adapted services easily accessible by a wide variety of users. This can only be possible if the communication between the user and the system is carried out through an interface that is simple, rapid, effective, and robust. Natural language interfaces such as dialog systems fulfill these requisites, as they are based on a spoken conversation that resembles human communication. In this paper, we enhance systems interacting in AAL domains by means of incorporating context-aware conversational agents that consider the external context of the interaction and predict the user’s state. The user’s state is built on the basis of their emotional state and intention, and it is recognized by means of a module conceived as an intermediate phase between natural language understanding and dialog management in the architecture of the conversational agent. This prediction, carried out for each user turn in the dialog, makes it possible to adapt the system dynamically to the user’s needs. We have evaluated our proposal developing a context-aware system adapted to patients suffering from chronic pulmonary diseases, and provide a detailed discussion of the positive influence of our proposal in the success of the interaction, the information and services provided, as well as the perceived quality.     

Social modification using implementation of partial agency toward objects

This article considers what kind of partial agency can be implemented for objects to bring about better agencies for interacting with humans. We humans have the ability to inform our fellows about our intentions, internal states, and requirements through verbal means, gestures, attitudes, timings, and other representations. These representations help us to maintain our belief that we are sufficient agents. Robots and virtual agents also mimic these representations; they act as if they have such an agency. However, their agencies are sometimes too excessive compared to their task. This mismatch leads to a high cognitive load being placed on users and consequently leads to breakdowns in interaction; it prevents human-agent interaction from being a modality in certain applications. We have devised an agency with multiple selectable features. We believe that selectable features promote good designs of virtual agents, robots, machinery, and home appliances according to their intended traits. We categorized these agencies into several groups and discuss what elements lead to these features. The article also describes a method of identifying these features in human behavior.     

SmallWorlds: Visualizing Social Recommendations

We present SmallWorlds, a visual interactive graph‐based interface that allows users to specify, refine and build item‐preference profiles in a variety of domains. The interface facilitates expressions of taste through simple graph interactions and these preferences are used to compute personalized, fully transparent item recommendations for a target user. Predictions are based on a collaborative analysis of preference data from a user's direct peer group on a social network. We find that in addition to receiving transparent and accurate item recommendations, users also learn a wealth of information about the preferences of their peers through interaction with our visualization. Such information is not easily discoverable in traditional text based interfaces. A detailed analysis of our design choices for visual layout, interaction and prediction techniques is presented. Our evaluations discuss results from a user study in which SmallWorlds was deployed as an interactive recommender system on Facebook.     

Testing homogeneous spreadsheet grids with the "what you see iswhat you test" methodology

Although there has been recent research into ways to design environments that enable end users to create their own programs, little attention has been given to helping these end users systematically test their programs. To help address this need in spreadsheet systems (the most widely used type of end-user programming language), we previously introduced a visual approach to systematically testing individual cells in spreadsheet systems. However, the previous approach did not scale well in the presence of largely homogeneous grids, which introduce problems somewhat analogous to the array-testing problems of imperative programs. We present two approaches to spreadsheet testing that explicitly support such grids. We present the algorithms, time complexities, and performance data comparing the two approaches. This is part of our continuing work to bring to end users at least some of the benefits of formalized notions of testing without requiring knowledge of testing beyond a naive level     

JASMINE: A Java Tool for Multimedia Collaboration on the Internet

Although collaboration tools have existed for a long time [8], Internet-based multimedia collaboration has recently received a lot of attention mainly due to easy accessibility of the Internet by ordinary users. The Java platform and programming language has also introduced yet another level of easy access: platform-independent computing. As a result, it is very attractive to use Java to design multimedia collaboration systems for the Internet. Today there are many systems, which use Java for multimedia collaboration. However, most of these systems require the shared Java application to be re-written according to the collaboration system's Application Programming Interface (API)—a task which is sometimes difficult or even impossible. In this paper, we describe a practical approach for transparent collaboration with Java. Our approach is transparent in that the Java application can be shared as is with no modifications. The main idea behind our system is that user events occurring through the interactions with the application can be caught, distributed, and reconstructed, hence allowing Java applications to be shared transparently. Our architecture allows us to make the huge installed base of Java applications collaborative, without any modification to their original code. We also prove the feasibility of our architecture by implementation of the JASMINE¹ prototype.     

VoIP quality measurement: subjective VoIP quality estimation model for G.711 and G.729 based on native Thai users

This paper presents a mathematical model that has been created from the subjective MOS, instead of modifying or improving the existing objective measurement methods (e.g., E-model) for VoIP quality measurement. The proposed model of VoIP quality measurement method is based on native Thai users who communicate to each other using Thai language, which is a tonal language, unlike English and most western languages. The data have been gathered using conversation-opinion tests with 400 and 354 native Thai subjects for two popular codecs, G.711 and G.729, respectively, referring to effects from two major network factors, packet loss and packet delay. This model is called the Thai subjective VoIP quality evaluation model (ThaiVQE). It has been evaluated using two test sets of subjective MOS, from 50 native Thai subjects for G.711 and 64 native Thai subjects for G.729, then the results have been compared with the E-model results. Based on native Thai users, the evaluation result surprisingly shows that ThaiVQE can contribute better accuracy and reliability than the standard E-model with error reduction of over 13 % for G.711 and 28 % for G.729. Therefore, this is an example study for other countries that have their own languages and cultures to create their subjective MOS model.