Searching for multimedia: analysis of audio,video and image Web queries

The development of digital libraries has enhanced the integration of textual and multimedia information in many document collections. The World Wide Web provides the connectivity for many digital library users. Studies exploring the searching characteristics of Web users are an important and a growing area of research. Most Web user studies have focused on general Web searching, regardless of subject matter or format. Little research has examined how Web users search for multimedia information. Our study examines users' multimedia searching on a major Web search service. The data set examined consisted of 1,025,908 queries from 211,058 users of Excite ®, a major Web search service. From this data set, we identified and analyzed queries for audio, image, and video queries. Our findings were compared to results from general Web searching studies. Implications for the design of Web searching services and interfaces are discussed.     

Logic and Computational Complexity for Boolean Information Retrieval

We study the complexity of query satisfiability and entailment for the Boolean information retrieval models WP and AWV using techniques from propositional logic and computational complexity. WP and AWV can be used to represent and query textual information under the Boolean model using the concept of attribute with values of type text, the concept of word, and word proximity constraints. Variations of WP and AWP are in use in most deployed digital libraries using the Boolean model, text extenders for relational database systems (e.g., Oracle 10g), search engines, and P2P systems for information retrieval and filtering     

Digital libraries and Web 3.0. The CallimachusDL approach

The constantly increasing volume of information available on the Internet is changing the forms of classification and access to data. Given the immense collection of information stored on the Internet, digital libraries constitute a fundamental subject of research. Among the challenges of classifying, locating and accessing knowledge in digital libraries tackling with the huge amount of resources the Web provides, improving digital libraries by means of different strategies, particularly, using semantics remains a promising and interesting approach. In this paper, CallimachusDL is presented, a semantics-based digital library which provides faceted search, enhanced access possibilities and a proof-of-concept implementation. CallimachusDL represents a novel approach to digital libraries, integrating social web and multimedia elements in a semantically annotated repository. The results of the implementation indicate that the features proposed in CallimachusDL are encouraging and extendable in the use of digital libraries.     

Drag-and-drop multimedia: ¶an interface framework for digital libraries

In this paper, we describe a new interface for querying multimedia digital libraries and an interface building framework. The interface employs a drag-and-drop style of interaction and combines a structured natural-language style query specification with reusable multimedia objects. We call this interface DanDMM, short for “drag-and-drop multimedia”. DanDMM interfaces capture the syntax of the underlying query language, and dynamically reconfigure to reflect the contents of the data repository. A distinguishing feature of DanDMM is its ability to synthesize integrated interfaces that incorporate both example-based specification using multimedia objects, and traditional techniques including keyword, attribute, and free text-based search. We describe the DanDMM-builder, a framework for synthesizing DanDMM interfaces, and give several examples of interfaces that have been constructed using DanDMM-builder, including a remote-sensing library application and a video digital library. Received: 15 December 1997 / Revised: June 1999     

Computational foundations for personalizing instruction with digital libraries

This paper describes our progress towards automating adaptive personalized instruction based on student conceptual understandings using digital libraries. The reported approach merges conversational learning theory with advances in natural language processing to enable personalized pedagogical interactions. Multi-document summarization techniques serve as the computational basis to process digital library resources and automatically construct a rich domain model on earthquakes and plate tectonics for high school age learners. Shallow semantic analysis and graph-based techniques are used to computationally diagnose student understandings that enable conceptual personalizations integrating digital library resources. The evaluation of the implemented algorithms indicates that digital libraries may serve as knowledge platforms to support the automated construction of rich domain models and the diagnosis of student conceptual understandings. Furthermore, this approach introduces a novel and effective alternative to prior work in adaptive learning environments in terms of scalability and portability, thus tackling important challenges associated with supporting personalized instruction using digital libraries.     

A framework for search interfaces

Searching textual databases can be confusing for users. Popular search systems for the World Wide Web and stand alone systems typically provide a simple interface: users type in keywords and receive a relevance ranked list of 10 results. This is appealing in its simplicity, but users are often frustrated because search results are confusing or aspects of the search are out of their control. If we are to improve user performance, reduce mistaken assumptions, and increase successful searches, we need more predictable design. To coordinate design practice, we suggest a four-phase framework that would satisfy first time, intermittent, and frequent users accessing a variety of textual and multimedia libraries     

Multimedia ontology matching by using visual and textual modalities

Ontologies have been intensively applied for improving multimedia search and retrieval by providing explicit meaning to visual content. Several multimedia ontologies have been recently proposed as knowledge models suitable for narrowing the well known semantic gap and for enabling the semantic interpretation of images. Since these ontologies have been created in different application contexts, establishing links between them, a task known as ontology matching, promises to fully unlock their potential in support of multimedia search and retrieval. This paper proposes and compares empirically two extensional ontology matching techniques applied to an important semantic image retrieval issue: automatically associating common-sense knowledge to multimedia concepts. First, we extend a previously introduced textual concept matching approach to use both textual and visual representation of images. In addition, a novel matching technique based on a multi-modal graph is proposed. We argue that the textual and visual modalities have to be seen as complementary rather than as exclusive sources of extensional information in order to improve the efficiency of the application of an ontology matching approach in the multimedia domain. An experimental evaluation is included in the paper.     

Content-based retrieval in digital libraries

With the recent developments in multimedia and telecommunication technologies, content-based information is becoming increasingly important for various areas such as digital libraries, interactive video and multimedia publishing. Multimedia data refers to simple structured data (such as numbers and short strings), large unstructured data (such as text documents, images, audio and video data) and complex structured data (such as maps, graphs, charts and tables). In this article, we briefly address content-based retrieval and the issues of representation, storage and retrieval of multimedia objects in digital libraries. We then very briefly identify some open areas of research     

A hybrid system approach for supporting digital libraries

A digital library (DL) consists of a database which contains library information and a user interface which provides a visual window for users to search relevant information stored in the database. Thus, an abstract structure of a digital library can be defined as a combination of a special purpose database and a user-friendly interface. This paper addresses one of the fundamental aspects of such a combination. This is the formal data structure for linking an object oriented database with hypermedia to support digital libraries. It is important to establish a formal structure for a digital library in order to efficiently maintain different types of library information. This article discusses how to build an object oriented hybrid system to support digital libraries. In particular, we focus on the discussion of a general purpose data model for digital libraries and the design of the corresponding hypermedia interface. The significant features of this research are, first, a formalized data model to define a digital library system structure; second, a practical approach to manage the global schema of a library system; and finally, a design strategy to integrate hypermedia with databases to support a wide range of application areas. Received: 15 December 1997 / Revised: June 1999     

A digital library instead of a traditional database for nanotechnologies: An attempt to use the ABCD system

Against the background of the limited possibilities of the traditional databases during the creation of the information infrastructure of modern science, the advantages and rich potential of digital libraries as a new class of information systems are shown in this paper. Based on the example of nanotechnologies, the specific requirements raised for the created digital libraries are analyzed, i.e., support of semi-structured data, use of a number of formats (text, tables, and graphics), and the active involvement of context information deposited on outside resources. The ABCD system, which is proposed for the control of libraries and information centers, on whose basis an information system for the use of nanomaterials in power engineering has been created, is considered in detail.     

Results of a digital library curriculum field test

The DL Curriculum Development project was launched in 2006, responding to an urgent need for consensus on DL curriculum across the fields of computer science and information and library science. Over the course of several years, 13 modules of a digital libraries (DL) curriculum were developed and were ready for field testing. The modules were evaluated in DL courses in real classroom environments in 37 classes by 15 instructors and their students. Interviews with instructors and questionnaires completed by their students were used to collect evaluative feedback. Findings indicate that the modules have been well designed to educate students on important topics and issues in DLs, in general. Suggestions to improve the modules based on the interviews and questionnaires were discussed as well. After the field test, module development has been continued, not only for the DL community but also others associated with DLs, such as information retrieval, big data, and multimedia. Currently, 56 modules are readily available for use through the project website or the Wikiversity site.     

中文文本的信息自动抽取和相似检索机制

目前信息抽取成为提供高质量信息服务的重要手段,提出面向中文文本信息的自动抽取和相似检索机制,其基本思想是将用户兴趣表示为语义模板,对关键字进行概念扩充,通过搜索引擎获得初步的候选文本集合,在概念触发机制和部分分析技术基础上,利用语义关系到模板槽的映射机制,填充文本语义模板,形成结构化文本数据库.基于文本数据表述的模糊性,给出用户查询与文本语义模板的相似关系,实现了相似检索,可以更加全面地满足用户的信息需求.     

全球多媒体国际认证新标准——多媒体与网页创作传播国际认证指标融入多媒体课程教学之研析

本研究运用全球化多媒体网页设计与数字内容传播应用能力的指标,提出融入多媒体课程教学的方式与建议,并讨论学校与企业的能力融合,试图建立一套学习与认证一贯课程的学习形态,协助企业准确搜寻需求之人力资源,学校也可以藉由多媒体网页设计与数字内容传播应用能力指标培养学生的专业多媒体能力,建构符合全球认证的课程,协助学习者达成学习与认证一贯的学习形态。     

Digital Libraries: Ongoing Development (From the Editor of the Special Issue)

Digital Libraries Initiative declared in the USA in the autumn of 1993 aroused interest to information systems of this class in many countries all over the world. Today, numerous research teams are involved in activities related to such systems. A significant number of digital libraries for diverse purposes are already in operation, and various research prototypes have been created. This subject has been discussed at international conferences dedicated specifically to digital libraries and conferences on fundamental directions of information system technologies, such as database technologies, Web technologies, textual search, data mining, and knowledge discovery. Programming and Computer Software already addressed the problems arising in relation to digital libraries. This issue of the journal further explores the subject.     

Texture features for browsing and retrieval of image data

Image content based retrieval is emerging as an important research area with application to digital libraries and multimedia databases. The focus of this paper is on the image processing aspects and in particular using texture information for browsing and retrieval of large image data. We propose the use of Gabor wavelet features for texture analysis and provide a comprehensive experimental evaluation. Comparisons with other multiresolution texture features using the Brodatz texture database indicate that the Gabor features provide the best pattern retrieval accuracy. An application to browsing large air photos is illustrated     

Sustainability of digital libraries: a conceptual model and a research framework

This paper aims to develop a conceptual model and a research framework for study of the economic, social and environmental sustainability of digital libraries. The major factors that are related to the economic, social and environmental sustainability of digital libraries have been identified. Relevant research in digital information systems and services in general, and digital libraries in particular, have been discussed to illustrate different issues and challenges associated with each of the three forms of sustainability. Based on the discussions of relevant research that have implications on sustainability of information systems and services, the paper proposes a conceptual model and a theoretical research framework for study of the sustainability of digital libraries. It shows that the sustainable business models to support digital libraries should also support equitable access supported by specific design and usability guidelines that facilitate easier, better and cheaper access; support the personal, institutional and social culture of users; and at the same time conform with the policy and regulatory frameworks of the respective regions, countries and institutions. It is also shown that measures taken to improve the economic and social sustainability should also support the environmental sustainability guidelines, i.e. reduce the overall environmental impact of digital libraries. It is argued that the various factors affecting the different sustainability issues of digital libraries need to be studied together to build digital libraries that are economically, socially and environmentally sustainable.     

Scheduling multimedia presentations in educational digital libraries

An educational digital library is a specialized digital library containing instructional materials, such as class lectures, seminar presentations, and various training materials. These materials consist of a combination of audio, video, and image data. In such an environment, basic parts of multimedia data are usually stored in databases and sophisticated multimedia presentations may be assembled to generate various presentations. In this paper, we investigate a theory of the scheduling strategies for supporting the synchronized presentations of multimedia streams which is applicable to educational digital libraries. This scheduling theory includes the specification and representation of synchronization on media streams, the realization of appropriate synchronization granularity, and the scheduling principles for the presentations of multimedia streams. This investigation formulates criteria for specifying and scheduling the skipping/pausing of media streams with asynchronous presentations when various delays occur. Adaptability to various quality-of-service requirements is supported in the scheduling strategies. Various synchronization mechanisms at both client and server sides are proposed to implement the scheduling theory. Experimental analysis is conducted using instructional materials.