Database workload management through CBR and fuzzy based characterization

Database Management System (DBMS) is used as a data source with financial, educational, web and other applications from last many years. Users are connected with the DBMS to update existing records and retrieving reports by executing workloads that consist of complex queries. In order to get the sufficient level of performance, arrangement of workloads is necessary. Rapid growth in data, maximum functionality and changing behavior tends the database workload to be more complex and tricky. Each DBMS experiences complex workloads that are difficult to manage by the humans; human experts take much time to manage database workload efficiently; even in some cases it may become impossible and leads toward malnourishment. This problem leads database practitioners, vendors and researchers toward new challenges. To achieve a satisfactory level of performance, either Database Administrator (DBA) or DBMSs must have the knowledge about the workload shifts. Efficient execution and resource allocation of workload is dependent on the workload type that may be either On Line Transaction Processing (OLTP) or Decision Support System (DSS). The research introduces a way to manage the workload in DBMSs on the basis of the workload type. The main goal of the research is to manage the workload in DBMSs through characterization, scheduler and idleness detection modules. The database workload management is performed by using the case based reasoning characterization; Fuzzy logic based scheduling and finally detection of CPU Idleness. Results are validated through experiments that are performed on real time and benchmark workload to reveal effectiveness and efficiency.     

Concurrency of self-* in autonomic systems

New computing systems are currently at crucial point in their evolution: autonomic systems (ASs), which are inspired by the human autonomic nervous system. Autonomic computing (AC) is characterized by self-*such as self-configuration, self-healing, self-optimization, self-protection and more which run simultaneously in ASs. Hence, self-*is a form of concurrent processing in ASs. Taking advantage of categorical structures we establish, in this paper, a firm formal basis for specifying concurrency of self-* in ASs.     

Autonomic QoS control in enterprise Grid environments using online simulation

As Grid Computing increasingly enters the commercial domain, performance and quality of service (QoS) issues are becoming a major concern. The inherent complexity, heterogeneity and dynamics of Grid computing environments pose some challenges in managing their capacity to ensure that QoS requirements are continuously met. In this paper, a comprehensive framework for autonomic QoS control in enterprise Grid environments using online simulation is proposed. This paper presents a novel methodology for designing autonomic QoS-aware resource managers that have the capability to predict the performance of the Grid components they manage and allocate resources in such a way that service level agreements are honored. Support for advanced features such as autonomic workload characterization on-the-fly, dynamic deployment of Grid servers on demand, as well as dynamic system reconfiguration after a server failure is provided. The goal is to make the Grid middleware self-configurable and adaptable to changes in the system environment and workload. The approach is subjected to an extensive experimental evaluation in the context of a real-world Grid environment and its effectiveness, practicality and performance are demonstrated.     

Adaptive reflex autonomicity for real-time systems

It may appear that for software systems that require strict real-time behavior, the idea of incorporating self-management (and specifically concepts from Autonomic Computing) may add the burden of excessive additional functionality and overhead. However, our experience is that, not only does real-time software benefit from autonomicity, but also the Autonomic Computing initiative (like other initiatives aiming at self-management) requires the expertise of the real-time community in order to achieve its overarching vision. In particular, there are emerging classes of real-time systems for which incorporation of self-management is absolutely essential in order to implement all of the requirements of the system, and in particular the timing requirements.     

Is it DSS or OLTP: automatically identifying DBMS workloads

The type of the workload on a database management system (DBMS) is a key consideration in tuning the system. Allocations for resources such as main memory can be very different depending on whether the workload type is Online Transaction Processing (OLTP) or Decision Support System (DSS). A DBMS also typically experiences changes in the type of workload it handles during its normal processing cycle. Database administrators must therefore recognize the significant shifts of workload type that demand reconfiguring the system in order to maintain acceptable levels of performance. We envision intelligent, autonomic DBMSs that have the capability to manage their own performance by automatically recognizing the workload type and then reconfiguring their resources accordingly. In this paper, we present an approach to automatically identifying a DBMS workload as either OLTP or DSS. Using data mining techniques, we build a classification model based on the most significant workload characteristics that differentiate OLTP from DSS and then use the model to identify any change in the workload type. We construct and compare classifiers built from two different sets of workloads, namely the TPC-C and TPC-H benchmarks and the Browsing and Ordering profiles from the TPC-W benchmark. We demonstrate the feasibility and success of these classifiers with TPC-generated workloads and with industry-supplied workloads.     

数据库系统交易型负载自适应管理

数据库系统的负载自适应是指数据库系统通过对负载的过滤和控制有效利用系统资源去满足负载性能要求的过程。自治数据库系统负载管理框架（Autonomic Workload Management Framework,AWMF）是一种负载自适应的总体框架,给出了负载自适应的基本组件和主要工作过程。研究AWMF对交易型负载（Transactional Workload）的有效性,提出了基于查询成本（Query Cost）的交易型负载的排队网络模型,以该模型作为性能预测部件实现了AWMF的原型实现——查询调度器,通过实验验证了AWMF对交易型负载的有效性。     

Modeling and predicting mental workload in en route air traffic control: critical review and broader implications

OBJECTIVE: We perform a critical review of research on mental workload in en route air traffic control (ATC). We present a model of operator strategic behavior and workload management through which workload can be predicted within ATC and other complex work systems. BACKGROUND: Air traffic volume is increasing worldwide. If air traffic management organizations are to meet future demand safely, better models of controller workload are needed. METHOD: We present the theoretical model and then review investigations of how effectively traffic factors, airspace factors, and operational constraints predict controller workload. RESULTS: Although task demand has a strong relationship with workload, evidence suggests that the relationship depends on the capacity of the controllers to select priorities, manage their cognitive resources, and regulate their own performance. We review research on strategies employed by controllers to minimize the control activity and information-processing requirements of control tasks. CONCLUSION: Controller workload will not be effectively modeled until controllers' strategies for regulating the cognitive impact of task demand have been modeled. APPLICATION: Actual and potential applications of our conclusions include a reorientation of workload modeling in complex work systems to capture the dynamic and adaptive nature of the operator's work. Models based around workload regulation may be more useful in helping management organizations adapt to future control regimens in complex work systems.     

数据库SQLite在医用血液分析仪嵌入式管理系统中的应用

为实现对医用血液分析仪测试数据和系统设置数据的有效管理,在分析仪嵌入式管理系统中引入了嵌入式数据库SQLite。设计了数据库的功能和结构,合理创建了应用表格,设计了系统与数据库间的API函数,并将数据库文件集成到管理机系统当中。SQLite在血液分析仪管理系统中的应用满足了仪器测试数据管理以及质量控制功能的要求。     

使用OEM 10g Grid Control进行Oracle数据库环境集中管理

首先简要介绍了企业大量Oracle数据库环境的管理难题,其次介绍了Oracle 10g EnterpriseManager Grid Control工具的系统管理框架和数据库管理功能,最后通过实际例子对如何部署和使用Grid Control进行数据库环境集中管理展开详细论述。     

A hayekian self-organization approach to service allocation in computing systems

Future ‘on-demand’ computing systems, often depicted as potentially large scale and complex Service-Oriented Architectures, will need innovative management approaches for controlling and matching services demand and supply. Centralized optimization approaches reach their bounds with increasing network size and number of nodes. The search for decentralized approaches has led to build on self-organization concepts like Autonomic Computing, which draw their inspiration from Biology. This article shows how an alternative self-organization concept from Economics, the Catallaxy concept of F.A. von Hayek, can be realized for allocating service supply and demand in a distributed ‘on-demand’ web services network. Its implementation using a network simulator allows evaluating the approach against a centralized resource broker, by dynamically varying connection reliability and node density in the network. Exhibiting Autonomic Computing properties, the Catallaxy realization outperforms a centralized broker in highly dynamic environments.     

Managing database server performance to meet QoS requirements in electronic commerce systems

The performance of electronic commerce systems has a major impact on their acceptability to users. Different users also demand different levels of performance from the system, that is, they will have different Quality of Service (QoS) requirements. Electronic commerce systems are the integration of several different types of servers and each server must contribute to meeting the QoS demands of the users. In this paper we focus on the role, and the performance, of a database server within an electronic commerce system. We examine the characteristics of the workload placed on a database server by an electronic commerce system and suggest a range of QoS requirements for the database server based on this analysis of the workload. We argue that a database server must be able to dynamically reallocate its resources in order to meet the QoS requirements of different transactions as the workload changes. We describe Quartermaster, which is a system to support dynamic goal-oriented resource management in database management systems, and discuss how it can be used to help meet the QoS requirements of the electronic commerce database server. We provide an example of the use of Quartermaster that illustrates how the dynamic reallocation of memory resources can be used to meet the QoS requirements of a set of transactions similar to transactions found in an electronic commerce workload. We briefly describe the memory reallocation algorithms used by Quartermaster and present experiments to show the impact of the reallocations on the performance of the transactions. Published online: 22 August 2001     

Managing Information in a Co-operative Object Database System

The paper describes a software infrastructure that was built to manage information in a co-operative environment for the design of control systems. The architecture of the environment, the organization of the design database and a suite of information management tools are presented. The paper suggests that the distributed client–server architecture and object database technology meet the requirements of managing information in the environment. The following issues related to information management are examined in more detail: support for version control, maintenance of information integrity by means of object access control and consistency control, support for user co-operation based on object sharing and change notification, graphical user interfaces, and design tool interfaces. Problems encountered during the implementation of the environment using a commercial object database management system are also discussed.     

基于自主运算的自适应存储区域网络系统

存储管理是目前网络存储系统亟需解决的重要问题之一,解决存储管理问题的核心是自动适应外部环境变化,实现自我调整和自我管理,其中自适应是管理的关键.提出了一个解决存储管理的新方法和体系结构,基于自主运算理论实现自适应的SAN(storage area network)存储管理系统.在Tsinghua Mass Storage NetworkSystem(TH-MSNS)项目的基础上,提出了一个基于自主运算的SAN存储管理系统的通用结构框架,实现了一个自适应级别的自主FC-SAN存储系统.初步的实验结果说明,新     

Characterization of database access pattern for analytic prediction of buffer hit probability

The analytic prediction of buffer hit probability, based on the characterization of database accesses from real reference traces, is extremely useful for workload management and system capacity planning. The knowledge can be helpful for proper allocation of buffer space to various database relations, as well as for the management of buffer space for a mixed transaction and query environment. Access characterization can also be used to predict the buffer invalidation effect in a multi-node environment which, in turn, can influence transaction routing strategies. However, it is a challenge to characterize the database access pattern of a real workload reference trace in a simple manner that can easily be used to compute buffer hit probability. In this article, we use a characterization method that distinguishes three types of access patterns from a trace: (1) locality within a transaction, (2) random accesses by transactions, and (3) sequential accesses by long queries. We then propose a concise way to characterize the access skew across randomly accessed pages by logically grouping the large number of data pages into a small number of partitions such that the frequency of accessing each page within a partition can be treated as equal. Based on this approach, we present a recursive binary partitioning algorithm that can infer the access skew characterization from the buffer hit probabilities for a subset of the buffer sizes. We validate the buffer hit predictions for single and multiple node systems using production database traces. We further show that the proposed approach can predict the buffer hit probability of a composite workload from those of its component files.     

Role of data dictionaries in information resource management

The role of information resource dictionary systems (data dictionary systems) is important in two important phases of information resource management:First, information requirements analysis and specification, which is a complex activity requiring data dictionary support: the end result is the specification of an “Enterprise Model,” which embodies the major activities, processes, information flows, organizational constraints, and concepts. This role is examined in detail after analyzing the existing approaches to requirements analysis and specification.Second, information modeling which uses the information in the Enterprise Model to construct a formal implementation independent database specification: several information models and support tools that may aid in transforming the initial requirements into the final logical database design are examined.The metadata — knowledge about both data and processes — contained in the data dictionary can be used to provide views of data for the specialized tools that make up the database design workbench. The role of data dictionary systems in the integration of tools is discussed.     

Building Automated Data Driven Systems for IT Service Management

Enterprises and service providers are increasingly challenged with improving the quality of service delivery while containing the cost. However, it is often difficult to effectively manage the complex relationships among dynamic customer workloads, strict service level requirements, and efficient service management processes. In this paper, we present our progress on building autonomic systems for IT service management through a collection of automated data driven methodologies. This includes the design of feedback controllers for workload management, the use of simulation-optimization methodology for workforce management, and the development of machine learning models for event management. We demonstrate the applicability of the presented approaches using examples and data from a large IT service delivery environment.     

基于O CR 车牌识别技术的停车管理系统设计与实现

针对传统的依赖人工统计记录的停车收费管理方式效率低下的问题,设计了一款基于阿里云O C R 车牌识别技 术的停车场管理系统,主要功能包括车牌识别、车辆的停车收费管理、停车信息查询以及缴费信息查询等。     

A generic construct based workload model for business intelligence benchmark

Benchmarks are vital tools in the performance measurement and evaluation of computer hardware and software systems. Standard benchmarks such as the TREC, TPC, SPEC, SAP, Oracle, Microsoft, IBM, Wisconsin, AS³AP, OO1, OO7, XOO7 benchmarks have been used to assess the system performance. These benchmarks are domain-specific in that they model typical applications and tie to a problem domain. Test results from these benchmarks are estimates of possible system performance for certain pre-determined problem types. When the user domain differs from the standard problem domain or when the application workload is divergent from the standard workload, they do not provide an accurate way to measure the system performance of the user problem domain. System performance of the actual problem domain in terms of data and transactions may vary significantly from the standard benchmarks. In this research, we address the issue of domain boundness and workload boundness which results in the ir-representative and ir-reproducible performance readings. We tackle the issue by proposing a domain-independent and workload-independent benchmark method which is developed from the perspective of the user requirements. We present a user-driven workload model to develop a benchmark in a process of workload requirements representation, transformation, and generation. We aim to create a more generalized and precise evaluation method which derives test suites from the actual user domain and application. The benchmark method comprises three main components. They are a high-level workload specification scheme, a translator of the scheme, and a set of generators to generate the test database and the test suite. The specification scheme is used to formalize the workload requirements. The translator is used to transform the specification. The generator is used to produce the test database and the test workload. In web search, the generic constructs are main common carriers we adopt to capture and compose the workload requirements. We determine the requirements via the analysis of literature study. In this study, we have conducted ten baseline experiments to validate the feasibility and validity of the benchmark method. An experimental prototype is built to execute these experiments. Experimental results demonstrate that the method is capable of modeling the standard benchmarks as well as more general benchmark requirements.     

Successful requirements management

Conclusion By way of a conclusion, the preceding discussion has identified a relatively complex web of interrelationships that need to be managed. Too often the technical details are focused on to the detriment of the sponsoring business. However, if requirements are to be managed successfully, there is a need for adequate tool support. In my opinion, the requirements management tools which are currently available do not provide the sophisticated level of support needed to adequately manage the complexity of linking requirements, acceptance criteria, constraints, benefits and solutions.     

基于运行时模型的多样化云资源管理方法

多样化的受管资源和不断变化的管理需求,使得云管理面临很大的难度和复杂度.面对一个新的特定的管理需求,管理员往往是在已有管理软件的基础上进行二次开发,通过管理功能的获取和组织来构造新的管理系统.然而,由于缺乏通用的方法,二次开发的难度和复杂度依然很大.为了能够根据管理需求快速定制、集成、扩展已有的管理软件,提出一种基于运行时模型的多样化云资源管理方法.首先,在系统管理接口的基础上构造不同受管资源的运行时模型;其次,通过对不同的运行时模型进行合并,来构造包含所有目标受管资源的组合模型;最后,通过组合模型到用户特定模型的转换,来满足特定的管理需求.在OpenStack与Hyperic两款独立管理软件的基础上,实现了基于运行时模型的虚拟机软、硬件资源统一管理系统,验证了方法的可行性和有效性.