列存储系统面向列的连接顺序优化研究

连接操作是影响列存储数据查询效率的重要操作之一,对于列存储系统中的连接操作优化,以往的研究工作大多专注于对数据组织结构的优化以及辅助物理结构的建立上,极少涉及逻辑层特别是早期的连接策略优化.为此,根据列存储数据的特点和分析型查询需求的特征,提出了一种新的列存储连接优化方法.该方法采用提早优化的策略,使用“事实表下推”的优化规则,并在多事实表查询条件下引入浓密树进行连接顺序决策,以较小的时空复杂度获得“最优”的连接执行顺序.使用代价估计模型对提出的连接策略优化方法进行了理论验证.同时,在大规模数据仓库基准数据集SSB上通过实验验证了提旱优化机制及下推规则的有效性.     

一种基于多连接属性划分的查询优化算法

查询操作是数据库中最常用的操作,由于分布式数据库的数据分布性和冗余性,使得查询优化处理成为分布式数据库研究的核心问题之一。为了提高分布式数据库查询效率,分析讨论了基于直接连接的常见执行策略和查询优化算法,同时针对分布式数据库应用中多表连接时存在多连接属性,提出一种改进的直接连接查询优化策略。改进后的算法提高了查询执行的并行性,缩短了查询处理时间,提高了查询效率。     

用于多表连接优化的深度强化学习嵌入表示

针对数据库查询优化中多表连接优化问题，任务是找到一个合适的连接顺序使查询执行计划最优，为此提出一种查询语句的嵌入表示方法SmartEncoder。通过优化查询语句中多表连接的嵌入表示信息，得到更丰富的关于连接的信息，将多表连接顺序选择优化建模为深度强化学习问题，根据动作的概率分布选择连接，从过去的经验中学习，生成更好的查询执行计划。在Join Order Benchmark数据集上的实验结果表明，SmartEncoder能够有效提高查询的效率。     

基于蚁群遗传混合算法改进的连接查询研究

连接查询优化技术对提升数据库性能至关重要,提出一种改进的连接查询算法,结合Wander Join连接查询算法,使用蚁群遗传混合算法对连接顺序进行优化。执行新的连接计划后,用剪枝策略降低样本的连接复杂度,达到了减少存储代价的目的。 理论分析和基于TPC-H数据集、TPC-DS数据集的算法对比实验表明,在多表连接的样本置信区间大于或等于95%的条件下,根据选择率的不同,加入蚁群遗传混合算法和剪枝策略的连接查询算法的相对错误率与Wander Join连接查询算法相比下降了20%～70%。     

GHMC_一种混合的数据库多连接查询优化算法

如何排列多连接表达式的连接顺序,是优化并行查询和提高数据库性能的关键技术之一．但多连接最优顺序是NPC问题。本文章研究了数据库多连接的特征,提出一种结合启发式和穷举搜索的Ghme算法,结合启发式和穷举搜索处理多连接查询,并从实验和理论证明其有效性。     

一种改进的半连接查询优化算法

查询优化是分布式数据库研究和关注的核心问题之一,为提高分布式数据库的查询效率,通过分析分布式数据库管理系统的特点,找出了影响分布式数据库管理系统查询效率的关键因素,并讨论了直接连接查询的常见策略和半连接查询的原理、实现方法以及所花费的传输代价,同时针对分布式数据库应用中存在大量重复查询操作的特点,提出了一种改进的半连接查询策略.最后结合应用实例对比传统半连接算法与改进后的算法,表明改进后的算法降低了数据传输量,缩短了查询处理时间,提高了查询效率.     

并行框架下基于位图索引的多表星型连接算法

分析面向大数据平台的MapReduce分布式编程技术以及实现数据查询时的连接算法,针对SSB数据模型,提出基于分布式缓存的多表星型连接优化技术.利用谓词向量技术,将维表中间连接的数据依赖转化为表上的位图索引过滤,减少数据依赖产生的巨大网络开销;采用分布式缓存技术充分利用处理节点的内存,优化网络传输,减少查询代价.     

XML查询结构连接顺序选择算法分析与优化

如今对XML查询的优化是对XML的热点研究方向。其中的结构连接操作是XML数据库查询的主要操作。和关系数据库中的连接运算一样,结构连接顺序的选择是XML数据库查询优化的核心。文中主要通过对XML查询优化中各种选择连接顺序算法的研究,提出了一种优化的算法,在规模较大的XML查询中能够有效缩减搜索空间,提高效率。     

列存储数据查询中的连接策略优化方法

列存储数据查询优化的重点是列的连接策略.现有的列存储系统通过存储的改变来简化列的连接,致使列的连接缺少查询优化处理,策略单一且无法满足复杂查询.在剖析现有连接选择策略的基础上,提出一种新的连接策略优化方法,即首先利用基于规则的优化方法为列存储数据查询制定优化规则,过滤不可能产生最优计划的候选计划;然后设计了基于代价的优化算法,根据动态Huffman树和左深连接树原理对查询执行顺序进行改进,进一步减少候选计划的规模;根据列存储数据的特点将候选计划中每个连接节点的执行策略归纳为串行连接和并行连接两类,并在此基础上提出代价估计模型,进而可针对这两种连接策略进行代价估计和策略选择.最后在SSB数据集上通过实验证明了方法在列存储数据查询中的有效性.     

XML查询结构连接顺序选择算法分析与优化

如今对XML查询的优化是对XML的热点研究方向。其中的结构连接操作是XML数据库查询的主要操作。和关系数据库中的连接运算一样，结构连接顺序的选择是XML数据库查询优化的核心。文中主要通过对XML查询优化中各种选择连接顺序算法的研究，提出了一种优化的算法，在规模较大的XML，查询中能够有效缩减搜索空间，提高效率。     

Real-time dynamic optimization of batch systems

In this paper a methodology for designing and implementing a real-time optimizing controller for batch processes is proposed. The controller is used to optimize a user-defined cost function subject to a parameterization of the input trajectories, a nominal model of the process and general state and input constraints. An interior point method with penalty function is used to incorporate constraints into a modified cost functional, and a Lyapunov based extremum seeking approach is used to compute the trajectory parameters. The technique is applicable to general nonlinear systems. A precise statement of the numerical implementation of the optimization routine is provided. It is shown how one can take into account the effect of sampling and discretization of the parameter update law in practical situations. A simulation example demonstrates the applicability of the technique.     

Formulation and parameter selection of multi-objective deterministic particle swarm for simulation-based optimization

Global derivative-free deterministic algorithms are particularly suitable for simulation-based optimization, where often the existence of multiple local optima cannot be excluded a priori, the derivatives of the objective functions are not available, and the evaluation of the objectives is computationally expensive, thus a statistical analysis of the optimization outcomes is not practicable. Among these algorithms, particle swarm optimization (PSO) is advantageous for the ease of implementation and the capability of providing good approximate solutions to the optimization problem at a reasonable computational cost. PSO has been introduced for single-objective problems and several extension to multi-objective optimization are available in the literature. The objective of the present work is the systematic assessment and selection of the most promising formulation and setup parameters of multi-objective deterministic particle swarm optimization (MODPSO) for simulation-based problems. A comparative study of six formulations (varying the definition of cognitive and social attractors) and three setting parameters (number of particles, initialization method, and coefficient set) is performed using 66 analytical test problems. The number of objective functions range from two to three and the number of variables from two to eight, as often encountered in simulation-based engineering problems. The desired Pareto fronts are convex, concave, continuous, and discontinuous. A full-factorial combination of formulations and parameters is investigated, leading to more than 60,000 optimization runs, and assessed by three performance metrics. The most promising MODPSO formulation/parameter is identified and applied to the hull-form optimization of a high-speed catamaran in realistic ocean conditions. Its performance is finally compared with four stochastic algorithms, namely three versions of multi-objective PSO and the genetic algorithm NSGA-II.     

Multiobjective optimization of trusses using genetic algorithms

In this paper we propose the use of the genetic algorithm (GA) as a tool to solve multiobjective optimization problems in structures. Using the concept of min–max optimum, a new GA-based multiobjective optimization technique is proposed and two truss design problems are solved using it. The results produced by this new approach are compared to those produced by other mathematical programming techniques and GA-based approaches, proving that this technique generates better trade-offs and that the genetic algorithm can be used as a reliable numerical optimization tool.     

云搜索优化算法

本文将云的生成、动态运动、降雨和再生成等自然现象与智能优化算法的思想融合,建立了一种新的智能优化算法-云搜索优化算法(CSO)。生成与移动的云可以弥漫于整个搜索空间,这使得新算法具有较强的全局搜索能力;收缩与扩张的云团在形态上会有千奇百态的变化,这使得算法具有较强的局部搜索能力;降雨后产生新的云团可以保持云团的多样性,这也是使搜索避免陷入局优的有效手段。实验表明,基于这三点建立的新算法具有优异的性能,benchmark函数最优值的计算结果以及与已有智能优化算法的比较展现了新算法精确的、稳定的全局求解能力。     

An integrated approach to topology,sizing, and shape optimization

Topology optimization has become very popular in industrial applications, and most FEM codes have implemented certain capabilities of topology optimization. However, most codes do not allow simultaneous treatment of sizing and shape optimization during the topology optimization phase. This poses a limitation on the design space and therefore prevents finding possible better designs since the interaction of sizing and shape variables with topology modification is excluded. In this paper, an integrated approach is developed to provide the user with the freedom of combining sizing, shape, and topology optimization in a single process.     

多元插值全局优化算法及其应用

本文介绍一种多元插值逼近和动态搜索轨迹相结合的全局优化算法.该算法大大减少了目标函数计算次数,寻优收敛速度快,算法稳定,且可获得全局极小,有效地解决了大规模非线性复杂动态系统的参数优化问题.一个具有8个控制参数的电力系统优化控制问题,采用该算法仅访问目标函数78次,便可求得最优控制器参数。     

Effects of dominant wolves in grey wolf optimization algorithm

Bio-inspired computation is one of the emerging soft computing techniques of the past decade. Although they do not guarantee optimality, the underlying reasons that make such algorithms become popular are indeed simplicity in implementation and being open to various improvements. Grey Wolf Optimizer (GWO), which derives inspiration from the hierarchical order and hunting behaviours of grey wolves in nature, is one of the new generation bio-inspired metaheuristics. GWO is first introduced to solve global optimization and mechanical design problems. Next, it has been applied to a variety of problems. As reported in numerous publications, GWO is shown to be a promising algorithm, however, the effects of characteristic mechanisms of GWO on solution quality has not been sufficiently discussed in the related literature. Accordingly, the present study analyses the effects of dominant wolves, which clearly have crucial effects on search capability of GWO and introduces new extensions, which are based on the variations of dominant wolves. In the first extension, three dominant wolves in GWO are evaluated first. Thus, an implicit local search without an additional computational cost is conducted at the beginning of each iteration. Only after repositioning of wolf council of higher-ranks, the rest of the pack is allowed to reposition. Secondarily, dominant wolves are exposed to learning curves so that the hierarchy amongst the leading wolves is established throughout generations. In the final modification, the procedures of the previous extensions are adopted simultaneously. The performances of all developed algorithms are tested on both constrained and unconstrained optimization problems including combinatorial problems such as uncapacitated facility location problem and 0-1 knapsack problem, which have numerous possible real-life applications. The proposed modifications are compared to the standard GWO, some other metaheuristic algorithms taken from the literature and Particle Swarm Optimization, which can be considered as a fundamental algorithm commonly employed in comparative studies. Finally, proposed algorithms are implemented on real-life cases of which the data are taken from the related publications. Statistically verified results point out significant improvements achieved by proposed modifications. In this regard, the results of the present study demonstrate that the dominant wolves have crucial effects on the performance of GWO.     

粒子群算法在组合优化问题上的研究与发展

粒子群优化算法是一种新兴的基于群智能搜索的优化技术。该算法简单、易实现、参数少,具有较强的全局优化能力,可有效应用于科学与工程实践中。介绍了算法的基本原理和算法在组合优化上一些改进方法的主要应用形式。最后,对粒子群算法作了一些深入分析并在此基础上对粒子群算法应用于组合优化问题做了一些总结。     

Value Creation in a Network: The Role of Pricing and Revenue Optimization and Enterprise Profit OptimizationTM

The Internet has created a virtual upheaval in the structural features of the supply and demand chains for most businesses. New agents and marketplaces have surfaced. The potential to create value and enhance profitable opportunities has attracted both buyers and sellers to the Internet. Yet, the Internet has proven to be more complex than originally thought. With information comes complexity: the more the information in real time, the greater the difficulty in interpretation and absorption. How can the value-creating potential of the Internet still be realized, its complexity notwithstanding? This paper argues that with the emergence of innovative tools, the expectations of the Internet as a medium for enhanced profit opportunities can still be realized. Creating value on a continuing basis is central to sustaining profitable opportunities. This paper provides an overview of the value creation process in electronic networks, the emergence of the Internet as a viable business communication and collaboration medium, the proclamation by many that the future of the Internet resides in “embedded intelligence”, and the perspectives of pragmatists who point out the other facet of the Internet—its complexity. The paper then reviews some recent new tools that have emerged to address this complexity. In particular, the promise of Pricing and Revenue Optimization (PRO) and Enterprise Profit Optimization^TM (EPO) tools is discussed. The paper suggests that as buyers and sellers adopt EPO, the market will see the emergence of a truly intelligent network—a virtual network—of private and semi-public profitable communities.     

A New Subdivision Algorithm for the Bernstein Polynomial Approach to Global Optimization

In this paper,an improved algorithm is proposed for unconstrained global optimization to tackle non-convex nonlinear multivariate polynomial programming problems.The proposed algorithm is based on the Bernstein polynomial approach.Novel features of the proposed algorithm are that it uses a new rule for the selection of the subdivision point,modified rules for the selection of the subdivision direction,and a new acceleration device to avoid some unnecessary subdivisions.The performance of the proposed algorithm is numerically tested on a collection of 16 test problems.The results of the tests show the proposed algorithm to be superior to the existing Bernstein algorithm in terms of the chosen performance metrics.