Reactive Search strategies using Reinforcement Learning,local search algorithms and Variable Neighborhood Search

Optimization techniques known as metaheuristics have been applied successfully to solve different problems, in which their development is characterized by the appropriate selection of parameters (values) for its execution. Where the adjustment of a parameter is required, this parameter will be tested until viable results are obtained. Normally, such adjustments are made by the developer deploying the metaheuristic. The quality of the results of a test instance [The term instance is used to refer to the assignment of values to the input variables of a problem.] will not be transferred to the instances that were not tested yet and its feedback may require a slow process of “trial and error” where the algorithm has to be adjusted for a specific application. Within this context of metaheuristics the Reactive Search emerged defending the integration of machine learning within heuristic searches for solving complex optimization problems. Based in the integration that the Reactive Search proposes between machine learning and metaheuristics, emerged the idea of putting Reinforcement Learning, more specifically the Q-learning algorithm with a reactive behavior, to select which local search is the most appropriate in a given time of a search, to succeed another local search that can not improve the current solution in the VNS metaheuristic. In this work we propose a reactive implementation using Reinforcement Learning for the self-tuning of the implemented algorithm, applied to the Symmetric Travelling Salesman Problem.     

Interactive fuzzy stochastic multi-level 0–1 programming using tabu search and probability maximization

In this paper, we consider interactive fuzzy programming for multi-level 0–1 programming problems involving random variable coefficients both in objective functions and constraints. Following the probability maximization model together with the concept of chance constraints, the formulated stochastic multi-level 0–1 programming problems are transformed into deterministic ones. Taking into account vagueness of judgments of the decision makers, we present interactive fuzzy programming. In the proposed interactive method, after determining the fuzzy goals of the decision makers at all levels, a satisfactory solution is derived efficiently by updating satisfactory levels of the decision makers with considerations of overall satisfactory balance among all levels. For solving the transformed deterministic problems efficiently, we also introduce novel tabu search for general 0–1 programming problems. A numerical example for a three-level 0–1 programming problem is provided to illustrate the proposed method.     

Context matters: The structure of task goals affects accuracy in multiple-target visual search

Career visual searchers such as radiologists and airport security screeners strive to conduct accurate visual searches, but despite extensive training, errors still occur. A key difference between searches in radiology and airport security is the structure of the search task: Radiologists typically scan a certain number of medical images (fixed objective), and airport security screeners typically search X-rays for a specified time period (fixed duration). Might these structural differences affect accuracy? We compared performance on a search task administered either under constraints that approximated radiology or airport security. Some displays contained more than one target because the presence of multiple targets is an established source of errors for career searchers, and accuracy for additional targets tends to be especially sensitive to contextual conditions. Results indicate that participants searching within the fixed objective framework produced more multiple-target search errors; thus, adopting a fixed duration framework could improve accuracy for career searchers.     

Tabu-based GIS for solving the vehicle routing problem

Besides being a hard combinatorial problem, the VRP is also a spatial problem. Hence, effective decision making in this field strongly requires the integration of GIS and optimization systems (GIS-O). This article integrates GIS and optimization tools for solving the vehicle routing problem with loading and distance requirements (DCVRP). A general outline of the multi-step integration is pointed out showing the interaction of the GIS and the spatial optimization according to the loose coupling strategy. The computational performance of the TS-VRP algorithm for the DCVRP turned out to be quite efficient on both computation time and solution quality. The Tunisian case study well illustrates the incentive behind using such a spatial decision support system that allows the management of the problem from the data acquisition to the visualization of possible simulation scenarios in a more realistic way.     

An improved global-best harmony search algorithm for faster optimization

In this paper, an improved global-best harmony search algorithm, named IGHS, is proposed. In the IGHS algorithm, initialization based on opposition-based learning for improving the solution quality of the initial harmony memory, a new improvisation scheme based on differential evolution for enhancing the local search ability, a modified random consideration based on artificial bee colony algorithm for reducing randomness of the global-best harmony search (GHS) algorithm, as well as two perturbation schemes for avoiding premature convergence, are integrated. In addition, two parameters of IGHS, harmony memory consideration rate and pitch adjusting rate, are dynamically updated based on a composite function composed of a linear time-varying function, a periodic function and a sign function in view of approximate periodicity of evolution in nature. Experimental results tested on twenty-eight benchmark functions indicate that IGHS is far better than basic harmony search (HS) algorithm and GHS. In further study, IGHS has also been compared with other eight well known metaheuristics. The results show that IGHS is better than or at least similar to those approaches on most of test functions.     

基于先验知识的自适应多叉树防碰撞算法

为提高无线射频识别(RFID)系统快速识别大量标签的能力,提出一种基于先验知识的自适应多叉树防碰撞算法。利用标签访问的规律性和标签分布的随机性,在不同的搜索深度,根据已有的先验知识和碰撞比特信息估计待识别的标签数量,从而动态地自适应选择搜索叉树。通过有效减少碰撞和空闲时隙数,大幅提高读写器搜索和识别标签的能力。理论分析与仿真实验结果表明,该算法能克服传统自适应多叉树防碰撞算法的缺点,合理选择初始搜索叉树,尤其在待识别标签数量较多的场合,可有效提高RFID系统的吞吐率。     

基于启发式搜索与预标注的中文CCG句法分析

针对中文组合范畴语法(CCG)分析困难的特点,研究如何将两种彼此相互独立的技术共同应用在中文CCG句法分析上。首先使用预标注算法,使用对数线性模型通过去除那些概率较低的词汇范畴来对句子的潜在分析空间进行剪枝。然后应用启发式搜索算法进一步加速分析过程。最后从时间效率和分析精度两个维度对所使用的方法进行验证。实验表明,基于启发式搜索与预标注的句法分析算法可以显著地提高分析效率与分析精度。     

隐目标回归算法设计研究

对常用的回归方法进行研究.此类方法虽然几何解释明确、易于求解,但均须事先确定(或假定)变量间的因果关系,再考虑建模,在实际应用中,对于很难确定变量的因果关系的问题,如物联网数据分析,上述方法就会失效.为此,提出一种无需假定因变量的隐目标回归方法.该方法易于核化,可以推广到非线性回归问题.通过人工数据和国际标准数据集上的实验验证了所提算法的有效性.     

基于改进离散粒子群禁忌算法的并行测试任务调度

针对并行测试任务调度问题特点,提出了一种解决并行测试任务调度的离散粒子群禁忌算法,设计了符合并行测试任务调度特点的粒子初始化编码方式、粒子位置转移公式以及禁忌搜索邻域。通过与禁忌搜索相结合,避免了离散粒子群算法早熟问题。通过实验以及算法对比,表明提出的算法是快速有效的,能够很好地解决并行测试任务调度问题,求得测试总时间最短的任务调度序列。     

基于模拟分析技术和随机搜索算法的化工过程能量集成方法研究

夹点和模拟分析技术已在化工能量集成中广泛应用.今以夹点技术为基础,对化工过程系统用能进行诊断,根据"过程用能一致性"原则提出能量集成改造方案,通过改变塔压实现塔顶冷凝器与塔底再沸器的热集成多效蒸馏.夹点技术实现的优化目标仅是热回收最大或公用工程能耗最小,不能实现包括设备整体费用最小的过程全局最优化.研究基于模拟技术,通过灵敏度分析,得到精馏塔各操作参数的样本映射数据,通过多项式拟合得到参数关联方程,并在遗传算法及模式搜索中设计过程费用函数,提出了将模拟分析技术与随机搜索算法相结合的,以过程费用函数最小化为优化目标的能量集成方法.工业实例的成功设计应用证明了其有效性和可行性.