Load Balancing in a Cluster-Based Web Server for Multimedia Applications

We consider a cluster-based multimedia Web server that dynamically generates video units to satisfy the bit rate and bandwidth requirements of a variety of clients. The media server partitions the job into several tasks and schedules them on the backend computing nodes for processing. For stream-based applications, the main design criteria of the scheduling are to minimize the total processing time and maintain the order of media units for each outgoing stream. In this paper, we first design, implement, and evaluate three scheduling algorithms, first fit (FF), stream-based mapping (SM), and adaptive load sharing (ALS), for multimedia transcoding in a cluster environment. We determined that it is necessary to predict the CPU load for each multimedia task and schedule them accordingly due to the variability of the individual jobs/tasks. We, therefore, propose an online prediction algorithm that can dynamically predict the processing time per individual task (media unit). We then propose two new load scheduling algorithms, namely, prediction-based least load first (P-LLF) and prediction-based adaptive partitioning (P-AP), which can use prediction to improve the performance. The performance of the system is evaluated in terms of system throughput, out-of-order rate of outgoing media streams, and load balancing overhead through real measurements using a cluster of computers. The performance of the new load balancing algorithms is compared with all other load balancing schemes to show that P-AP greatly reduces the delay jitter and achieves high throughput for a variety of workloads in a heterogeneous cluster. It strikes a good balance between the throughput and output order of the processed media units     

多数据流上共享窗口连接查询的降载策略

数据流模型作为一种新型的模型,在许多应用中扮演着重要的角色．基于数据流模型的查询处理技术也得到了广泛的研究．为了提高查询系统的性能,现有的研究成果主要可以划分为两类：调度优化和降低负载方法．调度优化方法通过改变元组执行次序来提高查询性能．降低负载方法在负载超出系统处理能力时,通过减少输入流量来提高吞吐率．然而,同时运用这两种方法来提高查询性能的研究工作还很少．结合共享滑动窗口查询操作的调度优化方法和降低负载方法,提出了两种在burst环境下提高查询吞吐率的策略：均匀降载策略和小窗口准确降载策略．理论分析和实验结果均证明这两种策略能显著提高系统的性能．     

Effective Capacity and QoS for Wireless Scheduling

Multiuser scheduling in a wireless context, where channel state information is exploited at the base station, can result in significant throughput gains to users. However, when QoS constraints are imposed (in the form of overflow probabilities), the benefits of multiuser scheduling are not clear. In this paper, we address this question for independent and identically distributed ON-OFF channel models, and study a ldquomultiuserrdquo formulation of effective capacity with QoS constraints. We consider a channel-aware greedy rule as well as the channel-aware max-queue rule, and showed that these algorithms that yield the same long-term throughput without QoS constraints have very different performance when QoS constraints are imposed. Next, we study the effective capacity for varying channel burstiness. From results on multiuser scheduling, we expect the long-term throughput to grow with increasing channel burstiness. However, we show that the throughput with QoS constraints decreases with increasing channel burstiness. The intuitive justification for this is that with increasing burstiness, even though the the long-term throughput increases, the channel access delay increases as well resulting in poor QoS performance.     

Robust multiuser MIMO scheduling algorithms with imperfect CSI

Robust multiuser multiple-input-multiple-output (MIMO) scheduling algorithms are proposed in this paper.With imperfect channel state information (CSI),traditional scheduling algorithms for the multiuser MIMO system based on the zero forcing precoding scheme will lose some performance due to the multi-user interference (MUI).In order to improve the system average throughput,we study the robust multiuser MIMO scheduling problem with imperfect CSI.From the average capacity formula,we derive a robust factor which can transform the robust multiuser MIMO scheduling problem into the traditional one,thus most existing non-robust scheduling algorithms can be robust if this factor is adopted.Simulation results show that compared with the traditional algorithms,the proposed robust algorithms can improve the system average throughput significantly under the CSI error environment.     

Adaptive optimization of join trees for multi-join queries over sensor streams

Data processing applications for sensor streams have to deal with multiple continuous data streams with inputs arriving at highly variable and unpredictable rates from various sources. These applications perform various operations (e.g. filter, aggregate, join, etc.) on incoming data streams in real-time according to predefined queries or rules. Since the data rate and data distribution fluctuate over time, an appropriate join tree for processing join queries must be adaptively maintained in response to dynamic changes to prevent rapid degradation of the system performance. In this paper, we address the problem of finding an optimal join tree that maximizes throughput for sliding window based multi-join queries over continuous data streams and prove its NP-Hardness. We present a dynamic programming algorithm, OptDP, which produces the optimal tree but runs in an exponential time in the number of input streams. We then present a polynomial time greedy algorithm, XGreedyJoin. We tested these algorithms in ARES, an adaptively re-optimizing engine for stream queries, which we developed by extending Jess (Jess is a popular RETE-based, forward chaining rule engine written in java). For almost all instances, trees from XGreedyJoin perform close to the optimal trees from OptDP, and significantly better than common heuristics-based XJoin algorithms.     

一种基于格雷码变换和M序列异或的MPEG视频加密算法

在多数的视频加密算法中,视频加密后的数据流会显著增大,因为这些算法没有考虑到视频编码特点,导致传输吞吐率的下降。结合MPEG编码特点,利用格雷码和自然二进制码相互转换的易生成性,以及M序列良好的随机特性,提出一种快速视频加密算法。算法先在宏块DCT变换之前进行空域置乱运算,然后对Z字型扫描后的DC和AC系数符号位进行异或运算。加密后的数据大小不变,且加密速度快,两种算法结合安全性高。     

Optimizing the radio resource utilization of multiaccess systems with a traffic-transmission quality adaptive packet scheduling

In this paper we state a general framework for radio resource allocation based on a matrix which highlights the trade-offs of complexity and efficiency. This framework is outlined for the systematic definition of scheduling algorithms that are jointly adaptive to traffic and to transmission quality in order to improve the radio resource utilization and the achievable throughput of cellular networks for the support of best-effort traffic. We consider the application of the matrix concept to both time division and code division multiple access, the latter scheme also bringing about mutual interference among competing users. Then we propose a scheduling algorithm for wireless systems, called channel adaptive open scheduling (CHAOS). The CHAOS performance in terms of throughput and delay is extensively compared with those resulting from a load adaptive channel independent scheduling (CIS). A major result of this work is the quantitative assessment of the performance advantage allowed by jointly accounting for traffic congestion and transmission quality. Moreover the main implementation issues related to the proposed algorithms are investigated.     

I/O scheduling for digital continuous media

A growing set of applications require access to digital video and audio. In order to provide playback of such continuous media (CM), scheduling strategies for CM data servers (CMS) are necessary. In some domains, particularly defense and industrial process control, the timing requirements of these applications are strict and essential to their correct operation. In this paper we develop a scheduling strategy for multiple access to a CMS such that the timing guarantees are maintained at all times. First, we develop a scheduling strategy for the steady state, i.e., when there are no changes in playback rate or operation. We derive an optimal Batched SCAN (BSCAN) algorithm that requires minimum buffer space to schedule concurrent accesses. The scheduling strategy incorporates two key constraints: (1) data fetches from the storage system are assumed to be in integral multiples of the block size, and (2) playback guarantees are ensured for frame-oriented streams when each frame can span multiple blocks. We discuss modifications to the scheduling strategy to handle compressed data like motion-JPEG and MPEG. Second, we develop techniques to handle dynamic changes brought about by VCR-like operations executed by applications. We define a suite of primitive VCR-like operations that can be executed. We show that an unregulated change in the BSCAN schedule, in response to VCR-like operations, will affect playback guarantees. We develop two general techniques to ensure playback guarantees while responding to VCR-like operations: passive and active accumulation. Using user response time as a metric we show that active accumulation algorithms outperform passive accumulation algorithms. An optimal response-time algorithm in a class of active accumulation strategies is derived. The results presented here are validated by extensive simulation studies.     

Impact of video scheduling on bandwidth allocation for multiplexed MPEG streams

We present efficient schemes for scheduling the delivery of variable-bit-rate MPEG-compressed video with stringent quality-of-service (QoS) requirements. Video scheduling is being used to improve bandwidth allocation at a video server that uses statistical multiplexing to aggregate video streams prior to transporting them over a network. A video stream is modeled using a traffic envelope that provides a deterministic time-varying bound on the bit rate. Because of the periodicity in which frame types in an MPEG stream are typically generated, a simple traffic envelope can be constructed using only five parameters. Using the traffic-envelope model, we show that video sources can be statistically multiplexed with an effective bandwidth that is often less than the source peak rate. Bandwidth gain is achieved without sacrificing the stringency of the requested QoS. The effective bandwidth depends on the arrangement of the multiplexed streams, which is a measure of the lag between the GOP periods of various streams. For homogeneous streams, we give an optimal scheduling scheme for video sources at a video-on-demand server that results in the minimum effective bandwidth. For heterogeneous sources, a sub-optimal scheduling scheme is given, which achieves acceptable bandwidth gain. Numerical examples based on traces of MPEG-coded movies are used to demonstrate the effectiveness of our schemes.     

FAIRIO: A Throughput-oriented Algorithm for Differentiated I/O Performance

Providing differentiated service in a consolidated storage environment is a challenging task. To address this problem, we introduce FAIRIO, a cycle-based I/O scheduling algorithm that provides differentiated service to workloads concurrently accessing a consolidated RAID storage system. FAIRIO enforces proportional sharing of I/O service through fair scheduling of disk time. During each cycle of the algorithm, I/O requests are scheduled according to workload weights and disk-time utilization history. Experiments, which were driven by the I/O request streams of real and synthetic I/O benchmarks and run on a modified version of DiskSim, provide evidence of FAIRIO’s effectiveness and demonstrate that fair scheduling of disk time is key to achieving differentiated service in a RAID storage system. In particular, the experimental results show that, for a broad range of workload request types, sizes, and access characteristics, the algorithm provides differentiated storage throughput that is within 10% of being perfectly proportional to workload weights; and, it achieves this with little or no degradation of aggregate throughput. The core design concepts of FAIRIO, including service-time allocation and history-driven compensation, potentially can be used to design I/O scheduling algorithms that provide workloads with differentiated service in storage systems comprised of RAIDs, multiple RAIDs, SANs, and hypervisors for Clouds.     

基于动态预测和任务流整形的网格调度算法

针对网格环境下计算节点的自治性、异构性、分布性等特征,提出一种基于任务响应时间的动态修正预测和任务流整形的网格调度算法,该调度方法依据历史数据和最近访问过计算节点的任务请求提交时间、任务完成时间、网络通信延迟等信息,预测计算节点的将来任务响应时间,将任务提交给预测的轻负载或性能较优的计算节点完成。通过使用动态修正算法和任务流整形算法降低预测误差,提高资源利用率。实验结果表明,该方法在任务响应时间、任务的吞吐率等方面优于随机调度等传统算法,具有较好的综合性能。     

Learning automata-based algorithms for finding cover sets in wireless sensor networks

Wireless sensor networks (WSNs) have been widely used in different applications. One of the most significant issues in WSNs is developing an efficient algorithm to monitor all the targets and, at the same time, extend the network lifetime. As sensors are often densely deployed, employing scheduling algorithms can be considered a promising approach that is able ultimately to result in extending total network lifetime. In this paper, we propose three learning automata-based scheduling algorithms for solving target coverage problem in WSNs. The proposed algorithms employ learning automata (LA) to determine the sensors that should be activated at each stage for monitoring all the targets. Additionally, we design a pruning rule and manage critical targets in order to maximize network lifetime. In order to evaluate the performance of the proposed algorithms, extensive simulation experiments were carried out, which demonstrated the effectiveness of the proposed algorithms in terms of extending the network lifetime. Simulation results also revealed that by a proper choice of the learning rate, a proper trade-off could be achieved between the network lifetime and running time.     

MIMO链路ad hoc网络传输调度算法

针对MIMO链路ad hoc网络中已有传输调度算法未充分利用MIMO空间复用能力的问题,提出了一种新的传输调度算法.该算法通过考虑MIMO的多流接收能力而有效地减小了调度帧长,通过合理安排节点分配顺序使得节点分配的数据流比较平均,同时,该算法通过允许节点发送多个数据流而高效利用了MIMO的空间复用能力.推导分析了传输调度算法的通过量和时延性能,结果表明,与已有算法相比,采用文中算法可以提高网络的通过量,减小网络的平均时延和最大时延.     

Transmission scheduling algorithm for MIMO link ad hoc networks

Most reported works on transmission scheduling algorithm for multiple input multiple output (MIMO) link ad hoc networks do not fully exploit the spatial multiplexing potential inherent to multiple an-tennas system.In this paper,a novel transmission scheduling algorithm is proposed to further enhance the performance of MIMO link ad hoc networks.By utilizing the MIMO multi-stream reception capabilities and ordering the nodes’ allocation sequence,the proposed algorithm can dramatically shorten the scheduling frame length and more evenly distribute the data streams allocated to the network nodes.Meanwhile,allowing the nodes to transmit multiple streams in a slot,the algorithm can fully exploit the MIMO spatial multiplexing potential.Additionally,we give the theoretical analysis to quantify the throughput and delay performance with respect to this scheme.Numerical results demonstrate that the proposed algorithm can efficiently enhance the network throughput and reduce the average and maximum delay.     

A topology-transparent MAC scheduling algorithm with guaranteed QoS for multihop wireless network

Due to its character of topology independency, topology-transparent medium access control (MAC) scheduling algorithm is very suitable for large-scale mobile ad hoc wireless networks. In this paper, we propose a new topologytransparent MAC scheduling algorithm, with parameters of the node number and the maximal nodal degree known, our scheduling algorithm is based on a special balanced incomplete block design whose block size is optimized by maximizing the guaranteed throughput. Its superiority over typical other scheduling algorithms is proven mathematically with respect to the guaranteed throughput, the maximal transmission delay, and also the minimal transmission delay. The effect of inaccuracy in the estimation of the maximal nodal degree on the guaranteed throughput is deduced mathematically, showing that the guaranteed throughput decreases almost linearly as the actual nodal degree increases. Further techniques for improving the feasibility of the algorithm, such as collision avoidance, time synchronization, etc., are also discussed.     

Dynamic playout scheduling algorithms for continuous multimedia streams

In this paper, we investigate a playout scheduling framework for supporting the continuous and synchronized presentations of multimedia streams in a distributed multimedia presentation system. We assume a situation in which the server and network transmissions provide sufficient support for the delivery of media objects. In this context, major issues regarding the enforcement of the smooth presentation of multimedia streams at client sites must be addressed to deal with rate variance of stream presentations and delay variance of networks. We develop various playout-scheduling algorithms that are adaptable to quality-of-service parameters. The proposed algorithms permit the local adjustment of unsynchronized presentations by gradually accelerating or retarding presentation components, rather than abruptly skipping or pausing the presentation materials. A comprehensive experimental analysis of the proposed algorithms demonstrates that our algorithms can effectively avoid playout gaps (or hiccups) in the presentations. This scheduling framework can be readily used to support customized multimedia presentations.     

Steady-State Throughput and Scheduling Analysis of Multicluster Tools: A Decomposition Approach

Cluster tools are widely used as semiconductor manufacturing equipment. While throughput analysis and scheduling of single-cluster tools have been well-studied, research work on multicluster tools is still at an early stage. In this paper, we analyze steady-state throughput and scheduling of multicluster tools. We consider the case where all wafers follow the same visit flow within a multicluster tool. We propose a decomposition method that reduces a multicluster tool problem to multiple independent single-cluster tool problems. We then apply the existing and extended results of throughput and scheduling analysis for each single-cluster tool. Computation of lower-bound cycle time (fundamental period) is presented. Optimality conditions and robot schedules that realize such lower-bound values are then provided using ldquopullrdquo and ldquoswaprdquo strategies for single-blade and double-blade robots, respectively. For an -cluster tool, we present lower-bound cycle time computation and robot scheduling algorithms. The impact of buffer/process modules on throughput and robot schedules is also studied. A chemical vapor deposition tool is used as an example of multicluster tools to illustrate the decomposition method and algorithms. The numerical and experimental results demonstrate that the proposed decomposition approach provides a powerful method to analyze the throughput and robot schedules of multicluster tools.     

Efficient metaheuristics for pick and place robotic systems optimization

This paper deals with a pick and place robotic system design problem. The objective is to present an efficient method which is able to optimize the performances of the robotic system. By defining the suitable combination of scheduling rules, our method allows each robot to perform the assigned pick and place operations in real time in order to maximize the throughput rate. For that, we have developed different resolution methods which define the scheduling rule for each robot in order to seize the products from the first side of the system and to place them on the second side. We suggest three metaheuristics which are the ant colony optimization, the particle swarm optimization and the genetic algorithm. Then, we try to select the best algorithm which is able to get the best solutions with the lowest execution times. This is the main advantage of our methods compared to exact methods. This fact represents a great interest taking in consideration that our methods must respect a strong industrial constraint regarding the functioning of a real industrial robotic system. This constraint states that the answer time to manage the seizing strategies of the robots must be less than 1 second. Numerical results show that the different algorithms perform optimally for the tested instances in a reasonable computational time.     

一种用于提高流媒体传输性能的标记方法

在DiffServ网络中常用的标记法由于无法区分出数据流中每一个包在应用层的重要程度,因此不能有效提高视频流的传送质量。针对MPEG特点,采用在数据源与边界路由器两次标记的策略,通过基于NS 2的仿真系统对这种新标记策略进行对比,在带宽受限的情况下能有效的提高视频流的传输质量。