Residual vector quantization using a multilayer competitive neuralnetwork

This paper presents a new technique for designing a jointly optimized residual vector quantizer (RVQ). In conventional stage-by-stage design procedure, each stage codebook is optimized for that particular stage distortion and does not consider the distortion from the subsequent stages. However, the overall performance can be improved if each stage codebook is optimized by minimizing the distortion from the subsequent stage quantizers as well as the distortion from the previous stage quantizers. This can only be achieved when stage codebooks are jointly designed for each other. In this paper, the proposed codebook design procedure is based on a multilayer competitive neural network where each layer of this network represents one stage of the RVQ. The weight connecting these layers form the corresponding stage codebooks of the RVQ. The joint design problem of the RVQ's codebooks (weights of the multilayer competitive neural network) is formulated as a nonlinearly constrained optimization task which is based on a Lagrangian error function. This Lagrangian error function includes all the constraints that are imposed by the joint optimization of the codebooks. The proposed procedure seeks a locally optimal solution by iteratively solving the equations for this Lagrangian error function. Simulation results show an improvement in the performance of an RVQ when designed using the proposed joint optimization technique as compared to the stage-by-stage design, where both generalized Lloyd algorithm (GLA) and the Kohonen learning algorithm (KLA) were used to design each stage codebook independently, as well as the conventional joint-optimization technique     

Novel fuzzy reinforced learning vector quantisation algorithm and its application in image compression

A new approach to the design of optimised codebooks using vector quantisation (VQ) is presented. A strategy of reinforced learning (RL) is proposed which exploits the advantages offered by fuzzy clustering algorithms, competitive learning and knowledge of training vector and codevector configurations. Results are compared with the performance of the generalised Lloyd algorithm (GLA) and the fuzzy K-means (FKM) algorithm. It has been found that the proposed algorithm, fuzzy reinforced learning vector quantisation (FRLVQ), yields an improved quality of codebook design in an image compression application when FRLVQ is used as a pre-process. The investigations have also indicated that RL is insensitive to the selection of both the initial codebook and a learning rate control parameter, which is the only additional parameter introduced by RL from the standard FKM     

Unitary space vector quantization codebook design for spatial correlated limited feedback MIMO system

In the transmitting, beamforming, and receiving combing （TBRC） MIMO system, a codebook based feedback strategy is usually used to provide the transmitter with the beamforming vector. The adopted codebook affects the system performance considerably. Therefore, the codebook design is a key technology in the TBRC MIMO system. In this article, the unitary space vector quantization （USVQ） codebook design criterion is proposed to design optimal codebooks for various spatial correlated MIMO channels. And the unitary space K-mean （USK） codebook generating algorithm is provided to generate the USVQ codebooks. Simulations show that the capacities of the feedback based TBRC systems using USVQ codebooks are very close to those of the ideal cases.     

Minimax partial distortion competitive learning for optimalcodebook design

The design of the optimal codebook for a given codebook size and input source is a challenging puzzle that remains to be solved. The key problem in optimal codebook design is how to construct a set of codevectors efficiently to minimize the average distortion. A minimax criterion of minimizing the maximum partial distortion is introduced in this paper. Based on the partial distortion theorem, it is shown that minimizing the maximum partial distortion and minimizing the average distortion will asymptotically have the same optimal solution corresponding to equal and minimal partial distortion. Motivated by the result, we incorporate the alternative minimax criterion into the on-line learning mechanism, and develop a new algorithm called minimax partial distortion competitive learning (MMPDCL) for optimal codebook design. A computation acceleration scheme for the MMPDCL algorithm is implemented using the partial distance search technique, thus significantly increasing its computational efficiency. Extensive experiments have demonstrated that compared with some well-known codebook design algorithms, the MMPDCL algorithm consistently produces the best codebooks with the smallest average distortions. As the codebook size increases, the performance gain becomes more significant using the MMPDCL algorithm. The robustness and computational efficiency of this new algorithm further highlight its advantages.     

Constrained-storage vector quantization with a universal codebook

Many image compression techniques require the quantization of multiple vector sources with significantly different distributions. With vector quantization (VQ), these sources are optimally quantized using separate codebooks, which may collectively require an enormous memory space. Since storage is limited in most applications, a convenient way to gracefully trade between performance and storage is needed. Earlier work addressed this problem by clustering the multiple sources into a small number of source groups, where each group shares a codebook. We propose a new solution based on a size-limited universal codebook that can be viewed as the union of overlapping source codebooks. This framework allows each source codebook to consist of any desired subset of the universal code vectors and provides greater design flexibility which improves the storage-constrained performance. A key feature of this approach is that no two sources need be encoded at the same rate. An additional advantage of the proposed method is its close relation to universal, adaptive, finite-state and classified quantization. Necessary conditions for optimality of the universal codebook and the extracted source codebooks are derived. An iterative design algorithm is introduced to obtain a solution satisfying these conditions. Possible applications of the proposed technique are enumerated, and its effectiveness is illustrated for coding of images using finite-state vector quantization, multistage vector quantization, and tree-structured vector quantization.     

Multiplication free vector quantization usingL1 distortion measure and its variants

The author considers vector quantization that uses the L (1) distortion measure for its implementation. A gradient-based approach for codebook design that does not require any multiplications or median computation is proposed. Convergence of this method is proved rigorously under very mild conditions. Simulation examples comparing the performance of this technique with the LBG algorithm show that the gradient-based method, in spite of its simplicity, produces codebooks with average distortions that are comparable to the LBG algorithm. The codebook design algorithm is then extended to a distortion measure that has piecewise-linear characteristics. Once again, by appropriate selection of the parameters of the distortion measure, the encoding as well as the codebook design can be implemented with zero multiplications. The author applies the techniques in predictive vector quantization of images and demonstrates the viability of multiplication-free predictive vector quantization of image data.     

模糊强化学习型的图像矢量量化算法

本文给出了一种新的图像矢量量化码书的优化设计方法.传统矢量量化方法只考虑了码字与训练矢量之间的吸引影响,所以约束了最优解的寻解空间.本文提出了一种新的学习机理--模糊强化学习机制,该机制在传统的吸引因子基础上,引入新的排斥因子,极大地释放了吸引因子对最优解的寻解空间的约束.新的模糊强化学习机制没有采用引入随机扰动的方法来避免陷入局部最优码书,而是通过吸引因子和排斥因子的合力作用,较准确地确定了每个码字的最佳移动方向,从而使整体码书向全局最优解靠近.实验结果表明,基于模糊强化学习机制的矢量量化算法始终稳定地取得显著优于模糊K-means算法的性能,较好地解决了矢量量化中的码书设计容易陷入局部极小和初始码书影响优化结果的问题.     

应用于矢量量化的竞争学习算法研究

本文依据部分失真定理提出了一种应用于矢量量化的竞争学习新算法－－部分失真均衡竞争学习算法，与目前流行的多种竞争学习算法相比，该算法对于不同尺寸码书的设计均取得了最好的结果，特别是对于大尺寸码书的设计，效果更为明显。     

Fast image colourisation based on twin-codebook vector quantisation

A novel colourisation scheme for grey-level images based on twincodebook vector quantisation (TBVQ) is presented. Different from the traditional vector quantiser with the same codebook in the encoding and decoding processes, the proposed TBVQ adopts two different but related codebooks in the encoder and decoder, respectively. During the colourisation process, the target image is first encoded by the greyscale codebook and then decoded by the related chromatic codebook. Experimental results demonstrate the effectiveness and efficiency of the proposed algorithm.     

基于码本的说话人自适应方法

本文提出了一种基于码本的说话人自适应方法.它可以将变换方法和Bayes估计法这两大类说话人自适应方法的优点有机的结合起来,既能实现快速的说话人自适应,还具有良好的一致渐进性.自适应过程可分为两个阶段:在第一阶段,用由大量参考说话人的语音码本构成的线性组合来逼近用户的语音码本.此时只需要很少的自适应训练数据就可以用基于Rosen梯度投影法的优化算法计算出线性组合中各码本的最佳权值.在第二阶段,码本的最佳线性组合被用作用户码本的先验估计值.随着更多自适应训练数据的获得,系统对用户码本进一步进行Bayes估计,从而可以实现累进的自适应.作者将该方法应用于说话人无关的连续汉语语音识别系统.一系列的对比实验表明该自适应方法很有前途.     

Low complexity codebook search method in massive MIMO system

In Massive MIMO systems for 5G networks,precoding technology is one of the key technologies.Aiming at user side codebook search method of the discrete Fourier transform (DFT) rotation codebook,a low complexity search algorithm was proposed.In this algorithm,all horizontal and vertical codebooks were grouped separately according to the characteristics that the precoding vectors with the same column of DFT rotation codebooks had the smallest chordal distance and the smaller chordal distance have the stronger correlation,and then the optimal horizontal and vertical codewords with maximum channel gain were obtained to form 3D precoding code-books.The simulation results indicate that the searching complexity of the proposed method is significantly reduced under conditions of insuring the system performance,moreover,this advantage becomes greater with the number of antennas increasing.     

Linearly constrained generalized Lloyd algorithm for reducedcodebook vector quantization

As linearly constrained vector quantization (LCVQ) is efficient for block-based compression of images that require low complexity decompression, it is a “de facto” standard for three-dimensional (3-D) graphics cards that use texture compression. Motivated by the lack of an efficient algorithm for designing LCVQ codebooks, the generalized Lloyd (1982) algorithm (GLA) for vector quantizer (VQ) codebook improvement and codebook design is extended to a new linearly constrained generalized Lloyd algorithm (LCGLA). This LCGLA improves VQ codebooks that are formed as linear combinations of a reduced set of base codewords. As such, it may find application wherever linearly constrained nearest neighbor (NN) techniques are used, that is, in a wide variety of signal compression and pattern recognition applications that require or assume distributions that are locally linearly constrained. In addition, several examples of linearly constrained codebooks that possess desirable properties such as good sphere packing, low-complexity implementation, fine resolution, and guaranteed convergence are presented. Fast NN search algorithms are discussed. A suggested initialization procedure halves iterations to convergence when, to reduce encoding complexity, the encoder considers the improvement of only a single codebook for each block. Experimental results for image compression show that LCGLA iterations significantly improve the PSNR of standard high-quality lossy 6:1 LCVQ compressed images     

Image compression based on fuzzy algorithms for learning vectorquantization and wavelet image decomposition

This paper evaluates the performance of an image compression system based on wavelet-based subband decomposition and vector quantization. The images are decomposed using wavelet filters into a set of subbands with different resolutions corresponding to different frequency bands. The resulting subbands are vector quantized using the Linde-Buzo-Gray (1980) algorithm and various fuzzy algorithms for learning vector quantization (FALVQ). These algorithms perform vector quantization by updating all prototypes of a competitive neural network through an unsupervised learning process. The quality of the multiresolution codebooks designed by these algorithms is measured on the reconstructed images belonging to the training set used for multiresolution codebook design and the reconstructed images from a testing set.     

Trade-Off Analysis of a Low-Power Image Coding Algorithm

In this paper, a novel algorithm for low-power image coding and decoding is presented and the various inherent trade-offs are described and investigated in detail. The algorithm reduces the memory requirements of vector quantization, i.e., the size of memory required for the codebook and the number of memory accesses by using small codebooks. This significantly reduces the memory-related power consumption, which is an important part of the total power budget. To compensate for the loss of quality introduced by the small codebook size, simple transformations are applied on the codewords during coding. Thus, small codebooks are extended through computations and the main coding task becomes computation-based rather than memory-based. Each image block is encoded by a codeword index and a set of transformation parameters. The algorithm leads to power savings of a factor of 10 in coding and of a factor of 3 in decoding, at least in comparison to classical full-search vector quantization. In terms of SNR, the image quality is better than or comparable to that corresponding to full-search vector quantization, depending on the size of the codebook that is used. The main disadvantage of the proposed algorithm is the decrease of the compression ratio in comparison to vector quantization. The trade-off between image quality and power consumption is dominant in this algorithm and is mainly determined by the size of the codebook.     

Fast Image Coding Algorithm Using Indirect-Index Codebook Based on SMVQ

Side-match vector quantization (SMVQ) achieves better compression performance than vector quantization (VQ) in image coding due to its exploration of the dependence of adjacent pixels. However, SMVQ has the disadvantage of requiring excessive time during the process of coding. Therefore, this paper proposes a fast image coding algorithm using indirect-index codebook based on SMVQ (ⅡC-SMVQ) to reduce the coding time. Two codebooks, named indirect-index codebook (Ⅱ-codebook) and entire-state codebook (ES-codebook), are trained and utilized. The Ⅱ-codebook is trained by using the Linde-Buzo-Gray (LBG) algorithm from side-match information, while the ES-codebook is generated from the clustered residual blocks on the basis of the Ⅱ-codebook. According to the relationship between these two codebooks, the codeword in the Ⅱ-codebook can be regarded as an indicator to construct a fast search path, which guides in quickly determining the state codebook from the ES-codebook to encode the to-be-encoded block. The experimental results confirm that the coding time of the proposed scheme is shorter than that of the previous SMVQ.     

SCMA codebook design based on resource block constellation

Aiming at the problems of typical sparse code multiple access codebook design scheme based on multidimensional mother constellation that the complexity is high and the minimum Euclidean distance between constellation points on resource blocks is difficult to determine,a SCMA codebook design scheme based on resource block constellation was proposed.By converting the design of multidimensional mother constellation into the design of two-dimensional resource block constellation,the design complexity of constellation was reduced.And the codebook design scheme starting from resource block constellation could maximize the minimum Euclidean distance between constellation points on resource blocks,which was better than the design method in which user codebooks were obtained from multi-dimensional mother constellation.Simulation results show that the proposed SCMA codebook design scheme based on resource block constellation can significantly improve the BER performance of system compared with the typical codebook design scheme based on multidimensional mother constellation.     

电子封装常用名称及术语汇集

电子封装常用名称及术语汇集下面，按英文字母顺序，汇集并解释了与目前ＬＳＩ（包括ＩＣ）正在采用的主要封装形式相关联的名称术语等。这些名称术语参考并引用了日本国内１２个半导体制造公司，其他国家７个半导体制造公司＊与ＬＳＩ封装相关的资料、日本电子机械工业会...     

基于二维格星座对SCMA码本的一种设计方法

现有的SCMA(稀疏码分多址)码本采用高维复数星座和映射矩阵相结合的设计方法,存在高维复数星座设计过程复杂,且任意时频资源星座图星座点间的最小欧式距离难以控制的问题.针对上述问题提出了 一种基于时频资源星座的码本设计方法.首先设计一个二维格星座,然后通过星座优化和扩频得到特定用户的码本.所提方法不仅可以获得最大成形增益...     

模糊增强学习码书设计算法及其在图像编码中的应用

本文提出一种用于图像压缩编码的模糊增强学习码书设计算法。该算法是在模糊竞争学习矢量量化的基础上引入增强学习,并用输入训练模式的监督信号与类别模式之间的隶属度控制增强信号。实验结果表明,该算法对初始码本依赖性小,与模糊竞争学习矢量量化和微分竞争学习算法相比,收敛速度更快,性能更好。     

Space-Time Codebook Design for Spread Systems

The problem of designing space-time constellations for communication in spread multiple-antenna wireless systems over Rayleigh fading channel is addressed. Using the asymptotic union bound on error probability as design criterion, codes based on general complex-valued symbols are obtained with a gradient search optimization technique. New space-time constellations are constructed and their performance is assessed. Simulation results show that the proposed technique achieves significant performance gains over existing schemes. Since the designed codebooks do not seem to possess any structure that could reduce the memory requirements for storing the corresponding codebook, the problem of designing structured space-time constellations is also addressed. To overcome this problem, a discrete Fourier transform-based approach is adopted to design structured codebooks and their performance is evaluated. The new structured codebooks also demonstrate significant improvement over state-of-art structured schemes.