Analogue VLSI primitives for perceptual tasks in machine vision

A variety of computational tasks in early vision can be formulated through lattice networks. The cooperative action of these networks depends upon the topology of interconnections, both feedforward and recurrent ones. The Gabor-like impulse response of a 2nd-order lattice network (i.e. with nearest and next-to-nearest interconnections) is analysed in detail, pointing out how a near-optimal filtering behaviour in space and frequency domains can be achieved through excitatory/inhibitory interactions without impairing the stability of the system. These architectures can be mapped, very efficiently at transistor level, on VLSI structures operating as analogue perceptual engines. The hardware implementation of early vision tasks can, indeed, be tackled by combining these perceptual agents through suitable weighted sums. Various implementation strategies have been pursued with reference to: (i) the algorithm-circuit mapping (current-mode and transconductor approaches); (ii) the degree of programmability (fixed, selectable and tunable); and (iii) the implementation technology (2 and 0.8 gate lengths). Applications of the perceptual engine to machine vision algorithms are discussed.     

A portable stereo vision system for whole body surface imaging

This paper presents a whole body surface imaging system based on stereo vision technology. We have adopted a compact and economical configuration which involves only four stereo units to image the frontal and rear sides of the body. The success of the system depends on a stereo matching process that can effectively segment the body from the background in addition to recovering sufficient geometric details. For this purpose, we have developed a novel sub-pixel, dense stereo matching algorithm which includes two major phases. In the first phase, the foreground is accurately segmented with the help of a predefined virtual interface in the disparity space image, and a coarse disparity map is generated with block matching. In the second phase, local least squares matching is performed in combination with global optimization within a regularization framework, so as to ensure both accuracy and reliability. Our experimental results show that the system can realistically capture smooth and complete whole body shapes with high accuracy.     

Stereo effect of image converted from planar

Research on planar-to-stereo image conversion has significant theoretical and practical implications for image processing. In this paper we use a method which segments an image into sub-blocks to perform this kind of conversion; parameters such as random variables are used for conversion control. We use two quantitative criteria, cross-entropy and root-mean-square error, to evaluate the stereo effect. Furthermore, the stereo effect that the random variables create is discussed. The results of the experiment show that, (i) when all random variables have the same distribution, different values of these random variables only slightly affect the stereo effect; and (ii) when different distributions are applied to the random variables, the cross-entropies or root-mean-square errors are slightly different, which indicates different distributions have a small influence on the stereo effect. Generally, we recommend normal distribution for better stereo effect in most cases.     

立体声红外无线耳机和发射机研制

介绍了立体声红外无线耳机和发射机的工作原理，设计了一种实用电路，给出了主要性能指标。其优点是保真度高、频响宽、抗干扰性能好、成本低。     

3D information extraction using Region-based Deformable Net for monocular robot navigation

This paper extends the Region-based Deformable Net (RbDN) technique described in [1] to extract the 3D information of all the objects in the scene from a single moving camera. The technique is used for segmenting real-time video sequences captured from a single moving camera. The deformation process tracks the changes in the location and the shape of the segments across the frames. These changes along with the camera displacement are used to estimate the 3D information. The algorithm is completely autonomous and does not require pre-knowledge, training, or assumption about the contents of the sequence. It can handle the difficult case where the motion of the camera is parallel to its optical axis. It can also estimate the distances to objects that are more than 100 m away as long as the camera displacement is over 10% of the expected distance to the objects.     

Convolutional neural network based deep conditional random fields for stereo matching

Stereo matching has been studied for many years and is still a challenge problem. The Markov Random Fields (MRF) model and the Conditional Random Fields (CRF) model based methods have achieved good performance recently. Based on these pioneer works, a deep conditional random fields based stereo matching algorithm is proposed in this paper, which draws a connection between the Convolutional Neural Network (CNN) and CRF. The object knowledge is used as a soft constraint, which can effectively improve the depth estimation accuracy. Moreover, we proposed a CNN potential function that learns the potentials of CRF in a CNN framework. The inference of the CRF model is formulated as a Recurrent Neural Network (RNN). A variety of experiments have been conducted on KITTI and Middlebury benchmark. The results show that the proposed algorithm can produce state-of-the-art results and outperform other MRF-based or CRF-based methods.     

关于聚焦诱导立体显示器的研究

传统的立体显示是通过聚焦诱导,进行深度视觉模糊调节,从而达到立体视觉效果。现在,科研人员开发了一种新型技术——聚焦修正。通过这项技术,将聚焦诱导和深度视觉模仿同步进行,可以使立体景象显示更加快速、准确,同时减轻观看者的视觉疲劳度。     

Stereo Video Retargeting with Representative Seams in a Group of Stereoscopic Frames

The important requirements for stereo video retargeting are threefold: keeping temporal coherence, preventing depth distortion, and minimizing shape distortions of the retargeted video. To meet these requirements, the left and right video sequences are divided into groups of frames (GoFs), where the GoF is a basic unit for the seam carving and we assign a set of fixed seams for all frames within the GoF. To determine the fixed seams for each GoF, we need to find the GoF boundary in the video first. Then, the representative frame for each GoF is generated by considering the spatial saliency and temporal coherence. Also, the confidence of the stereoscopic correspondence between the left and right frames is considered to prevent depth distortion.     

多功能电视伴音广播系统及发展

本文详细介绍了多功能电视伴音广播系统及发展概况。主要包括发送和接收两部分所需要采取的技术措施,并对多功能电视伴音在几个主要国家的发展进行了比较。     

多路立体声光纤数字传输设备的研制

介绍一种新研制的多路立体声光纤数字传输设备 ,重点阐述方案设计的思路 ,简略介绍 PCM的基本技术原理 ,侧重讨论发送机和接收机的技术问题。