Classification and recognition of dynamical models: the role of phase, independent components, kernels and optimal transport

We address the problem of performing decision tasks, and in particular classification and recognition, in the space of dynamical models in order to compare time series of data. Motivated by the application of recognition of human motion in image sequences, we consider a class of models that include linear dynamics, both stable and marginally stable (periodic), both minimum and non-minimum phase, driven by non-Gaussian processes. This requires extending existing learning and system identification algorithms to handle periodic modes and nonminimum phase behavior, while taking into account higher-order statistics of the data. Once a model is identified, we define a kernel-based cord distance between models that includes their dynamics, their initial conditions as well as input distribution. This is made possible by a novel kernel defined between two arbitrary (non-Gaussian) distributions, which is computed by efficiently solving an optimal transport problem. We validate our choice of models, inference algorithm, and distance on the tasks of human motion synthesis (sample paths of the learned models), and recognition (nearest-neighbor classification in the computed distance). However, our work can be applied more broadly where one needs to compare historical data while taking into account periodic trends, non-minimum phase behavior, and non-Gaussian input distributions.     

A variational approach to problems in calibration of multiple cameras

This paper addresses the problem of calibrating camera parameters using variational methods. One problem addressed is the severe lens distortion in low-cost cameras. For many computer vision algorithms aiming at reconstructing reliable representations of 3D scenes, the camera distortion effects will lead to inaccurate 3D reconstructions and geometrical measurements if not accounted for. A second problem is the color calibration problem caused by variations in camera responses that result in different color measurements and affects the algorithms that depend on these measurements. We also address the extrinsic camera calibration that estimates relative poses and orientations of multiple cameras in the system and the intrinsic camera calibration that estimates focal lengths and the skew parameters of the cameras. To address these calibration problems, we present multiview stereo techniques based on variational methods that utilize partial and ordinary differential equations. Our approach can also be considered as a coordinated refinement of camera calibration parameters. To reduce computational complexity of such algorithms, we utilize prior knowledge on the calibration object, making a piecewise smooth surface assumption, and evolve the pose, orientation, and scale parameters of such a 3D model object without requiring a 2D feature extraction from camera views. We derive the evolution equations for the distortion coefficients, the color calibration parameters, the extrinsic and intrinsic parameters of the cameras, and present experimental results.     

The multimod application framework: a rapid application development tool for computer aided medicine

This paper describes a new application framework (OpenMAF) for rapid development of multimodal applications in computer-aided medicine. MAF applications are multimodal in data, in representation, and in interaction. The framework supports almost any type of biomedical data, including DICOM datasets, motion-capture recordings, or data from computer simulations (e.g. finite element modeling). The interactive visualization approach (multimodal display) helps the user interpret complex datasets, providing multiple representations of the same data. In addition, the framework allows multimodal interaction by supporting the simultaneous use of different input-output devices like 3D trackers, stereoscopic displays, haptics hardware and speech recognition/synthesis systems. The Framework has been designed to run smoothly even on limited power computers, but it can take advantage of all hardware capabilities. The Framework is based on a collection of portable libraries and it can be compiled on any platform that supports OpenGL, including Windows, MacOS X and any flavor of Unix/linux.     

Spectral Duality for Finitely Generated Nilpotent Minimum Algebras, with Applications

We establish a categorical duality for the finitely generatedLindenbaum-Tarski algebras of propositional nilpotent minimumlogic. The latter's conjunction is semantically interpretedby a left-continuous (but not continuous) triangular norm; implicationis obtained through residuation. Our duality allows one to transferto nilpotent minimum logic several known results about inutitionisticlogic with the prelinearity axiom (also called Gödel-Dummettlogic), mutatis mutandis. We give several such applications.     

Algorithmic and architectural design for real-time and power-efficient Retinex image/video processing

This paper presents novel algorithmic and architectural solutions for real-time and power-efficient enhancement of images and video sequences. A programmable class of Retinex-like filters, based on the separation of the illumination and reflectance components, is proposed. The dynamic range of the input image is controlled by applying a suitable non-linear function to the illumination, while the details are enhanced by processing the reflectance. An innovative spatially recursive rational filter is used to estimate the illumination. Moreover, to improve the visual quality results of two-branch Retinex operators when applied to videos, a novel three-branch technique is proposed which exploits both spatial and temporal filtering. Real-time implementation is obtained by designing an Application Specific Instruction-set Processor (ASIP). Optimizations are addressed at algorithmic and architectural levels. The former involves arithmetic accuracy definition and linearization of non-linear operators; the latter includes customized instruction set, dedicated memory structure, adapted pipeline, bypasses, custom address generator, and special looping structures. The ASIP is synthesized in standard-cells CMOS technology and its performances are compared to known Digital signal processor (DSP) implementations of real-time Retinex filters. As a result of the comparison, the proposed algorithmic/architectural design outperforms state-of-art Retinex-like operators achieving the best trade-off between power consumption, flexibility, and visual quality.

Integral invariants for shape matching

For shapes represented as closed planar contours, we introduce a class of functionals which are invariant with respect to the Euclidean group and which are obtained by performing integral operations. While such integral invariants enjoy some of the desirable properties of their differential counterparts, such as locality of computation (which allows matching under occlusions) and uniqueness of representation (asymptotically), they do not exhibit the noise sensitivity associated with differential quantities and, therefore, do not require presmoothing of the input shape. Our formulation allows the analysis of shapes at multiple scales. Based on integral invariants, we define a notion of distance between shapes. The proposed distance measure can be computed efficiently and allows warping the shape boundaries onto each other; its computation results in optimal point correspondence as an intermediate step. Numerical results on shape matching demonstrate that this framework can match shapes despite the deformation of subparts, missing parts and noise. As a quantitative analysis, we report matching scores for shape retrieval from a database.     

Human cytidine deaminase: a three-dimensional homology model of a tetrameric metallo-enzyme inferred from the crystal structure of a distantly related dimeric homologue

Cytidine deaminase (CDA) is a cytosolic metalloprotein whose functional unit can be either a homotetramer (T-CDA) or a homodimer (D-CDA), depending on the species. In 1994, the first crystal structure of the dimeric Escherichia coli CDA has been published. However, a crystal structure of a tetrameric CDA was not determined until 2002. Prior to the disclosure of the experimentally elucidated structure of a tetrameric CDA, we derived a homology model of the human T-CDA employing the crystal structure of the dimeric E. coli CDA as a template. The comparison of our theoretical model with the crystal structure of the human T-CDA, subsequently published in 2004, validates our prediction: not only of the structural features of the monomer and the details of the binding site, but also the multimeric arrangement of the subunits were determined with high accuracy in our model. By means of a phylogenetic analysis conducted on CDAs from various organisms, we demonstrate that the E. coli CDA is one of the furthest known homologues of the human enzyme. Nonetheless, despite the evolutionary distance and, more importantly, the different multimeric arrangement of their functional units, the E. coli CDA proved to have all the necessary information to accurately infer the structure of its human homologue.     

Dissipation in vibrating superleak second sound transducers

We have performed an experimental study of the generation and detection of second sound in⁴He using vibrating superleak second sound transducers. At temperatures well belowT and for low driving amplitudes, the magnitude of the generated second sound wave is proportional to the drive amplitude. However, nearT and for high drive amplitudes this is no longer the case—instead, the second sound amplitude saturates. In this regime we also find that overtones of the drive frequency are generated. Our results suggest that this behavior is due to critical velocity effects in the pores of the superleak in the generator transducer. This type of measurement may prove to be a useful way in which to study critical velocity effects in confined geometries.