Consistent Video Filtering for Camera Arrays

Visual formats have advanced beyond single‐view images and videos: 3D movies are commonplace, researchers have developed multi‐view navigation systems, and VR is helping to push light field cameras to mass market. However, editing tools for these media are still nascent, and even simple filtering operations like color correction or stylization are problematic: naively applying image filters per frame or per view rarely produces satisfying results due to time and space inconsistencies. Our method preserves and stabilizes filter effects while being agnostic to the inner working of the filter. It captures filter effects in the gradient domain, then uses input frame gradients as a reference to impose temporal and spatial consistency. Our least‐squares formulation adds minimal overhead compared to naive data processing. Further, when filter cost is high, we introduce a filter transfer strategy that reduces the number of per‐frame filtering computations by an order of magnitude, with only a small reduction in visual quality. We demonstrate our algorithm on several camera array formats including stereo videos, light fields, and wide baselines.     

Automatic and Efficient Human Pose Estimation for Sign Language Videos

We present a fully automatic arm and hand tracker that detects joint positions over continuous sign language video sequences of more than an hour in length. To achieve this, we make contributions in four areas: (i) we show that the overlaid signer can be separated from the background TV broadcast using co-segmentation over all frames with a layered model; (ii) we show that joint positions (shoulders, elbows, wrists) can be predicted per-frame using a random forest regressor given only this segmentation and a colour model; (iii) we show that the random forest can be trained from an existing semi-automatic, but computationally expensive, tracker; and, (iv) introduce an evaluator to assess whether the predicted joint positions are correct for each frame. The method is applied to 20 signing footage videos with changing background, challenging imaging conditions, and for different signers. Our framework outperforms the state-of-the-art long term tracker by Buehler et al. (International Journal of Computer Vision 95:180–197, 2011), does not require the manual annotation of that work, and, after automatic initialisation, performs tracking in real-time. We also achieve superior joint localisation results to those obtained using the pose estimation method of Yang and Ramanan  (Proceedings of the IEEE conference on computer vision and pattern recognition, 2011).     

Ray casting architectures for volume visualization

Real-time visualization of large volume data sets demands high-performance computation, pushing the storage, processing and data communication requirements to the limits of current technology. General-purpose parallel processors have been used to visualize moderate-size data sets at interactive frame rates; however, the cost and size of these supercomputers inhibits the widespread use for real-time visualization. This paper surveys several special-purpose architectures that seek to render volumes at interactive rates. These specialized visualization accelerators have cost, performance and size advantages over parallel processors. All architectures implement ray casting using parallel and pipelined hardware. We introduce a new metric that normalizes performance to compare these architectures. The architectures included in this survey are VOGUE, VIRIM, Array-Based Ray Casting, EM-Cube and VIZARD II. We also discuss future applications of special-purpose accelerators     

Design and implementation of a software simulation engine

Gate-level logic simulation takes up more CPU time as system complexity increases. A special-purpose system which can cut verification time by several orders of magnitude is described. The Yorktown Simulation Engine (YSE) is a highly parallel programmable machine which can simulate up to 1 M gates at a speed of over 2000M gate simulations per second. It is estimated that the IBM 3081 processor could have been simulated at over 1 000 instructions per second on YSE. Gate-level logic simulation is reviewed and the architecture and hardware implementation of the YSE is described. The software architecture, including compiler, linker and register-level language translator, Ysetran, architecture, are detailed.     

Evaluation of artery visualizations for heart disease diagnosis

Heart disease is the number one killer in the United States, and finding indicators of the disease at an early stage is critical for treatment and prevention. In this paper we evaluate visualization techniques that enable the diagnosis of coronary artery disease. A key physical quantity of medical interest is endothelial shear stress (ESS). Low ESS has been associated with sites of lesion formation and rapid progression of disease in the coronary arteries. Having effective visualizations of a patient's ESS data is vital for the quick and thorough non-invasive evaluation by a cardiologist. We present a task taxonomy for hemodynamics based on a formative user study with domain experts. Based on the results of this study we developed HemoVis, an interactive visualization application for heart disease diagnosis that uses a novel 2D tree diagram representation of coronary artery trees. We present the results of a formal quantitative user study with domain experts that evaluates the effect of 2D versus 3D artery representations and of color maps on identifying regions of low ESS. We show statistically significant results demonstrating that our 2D visualizations are more accurate and efficient than 3D representations, and that a perceptually appropriate color map leads to fewer diagnostic mistakes than a rainbow color map.     

Preliminary results of muscle cuff cervicoplasty in the ewe for the treatment of urinary incontinence

We describe a childhood mitochondrial disorder in which the clinical symptoms began and remained confined to the gastrointestinal (GI) system during the first 4 y. Seizures heralded the onset of progressive encephalopathy at age 7. Peripheral neuropathy, retinitis pigmentosa, and neural deafness developed subsequently. Laboratory investigations disclosed elevated levels of plasma lactate, and a muscle biopsy revealed ragged red fibers lacking cytochrome c oxidase activity and diminished levels of respiratory chain enzyme complexes. Molecular genetic tests failed to show any of the previously reported pathogenic mitochondrial DNA (mtDNA) mutations. We therefore screened the whole mitochondrial genome by coupling restriction digestions with single-strand conformational polymorphism (SSCP) patterns. We identified a unique SSCP in the segment that encompassed the tRNA(Lys) gene, and direct sequencing of this segment revealed a G-->A transition at an evolutionarily conserved nucleotide at mtDNA position 8313. This G8313A transition was heteroplasmic in muscle and fibroblasts of the patient, but was absent in the white blood cells and platelets from his maternal relatives. This report illustrates how GI symptoms can be the initial manifestation in a mitochondrial disorder and suggests that mitochondrial dysfunction should be considered in differentials of unexplained chronic GI symptoms, especially when lactic acidosis or other unrelated clinical signs or symptoms are present.     

Synthesis of Allylarenes via Catalytic Decarboxylation of Allyl Benzoates

A catalyst system consisting of the palladium(0) complex Pd₂(dba)₃ and tri(p‐tolyl)phosphine was found to efficiently promote the decarboxylation of allyl benzoates with formation of allylarenes. This catalytic C O activation followed by extrusion of carbon dioxide and C C bond formation represents a sustainable alternative to traditional waste‐intensive cross‐couplings. The scope of the transformation includes allyl and cinnamyl esters of various ortho‐substituted benzoic acids. For particularly activated substrates, the palladium catalyst can optionally be replaced by an inexpensive nickel complex.