WavNet — Visual saliency detection using Discrete Wavelet Convolutional Neural Network

In the recent advancements in image and video analysis, the detection of salient regions in the image becomes the initial step. This plays a crucial role in deciding the performance of such algorithms. In this work, a Multi-Resolution Feature Extraction (MRFE) technique that makes use of Discrete Wavelet Convolutional Neural Network (DWCNN) for generating features is employed. An Enhanced Feature Extraction (EFE) module extracts additional features from the high level features of the DWCNN, which are used to frame both channel as well as spatial attention models for yielding contextual attention maps. A new hybrid loss function is also proposed, which is a combination of Balanced Cross Entropy (BCE) loss and Edge based Structural Similarity (ESSIM) loss that effectively identifies and segments the salient regions with clear boundaries. The method is tested exhaustively with five different benchmark datasets and is proved superior to the existing state-of-the-art methods with a minimum Mean Absolute error (MAE) of 0.03 and F-measure of 0.956.     

A comprehensive survey on computer vision based concepts,methodologies, analysis and applications for automatic gun/knife detection

The ability to detect gun and gun held in hand or other body parts is a typical human skill. The same problem presents an imperative task for computer vision system. Automatic observer independent detection of hand held gun or gun held in the other body part, whether it is visible or concealed, provides enhance security in vulnerable places and initiates appropriate action there. Compare to the automatic object detection systems, automatic detection of gun has very few successful attempts. In the present scope of this paper, we present an extensive survey on automatic detection of gun and define a taxonomy for this particular detection system. We also describe the inherent difficulties related with this problem. In this survey of published papers, we examine different approaches used in state-of-the-art attempts and compare performances of these approaches. Finally, this paper concludes pointing to the possible research gaps in related fields.     

Past is important: Improved image captioning by looking back in time

A major development in the area of image captioning consists of trying to incorporate visual attention in the design of language generative model. However, most previous studies only emphasize its role in enhancing visual composition at the current moment, while neglect its role in global sequence reasoning. This problem appears not only in captioning model, but also in reinforcement learning structure. To tackle this issue, we first propose a Visual Reserved model that enables previous visual context to be considered for the current sequence reasoning. Next, a Attentional-Fluctuation Supervised model is also proposed in reinforcement learning structure. Compared against the traditional strategies that only take non-differentiable Natural Language Processing (NLP) metrics as the incentive standard, the proposed model regards the fluctuation of previous attention matrix as an important indicator to judge the convergence of the captioning model. The proposed methods have been tested on MS-COCO captioning dataset and achieve competitive results evaluated by the evaluation server of MS COCO captioning challenge.     

Visually deficient working conditions and reduced work performance in office workers: Is it mediated by visual discomfort?

IntroductionThe main purpose of this cross-sectional study was to investigate whether visual discomfort acts as a mediating factor between perceived visual ergonomic working conditions and self-rated visual performance among office workers who carry out administrative tasks and computer-based work at the Swedish Tax Agency.MethodsA questionnaire was sent to 94 office workers addressing: 1) perceived visual quality of the visual display units; 2) prevalence of eye symptoms; and 3) self-rated visual performance. Eighty-six persons (54 women (63%), 31 men (36%), and 1 of unspecified sex) answered the questionnaire. Multiple regression analysis investigated the association between visual ergonomic working conditions and visual performance, both with and without visual discomfort as a mediator.ResultsThe group mean of the Indexed survey questions indicated a reasonably good quality of visual ergonomic working conditions, a relative absence of eye symptoms, and acceptable self-rated visual performance. Results from multiple regression analysis showed a significant association between perceived visual ergonomic working conditions and self-rated visual performance (r² = 0.30, β = 0.327, p < 0.01). When visual discomfort was used as a mediator, the association between perceived visual ergonomic working conditions and self-rated visual performance remained the same (r² = 0.32, β = 0.315, p < 0.01).DiscussionIt was remarkable to discover that self-rated visual performance was independent of visual discomfort. Possible explanations include exposure factors not included in the current study, such as dry air and sensory irritation in the eyes, psychosocial stress, time spent performing near work activities, or time exposed to visually deficient working conditions.Relevance to industryThe strong connection between satisfaction with visual ergonomic working conditions and productivity in this study has implications for workplace profitability and staff satisfaction. If productivity is enhanced by better visual ergonomic working conditions, then managers of workplaces may be able to improve work outcomes by optimizing the physical work environment.     

CV3: Visual Exploration,Assessment, and Comparison of CVs

The Curriculum Vitae (CV, also referred to as “résumé”) is an established representation of a person's academic and professional history. A typical CV is comprised of multiple sections associated with spatio‐temporal, nominal, hierarchical, and ordinal data. The main task of a recruiter is, given a job application with specific requirements, to compare and assess CVs in order to build a short list of promising candidates to interview. Commonly, this is done by viewing CVs in a side‐by‐side fashion. This becomes challenging when comparing more than two CVs, because the reader is required to switch attention between them. Furthermore, there is no guarantee that the CVs are structured similarly, thus making the overview cluttered and significantly slowing down the comparison process. In order to address these challenges, in this paper we propose “CV3”, an interactive exploration environment offering users a new way to explore, assess, and compare multiple CVs, to suggest suitable candidates for specific job requirements. We validate our system by means of domain expert feedback whose results highlight both the efficacy of our approach and its limitations. We learned that CV3 eases the overall burden of recruiters thereby assisting them in the selection process.     

Eye movements and visual discomfort when viewing stereoscopic 3D content

The visual brain fuses the left and right images projected onto the two eyes from a stereoscopic 3D (S3D) display, perceives parallax, and rebuilds a sense of depth. In this process, the eyes adjust vergence and accommodation to adapt to the depths and parallax of the points they gazed at. Conflicts between accommodation and vergence when viewing S3D content potentially lead to visual discomfort. A variety of approaches have been taken towards understanding the perceptual bases of discomfort felt when viewing S3D, including extreme disparities or disparity gradients, negative disparities, dichoptic presentations, and so on. However less effort has been applied towards understanding the role of eye movements as they relate to visual discomfort when viewing S3D. To study eye movements in the context of S3D viewing discomfort, a Shifted-S3D-Image-Database (SSID) is constructed using 11 original nature scene S3D images and their 6 shifted versions. We conducted eye-tracking experiments on humans viewing S3D images in SSID while simultaneously collecting their judgments of experienced visual discomfort. From the collected eye-tracking data, regions of interest (ROIs) were extracted by kernel density estimation using the fixation data, and an empirical formula fitted between the disparities of salient objects marked by the ROIs and the mean opinion scores (MOS). Finally, eye-tracking data was used to analyze the eye movement characteristics related to S3D image quality. Fifteen eye movement features were extracted, and a visual discomfort predication model learned using a support vector regressor (SVR). By analyzing the correlations between features and MOS, we conclude that angular disparity features have a strong correlation with human judgments of discomfort.     

镓锗铜萃余液综合利用研究与应用

本文针对镓锗铜综合回收系统产出的萃余液,设计通过中和氧化除杂、锌粉置换除铜镉、有机试剂除钴镍、纯碱法生产碱式碳酸锌、高温煅烧生产活性氧化锌和一步法生产元明粉的生产工艺流程,有效的将镓锗铜萃余液分类分离富集,产出具有价值的富集渣和工业产品,进一步提升综合回收经济效益。     

Affine hull based target representation for visual tracking

Handling appearance variations is a challenging issue in visual tracking. Existing appearance models are usually built upon a linear combination of templates. With such kind of representation, accurate visual tracking is not desirable when heavy appearance variations are in presence. Under the framework of particle filtering, we propose a novel target representation for tracking. Namely, the target candidates are represented by affine combinations of a template set, which leads to better capability in describing unseen target appearances. Additionally, in order to adapt this representation to dynamic contexts across a video sequence, a novel template update scheme is presented. Different from conventional approaches, the scheme considers both the importance of one template to a target candidate in the current frame and the recentness of the template that is kept in the template set. Comprehensive experiments show that the proposed algorithm achieves superior performances in comparison with state-of-the-art works.     

What determines the take-over time? An integrated model approach of driver take-over after automated driving

In recent years the automation level of driver assistance systems has increased continuously. One of the major challenges for highly automated driving is to ensure a safe driver take-over of the vehicle guidance. This must be ensured especially when the driver is engaged in non-driving related secondary tasks. For this purpose it is essential to find indicators of the driver’s readiness to take over and to gain more knowledge about the take-over process in general.     

Towards the Unified Principles for Level 5 Autonomous Vehicles

The rapid advance of autonomous vehicles (AVs) has motivated new perspectives and potential challenges for existing modes of transportation. Currently, driving assistance systems of Level 3 and below have been widely produced, and several applications of Level 4 systems to specific situations have also been gradually developed. By improving the automation level and vehicle intelligence, these systems can be further advanced towards fully autonomous driving. However, general development concepts for Level 5 AVs remain unclear, and the existing methods employed in the development processes of Levels 0–4 have been mainly based on task-driven function development related to specific scenarios. Therefore, it is difficult to identify the problems encountered by high-level AVs. The essential logical and physical mechanisms of vehicles have hindered further progression towards Level 5 systems. By exploring the physical mechanisms behind high-level autonomous driving systems and analyzing the essence of driving, we put forward a coordinated and balanced framework based on the brain–cerebellum–organ concept through reasoning and deduction. Based on a mixed mode relying on the crow inference and parrot imitation approach, we explore the research paradigm of autonomous learning and prior knowledge to realize the characteristics of self-learning, self-adaptation, and self-transcendence for AVs. From a systematic, unified, and balanced point of view and based on least action principles and unified safety field concepts, we aim to provide a novel research concept and develop an effective approach for the research and development of high-level AVs, specifically at Level 5.