Human tracking and silhouette extraction for human–robot interaction systems

In this study, we propose a new integrated computer vision system designed to track multiple human beings and extract their silhouette with a pan-tilt stereo camera, so that it can assist in gesture and gait recognition in the field of Human–Robot Interaction (HRI). The proposed system consists of three modules: detection, tracking and silhouette extraction. These modules are robust to camera movements, and they work interactively in near real-time. Detection was performed by camera ego-motion compensation and disparity segmentation. For tracking, we present an efficient mean shift-based tracking method in which the tracking objects are characterized as disparity weighted color histograms. The silhouette was obtained by two-step segmentation. A trimap was estimated in advance and then effectively incorporated into the graph-cut framework for fine segmentation. The proposed system was evaluated with respect to ground truth data, and it was shown to detect and track multiple people very well and also produce high-quality silhouettes.

Synaptic proteome changes in the superior frontal gyrus and occipital cortex of the alcoholic brain

Cognitive deficits and behavioral changes that result from chronic alcohol abuse are a consequence of neuropathological changes that alter signal transmission through the neural network. To focus on the changes that occur at the point of connection between the neural network cells, synaptosomal preparations from post‐mortem human brain of six chronic alcoholics and six non‐alcoholic controls were compared using 2‐D differential in‐gel electrophoresis (DIGE). Functionally affected and spared regions (superior frontal gyrus, SFG, and occipital cortex, OC, respectively) were analyzed from both groups to further investigate the specific pathological response that alcoholism has on the brain. Forty‐nine proteins were differentially regulated between the SFG of alcoholics and the SFG of controls and 94 proteins were regulated in the OC with an overlap of 23 proteins. Additionally, the SFG was compared to the OC within each group (alcoholics or controls) to identify region‐specific differences. A selection was identified by MALDI‐TOF mass spectrometry revealing proteins involved in vesicle transport, metabolism, folding and trafficking, and signal transduction, all of which have the potential to influence synaptic activity. A number of proteins identified in this study have been previously related to alcoholism; however, the focus on synaptic proteins has also uncovered novel alcoholism‐affected proteins. Further exploration of these proteins will illuminate the mechanisms altering synaptic plasticity, and thus neuronal signaling and response, in the alcoholic brain.     

基于PERT技术的人员调度研究

人员成本占软件项目总成本的大部分,但是现有的Pert技术未能体现人员计划管理这重要的一环,不合理的活动指派时间可能导致人员闲置或者项目延迟.本文提出一种解决方法,基于Pert技术,结合人员闲置、项目延迟和缓冲区计算活动负责人的指派时间,以此指导项目管理,可有效减少总开销.     

基于小波系数块能量分析和混沌映射的水印算法

小波变换具有时频局部化特性和与人眼视觉特性相符的变换机制,而混沌序列具有确定、似随机、不可预测等特性.在对小波系数块能量分析的基础上,提出了一种基于小波系数块能量分析和混沌映射的水印算法.该算法具有一定的鲁棒性,并且抗破译性强.     

Human visual sensitivity based optimal local backlight dimming methodologies under different viewing conditions

An adaptive local backlight dimming algorithm is proposed considering human visual sensitivities under various viewing conditions. Local dimming amount is maximized based on contrast sensitivity function and local image characteristics to minimize perceived luminance and contrast losses maintaining image qualities. Average luminance, contrast and spatial frequency are evaluated as local image characteristics. As dimming based on local characteristics has blocking artifacts, a compensation method using edge luminance difference is proposed considering human responses. The proposed algorithms reduce backlight power consumption by 39.69% on average, with an average SSIM of 0.995. It can be increased by 5.66% with varying viewing conditions, resulting in a 45.35% power consumption reduction on average. The outperformances of the proposed algorithm in power consumption reduction and maintaining image quality are verified with various image quality metrics compared to recent dimming algorithms.     

Difficulty and complexity definitions for assembly task allocation and assignment in human–robot collaborations: A review

This paper presents a literature review on the different aspects of task allocation and assignment problems in human–robot collaboration (HRC) tasks in industrial assembly environments. In future advanced industrial environments, robots and humans are expected to share the same workspace and collaborate to efficiently achieve shared goals. Difficulty- and complexity-aware HRC assembly is necessary for human-centric manufacturing, which is a goal of Industry 5.0. Therefore, the objective of this study is to clarify the definitions of difficulty and complexity used to encourage effective collaboration between humans and robots to leverage the adaptability of humans and the autonomy of robots. To achieve this goal, a systematic review of the following relevant databases for computer science was performed: IEEE Xplore, ScienceDirect, SpringerLink, ACM Digital Library, and ASME Digital Collection. The results extracted from 74 peer-reviewed research articles published until July 2022 were summarized and categorized into four taxonomies for 145 difficulty and complexity definitions from the perspectives of (1) definition-use objectives, (2) evaluation objectives, (3) evaluation factors, and (4) evaluation variables. Next, existing definitions were primarily classified according to the following two criteria to identify potential future studies on the formulation of new definitions for human-centric manufacturing: (1) agent specificity and (2) common aspects in manual and robotic assemblies.     

A state-of-the-art survey on Augmented Reality-assisted Digital Twin for futuristic human-centric industry transformation

The combination of Augmented Reality (AR) and Digital Twin (DT) has begun to show its potential nowadays, leading to a growing research interest in both academia and industry. Especially under the current human-centric trend, AR embraces the potential to integrate operators into the new generation of Human Cyber–Physical System (HCPS), in which DT is a pillar component. Some review articles have focused on this topic and discussed the benefits of combining AR and DT, but all of them are limited to a specific domain. To fill the gap, this research conducts a state-of-the-art survey (till 17-July-2022) from the AR-assisted DT perspective across different sectors of the industrial field, covering a total of 118 selected publications. Firstly, application scenarios and functions of AR-assisted DT are summarized by following the engineering lifecycle, among which production process, service design, and Human–Machine Interaction (HMI) are hot topics. Then, improvements specifically brought by AR are analyzed according to three dimensions, namely virtual twin, hybrid twin, and cognitive twin, respectively. Finally, challenges and future perspectives of AR-assisted DT for futuristic human-centric industry transformation are proposed, including promoting product design, robotic-related works, cyber–physical interaction, and human ergonomics.     

Performance evaluation of a tactile and kinesthetic finger feedback system for teleoperation

Teleoperation during a catastrophic event requires an interface that can perform under frequently changing circumstances caused by unpredictable and dangerous conditions. Thus, teleoperation interfaces are under active development to provide both visual and haptic feedback to the fingers. However, studies of teleoperation systems with finger haptic feedback based on force profiles are difficult to conduct because of interface limitations. Therefore, in this paper, we introduce an intuitive teleoperation interface, an anthropomorphic teleoperated robot, and a hand-wearable force-feedback system that provides various feedbacks to the fingers. We combined these systems to compare and evaluated the performance of tactile and kinesthetic finger feedback using two experiments: maintaining appropriate grip force for variably fragile objects and following a force trajectory that changed in real time. Ten subjects participated in the experiments. The results were analyzed using repeated measures analysis of variance. Feedback factors differed significantly. Provision of force feedback to the user’s finger was most effective in both teleoperation experiments.     

Shifting role for human factors in an ‘unmanned’ era

Human factors practitioners (HFPs) play many different roles in the design, creation, operation and maintenance of engineered systems. Less well known are the methods which are aimed at helping with the early stages of design, which are more systems-oriented and often involve questions of the concept of operation in which the engineered system will be fielded. Emerging from the field of cognitive engineering, these methods, including simulation, cognitive work analysis, cognitive task analyses and hierarchical task analysis, will be important as autonomous systems become increasingly capable. Even the most capable systems will continue to interact with humans, and it is at these interfaces between humans and engineered systems that HFP will continue to be needed. This paper describes recent work to leverage these methods to inform concepts of operation in aviation and space, machine learning algorithms and goal-oriented human–machine collaboration.     

Human-autonomy teaming in military settings

ABSTRACT

In this Thematic Issue ‘Human-Autonomy Teaming’ of Theoretical Issues in Ergonomics Science, five U.S. military-funded research efforts are presented to discuss human factors issues in a variety of military human-autonomy teaming mission environments: dismounted infantry working with a small ground robot; intelligence analysis; human working with an intelligent agent to manage a team of heterogeneous unmanned vehicles; vehicle-mounted ground penetrating radar. The research issues addressed in this Issue are diverse – from display designs to operator performance and trust in the systems. The results and insights documented in these five articles should provide useful resources to researchers and practitioners working on intelligent and autonomous systems.