BCI Competition 2003--Data sets Ib and IIb: feature extraction from event-related brain potentials with the continuous wavelet transform and the t-value scalogram

The t-CWT, a novel method for feature extraction from biological signals, is introduced. It is based on the continuous wavelet transform (CWT) and Student's t-statistic. Applied to event-related brain potential (ERP) data in brain-computer interface (BCI) paradigms, the method provides fully automated detection and quantification of the ERP components that best discriminate between two samples of EEG signals and are, therefore, particularly suitable for classification of single-trial ERPs. A simple and fast CWT computation algorithm is proposed for the transformation of large data sets and single trials. The method was validated in the BCI Competition 2003, where it was a winner (provided best classification) on two data sets acquired in two different BCI paradigms, P300 speller and slow cortical potential (SCP) self-regulation. These results are presented here.     

基于视觉认知机理的复杂动态背景下目标提取

针对现有复杂动态背景下目标检测与提取算法存在的局限性,提出构建一种基于视觉认知机理的时空域特征交互模式,以及基于该模式的复杂动态背景下的目标检测与提取算法。该算法通过时域特征在相似空域特征上的传递和空域特征依据时域特征一致性进行捆绑两个交互作用,实现复杂动态背景下的目标检测和提取。实验结果表明该算法不仅有效克服了传统目标检测与提取算法凭借单一特征或特征组合进行复杂背景中目标提取的不稳定性,同时大大降低了虚警率。     

基于深度空时域特征融合的高动态空中多形态目标检测方法(特邀)

针对复杂背景下,依靠高超声速飞行器搭载的红外探测器对高动态空中目标的可靠探测和精确识别问题,提出了一种基于深度空时域特征融合的空中多形态目标检测方法。设计了加权双向循环特征金字塔结构提取多形态目标静态特征,并引入可切换空洞卷积,增大感受野的同时减少空域信息损失。对于时序运动特征的提取,为了抑制复杂背景噪声的同时将角点信息集中到运动区域中,通过特征点匹配法生成掩膜图,之后进行光流计算,根据计算结果设计稀疏光流特征图,利用3D卷积提取多个连续帧图像中包含的时序特征,生成三维时序运动特征图。最后,通过对图像静态特征与时序运动特征进行通道维度的拼接,实现深度空时域特征融合。大量的对比实验表明,文中方法可明显减少复杂背景下的虚假识别概率,具备高实时性的同时目标识别准确率达89.87%,满足高动态下的红外目标智能检测识别需求。     

Combining spatial filters for the classification of single-trial EEG in a finger movement task

Brain-computer interface (BCI) is to provide a communication channel that translates human intention reflected by a brain signal such as electroencephalogram (EEG) into a control signal for an output device. In recent years, the event-related desynchronization (ERD) and movement-related potentials (MRPs) are utilized as important features in motor related BCI system, and the common spatial patterns (CSP) algorithm has shown to be very useful for ERD-based classification. However, as MRPs are slow nonoscillatory EEG potential shifts, CSP is not an appropriate approach for MRPs-based classification. Here, another spatial filtering algorithm, discriminative spatial patterns (DSP), is newly introduced for better extraction of the difference in the amplitudes of MRPs, and it is integrated with CSP to extract the features from the EEG signals recorded during voluntary left versus right finger movement tasks. A support vector machines (SVM) based framework is designed as the classifier for the features. The results show that, for MRPs and ERD features, the combined spatial filters can realize the single-trial EEG classification better than anyone of DSP and CSP alone does. Thus, we propose an EEG-based BCI system with the two feature sets, one based on CSP (ERD) and the other based on DSP (MRPs), classified by SVM.     

Optimizing Spatial filters for Robust EEG Single-Trial Analysis

Due to the volume conduction multichannel electroencephalogram (EEG) recordings give a rather blurred image of brain activity. Therefore spatial filters are extremely useful in single-trial analysis in order to improve the signal-to-noise ratio. There are powerful methods from machine learning and signal processing that permit the optimization of spatio-temporal filters for each subject in a data dependent fashion beyond the fixed filters based on the sensor geometry, e.g., Laplacians. Here we elucidate the theoretical background of the common spatial pattern (CSP) algorithm, a popular method in brain-computer interface (BCD research. Apart from reviewing several variants of the basic algorithm, we reveal tricks of the trade for achieving a powerful CSP performance, briefly elaborate on theoretical aspects of CSP, and demonstrate the application of CSP-type preprocessing in our studies of the Berlin BCI (BBCI) project.     

Comprehensive common spatial patterns with temporal structure information of EEG data: minimizing nontask related EEG component

In the context of electroencephalogram (EEG)-based brain-computer interfaces (BCI), common spatial patterns (CSP) is widely used for spatially filtering multichannel EEG signals. CSP is a supervised learning technique depending on only labeled trials. Its generalization performance deteriorates due to overfitting occurred when the number of training trials is small. On the other hand, a large number of unlabeled trials are relatively easy to obtain. In this paper, we contribute a comprehensive learning scheme of CSP (cCSP) that learns on both labeled and unlabeled trials. cCSP regularizes the objective function of CSP by preserving the temporal relationship among samples of unlabeled trials in terms of linear representation. The intrinsically temporal structure is characterized by an l(1) graph. As a result, the temporal correlation information of unlabeled trials is incorporated into CSP, yielding enhanced generalization capacity. Interestingly, the regularizer of cCSP can be interpreted as minimizing a nontask related EEG component, which helps cCSP alleviate nonstationarities. Experiment results of single-trial EEG classification on publicly available EEG datasets confirm the effectiveness of the proposed method.     

基于非负矩阵分解的SAR图像目标识别

 特征提取是合成孔径雷达自动目标识别的关键技术,同时也是难点问题之一。本文提出了一种基于非负矩阵分解算法与Fisher线性判别方法的合成孔径雷达图像目标识别的方法,通过基于基向量非负加权组合的形式构建SAR目标图像,能充分利用目标的局部空间结构信息提取目标特征信息实现目标识别。首先将水平集分割预处理后的SAR目标图像样本构成初始矩阵,然后利用非负矩阵分解后得到的权向量作为目标图像的特征向量,再通过依据Fisher线性判别构成的分类器,实现对MSTAR数据中3类目标的识别,并与目前已有的几种典型方案进行对比。试验结果表明该方法是可行且有效的,并能够明显提高对目标识别的稳定性和正确率。     

基于运动想象的异步在线脑-机接口系统

目前,运动想象脑-机接口( motor imagery brain computer interface,MIBCI) 的离线分析和研究相对比较成熟,但是异步在线MIBCI始终具有挑战性。针对在线BCI系统的识别率和控制方式,提出了利用共空间模式(common spatial pattern,CSP)算法对运动想象(motor imagery,MI)进行特征提取并结合alpha波进行异步控制。构建了一种简单实用的自主控制小球运动MIBCI实验系统。有四名受试者参加了在线实验,其中有两名受试者在线运动想象识别正确率最高能达到100%。实验结果验证了本文所建系统的可行性和实用性。      

基于时序信息的红外图像缺陷信息提取

主动红外热像检测技术中,红外图像的缺陷信息提取是其核心内容。传统的红外图像处理方法在一定程度上可以消除噪声、提高图像的对比度,但是仍存在一些问题,如:需要手动选择特征信息丰富的红外图像,红外图像增强和图像分割过程中会引入主观成分,仅仅分析单张红外图像可能存在信息丢失等问题。针对上述问题,本文根据主动红外热成像的数据特征提出了一种基于时序信息的红外图像缺陷信息提取方法。首先,通过室内实验制作含缺陷分层的混凝土试块;然后,利用主动红外热像检测技术进行三维红外图像数据的采集,提取每个像素点的时序信息;最后,采用基于时序信息的K-means方法进行缺陷特征提取。结果表明,基于时序信息的缺陷提取方法是可行的,其可以提取到隐藏的分层缺陷信息,提取效果优于基于空域信息的K-means方法。     

Motor Imagery EEG Fuzzy Fusion of Multiple Classification

Due to the volume conduction, electroencephalogram (EEG) gives a rather blurred image of brain activities. It is a challenge for generating satisfactory performance with EEG. This paper studies the multiple areas fusion of EEG classifiers to improve the motor imagery EEG classification performance. Two feature extraction methods are employed to extract the feature from three different areas of EEG. One is power spectral density (PSD), and the other is common spatial patterns (CSP). Classifiers are designed based on the well-known linear discrimination analysis (LDA). The fusion of the individual classifiers is realized by means of the Choquet fuzzy integral. It is demonstrated that the proposed method comes with better performance compared with the individual classifier.     

基于YOLOv5s的改进实时红外小目标检测

针对红外图像分辨率低、背景复杂、目标细节特征缺失等问题,提出了一种基于YOLOv5s的改进实时红外小目标检测模型Infrared-YOLOv5s。在特征提取阶段,采用SPD-Conv进行下采样,将特征图切分为特征子图并按通道拼接,避免了多尺度特征提取过程中下采样导致的特征丢失情况,设计了一种基于空洞卷积的改进空间金字塔池化模块,通过对具有不同感受野的特征进行融合来提高特征提取能力;在特征融合阶段,引入由深到浅的注意力模块,将深层特征语义特征嵌入到浅层空间特征中,增强浅层特征的表达能力;在预测阶段,裁减了网络中针对大目标检测的特征提取层、融合层及预测层,降低模型大小的同时提高了实时性。首先通过消融实验验证了提出各模块的有效性,实验结果表明,改进模型在SIRST数据集上平均精度均值达到了95.4%,较原始YOLOv5s提高了2.3%,且模型大小降低了72.9%,仅为4.5 M,在Nvidia Xavier上推理速度达到28 f/s,利于实际的部署和应用。在Infrared-PV数据集上的迁移实验进一步验证了改进算法的有效性。提出的改进模型在提高红外图像小目标检测性能的同时,能够满足实时性要...     

基于时空域滤波的红外弱小目标背景抑制

在红外成像探测系统中,对红外图像背景进行有效的抑制是准确检测出弱小目标的前提条件.基于目标在空域局部灰度稳定和时域运动连续的约束,提出了一种基于时空域滤波的红外弱小目标背景抑制新方法.首先,利用引导滤波保存图像细节和时域偏微分方程提取图像中突变区域的优势,实现对图像空域与时域中平稳和强起伏不同特征复杂背景进行抑制处理;然后,将时空域背景抑制结果利用相与操作算子处理完成对高度类似弱小目标信号的剔除;最后,为恢复前期抑制结果中丢失的目标信息,利用时空域融合结果作为引导图像进行进一步优化处理,得到最终背景抑制结果.仿真实验采用两组低信杂比运动弱小目标红外图像序列进行方法验证,并将该方法与几种背景抑制方法进行了比较,实验结果表明:该方法无论从主观视觉还是客观评价指标上均优于其他几种方法.     

MCR-YOLO model for underwater target detection based on multi-color spatial features

Within the fields of underwater robotics and ocean information processing, computer vision-based underwater target detection is an important area of research. Underwater target detection is made more difficult by a number of problems with underwater imagery, such as low contrast, color distortion, fuzzy texture features, and noise interference, which are caused by the limitations of the unique underwater imaging environment. In order to solve the above challenges, this paper proposes a multi-col...     

基于Hough变换与目标主轴提取的SAR图像目标方位角估计方法

该文提出了一种基于Hough变换与目标主轴提取的SAR图像目标方位角估计方法。针对传统基于Hough变换估计方法的不足,在估计过程中引入目标的主轴信息指导方位角的估计。利用基于马尔可夫随机场(MRF)的图像分割提取准确的目标成像轮廓。在此基础上,基于Hough变换检测目标轮廓的直边,基于轮廓特征点检测获得目标主轴的大致方向,结合Hough变换检测结果与目标主轴信息获得最终的方位角估计。实验结果验证了该文方法的有效性。     

基于阴影的SAR图像车辆目标三维特征提取

目标长、宽、高三维几何特征,对SAR图像解译与目标识别等具有重要意义。从SAR成像几何出发,根据SAR观测俯仰角、目标及阴影之间的几何关系,研究提出了基于两维高分辨SAR图像阴影信息的车辆目标三维几何特征提取方法。该方法既可由某一方位角的单幅SAR图像提取目标三维几何特征,也可通过任意有限(3～5)个方位角SAR图像的融合提取目标三维几何特征,而且融合还可有效提高目标三维几何特征的提取精度。通过大量MSTAR实测SAR图像数据的实验结果,验证了其有效性。     

基于笔画宽度特征和剪枝算法的自然场景标签检测

针对自然场景标签图像背景复杂、目标区域形式多样、色调单一、空间集中等问题,提出了一种基于笔画宽度特征和剪枝算法的自然场景标签检测方法。根据图像的特点,首先利用阈值法和启发式规则,初步筛选出字符候选区;然后通过设计的笔画宽度特征提取算法,获得每一个候选区的文本相似度,融合基于惩罚函数的剪枝算法实现背景区域的滤除,得到进一步分割后的标签检测区域;使用形态学处理和区域面积的细分割后,最终生成目标检测图像。多组对比实验检测结果表明,本文算法具有良好的目标检测效果和优异的普适性。     

基于级联网络的复杂大场景SAR图像舰船目标快速检测

合成孔径雷达(synthetic aperture radar,SAR)图像舰船目标检测紧贴军事和民用需求,为海洋监视提供重要信息支撑.针对复杂大场景SAR图像,本文设计了一种基于级联网络的舰船目标检测框架,该网络框架主要由D-BiSeNet海陆分割、分块区域筛选和CP-FCOS目标检测三部分组成.通过改进双边网络(D...     

Two-stream small-scale pedestrian detection network with feature aggregation for drone-view videos

Detecting small-scale pedestrians in aerial images is a challenging task that can be difficult even for humans. Observing that the single image based method cannot achieve robust performance because of the poor visual cues of small instances. Considering that multiple frames may provide more information to detect such difficult case instead of only single frame, we design a novel video based pedestrian detection method with a two-stream network pipeline to fully utilize the temporal and contextual information of a video. An aggregated feature map is proposed to absorb the spatial and temporal information with the help of spatial and temporal sub-networks. To better capture motion information, a more refined flow net (SPyNet) is adopted instead of a simple flownet. In the spatial stream subnetwork, we modified the backbone network structure by increasing the feature map resolution with relatively larger receptive field to make it suitable for small-scale detection. Experimental results based on drone video datasets demonstrate that our approach improves detection accuracy in the case of small-scale instances and reduces false positive detections. By exploiting the temporal information and aggregating the feature maps, our two-stream method improves the detection performance by 8.48% in mean Average Precision (mAP) from that of the basic single stream R-FCN method, and it outperforms the state-of-the-art method by 3.09% on the Okutama Human-action dataset.

     

融合时空上下文信息的胸环靶着弹检测算法

为减小光照不均与随机抖动对胸环靶着弹检测精度的影响,该文提出一种融合时空上下文信息的胸环靶着弹检测算法。利用目标及其邻域的空间上下文信息进行光照均衡化,并提取胸环靶序列间时域运动上下文信息进行抖动校正。为提高胸环靶图像的稳定性,该算法提出多参数融合方法对抖动校正后的序列图像进行像素级融合。接着进行弹孔区域粗提取、能量筛选与重叠弹孔判别,获得弹孔位置分布。采用在部队靶场实地采集的图像进行实验,验证了该算法可以有效抑制光照不均与随机抖动带来的噪声影响,具有较好的弹孔提取能力。