基于PYNQ框架的深度卷积特征异构跟踪系统

针对深度卷积特征目标跟踪算法中特征提取计算量大、速度慢、难以在嵌入式平台上应用的问题,提出了一种基于PYNQ框架的目标跟踪方案,并将其部署在Zynq异构平台.首先设计基于深度卷积特征的目标跟踪算法;根据算法的特点进行软硬件划分,完成片上系统的构建;然后针对深度卷积特征提取的计算过程进行并行优化,导出加速IP核;最后在P...

Deep Convolutional Features Heterogeneous Tracking System Based on PYNQ Framework

In order to solve the problems of feature extraction in deep convolutional features visual tracking algorithm, such as large amount of computation, slow speed and difficulty in application on embedded platform, a visual tracking scheme based on PYNQ framework is proposed and deployed on Zynq heterogeneous platform. Firstly, a visual tracking algorithm based on deep convolutional features is designed. Then, according to the characteristics of the algorithm, the software and hardware are divided to complete the system-on-chip construction. Then, the calculation process of deep convolutional features extraction is optimized in parallel and derived as an accelerated IP core. Finally, via Jupyter Notebooks in the PYNQ framework, the accelerated IP core can be used as a hardware coprocessor to achieve data interaction from the bottom to the top. The experimental results show that the algorithm achieves good tracking accuracy on the benchmark OTB-2015 and UAV123. The tracking speed is up to 30 times higher than when the accelerated IP core is not integrated. Under the circumstance of considering the tracking robustness, the heterogeneous tracking system has high execution efficiency, good portability and engineering application value.