Rotor space-time domain image enhancement and vibration measurement method

PDF(4119 KB)

Journal of Vibration and Shock ›› 2023, Vol. 42 ›› Issue (7) : 133-142.

WANG Qingjian1, WANG Sen1, WU Xing2, LIU Xiaoqin1, LIU Tao1

Author information +

History +

Abstract

The main factors for improving the accuracy of visual vibration measurement depend on the number of samples in the captured image per unit period and the sharpness of the edge of the vibrating target in the image. However, the limited acquisition frequency and inherent resolution of industrial cameras will lead to obvious offset errors in the final obtained timing displacement signals due to the loss of spatial-temporal information. Therefore, this paper proposes a method for spatial-temporal enhancement and vibration measurement of rotor images. A fitting sample is inserted between two adjacent sample images through the video frame interpolation algorithm, thereby enhancing the number of samples collected in a unit period. In order to alleviate the phenomenon of blur, distortion and noise in the collected low-resolution images, the super-resolution reconstruction algorithm is used to restore the high-frequency information in the images. After weighing the time consumption of the algorithm and the consumption of computing resources, this paper integrates the video frame insertion and video reconstruction tasks to realize the feature information sharing of the two model tasks. The experimental results tested on the self-made high-speed vibration rotor image dataset show that compared with the current advanced algorithm, the model constructed in this paper is improved by 0.3dB and the lightweight model has better reconstruction accuracy than the advanced model while reducing the model parameters by 17.9%. The time-domain and frequency-domain signals measured at two sampling frequencies show that the vibration signals obtained by the proposed algorithm have better periodicity and stability.

Key words

video super-resolution reconstruction / video frame interpolation / visual vibration measurement / Image enhancement

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

WANG Qingjian1, WANG Sen1, WU Xing2, LIU Xiaoqin1, LIU Tao1. Rotor space-time domain image enhancement and vibration measurement method[J]. Journal of Vibration and Shock, 2023, 42(7): 133-142

References

[1] 郭俊锋,施建旭,魏兴春,等. 一种机械振动信号的结构化随机测量矩阵构造方法[J]. 振动与冲击,2017,36(7):104-109,170.
GUO Junfeng, SHI Jianxu, WEI Xingchun et al. A structured random measurement matrix GCMM for mechanical vibration signals[J]. Journal of Vibration and Shock, 2017,36(7):104-109,170.
[2] 江东,单薏,刘绪坤,等. 基于磁悬浮技术建筑物振动测量研究[J]. 振动与冲击,2017,36(7):130-135.
JIANG Dong, SHAN Yi, LIU Xukun, et al. Vibration measurement of a building based on magnetic levitation technology[J]. Journal of Vibration and Shock, 2017,36(7):104-109,170.
[3] 何祯鑫,张正义,李洪才,等. 基于光纤Bragg光栅传感的轴向柱塞泵非介入式振动测量方法[J]. 振动与冲击,2019,38(20):196-202,236.
HE Zhenxin, ZHANG Zhengyi, LI Hongcai, et al. A non-intrusive vibration measurement method of an axial piston pump based on fiber Bragg grating sensing[J]. Journal of Vibration and Shock,2019,38(20):196-202,236.
[4] 陈忠,陈教豆. 基于双目立体视觉与数字散斑图像相关的全场振动测量[J]. 振动与冲击,2015(13):121-126.
CHEN Zhong, CHEN Jiaodou. Full-field vibration measurement based on binocular stereo vision and digital speckle image correlation[J]. Journal of Vibration and Shock, 2015(13):121-126.
[5] 尹爱军,李江,张泉. 复小波离面振动检测的研究[J]. 振动与冲击,2017,36(8):60-64.
YIN Aijun, LI Jiang, ZHANG Quan. Research on out-of-plane vibration detection based on CWT[J]. Journal of Vibration and Shock, Journal of Vibration and Shock, 2017,36(8):60-64.
[6] Kim J, Lee J K, Lee K M. Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2016: 1646-1654.
[7] Tong T, Li G, Liu X, et al. Image super-resolution using dense skip connections[C]//Proceedings of the IEEE international conference on computer vision. 2017: 4799-4807.
[8] Caballero J, Ledig C, Aitken A, et al. Real-time video super-resolution with spatio-temporal networks and motion compensation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017: 4778-4787.
[9] Sajjadi M S M, Vemulapalli R, Brown M. Frame-recurrent video super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018: 6626-6634.
[10] Caballero J, Ledig C, Aitken A, et al. Real-time video super-resolution with spatio-temporal networks and motion compensation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017: 4778-4787.
[11] Tian Y, Zhang Y, Fu Y, et al. Tdan: Temporally-deformable alignment network for video super-resolution[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020: 3360-3369.
[12] Xue T, Chen B, Wu J, et al. Video enhancement with task-oriented flow[J]. International Journal of Computer Vision, 2019, 127(8): 1106-1125.
[13] Dai J, Qi H, Xiong Y, et al. Deformable convolutional networks[C]//Proceedings of the IEEE international conference on computer vision. 2017: 764-773..
[14] Wang X, Chan K C K, Yu K, et al. Edvr: Video restoration with enhanced deformable convolutional networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 2019: 0-0.
[15] Fukami K, Fukagata K, Taira K. Super-resolution reconstruction of turbulent flows with machine learning[J]. Journal of Fluid Mechanics, 2019, 870: 106-120.
[16] Xiang X, Tian Y, Zhang Y, et al. Zooming slow-mo: Fast and accurate one-stage space-time video super-resolution[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020: 3370-3379.
[17] Shi W, Caballero J, Huszár F, et al. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2016: 1874-1883.
[18] Pan J, Bai H, Tang J. Cascaded deep video deblurring using temporal sharpness prior[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020: 3043-3051.
[19] Xu Y, Gao L, Tian K, et al. Non-local convlstm for video compression artifact reduction[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2019: 7043-7052.
[20] Shi X, Chen Z, Wang H, et al. Convolutional LSTM network: A machine learning approach for precipitation nowcasting[J]. Advances in neural information processing systems, 2015, 28..
[21] Lai W S, Huang J B, Ahuja N, et al. Deep laplacian pyramid networks for fast and accurate super-resolution[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 624-632.