高级检索

    韩松, 谷小婧, 顾幸生. 基于自适应互信息的红外/深度双摄像机时空配准[J]. 华东理工大学学报(自然科学版), 2019, 45(2): 328-335. DOI: 10.14135/j.cnki.1006-3080.20180131002
    引用本文: 韩松, 谷小婧, 顾幸生. 基于自适应互信息的红外/深度双摄像机时空配准[J]. 华东理工大学学报(自然科学版), 2019, 45(2): 328-335. DOI: 10.14135/j.cnki.1006-3080.20180131002
    HAN Song, GU Xiaojing, GU Xingsheng. Spatio-Temporal Registration of Infrared and Depth Cameras Based on Adaptive Mutual Information[J]. Journal of East China University of Science and Technology, 2019, 45(2): 328-335. DOI: 10.14135/j.cnki.1006-3080.20180131002
    Citation: HAN Song, GU Xiaojing, GU Xingsheng. Spatio-Temporal Registration of Infrared and Depth Cameras Based on Adaptive Mutual Information[J]. Journal of East China University of Science and Technology, 2019, 45(2): 328-335. DOI: 10.14135/j.cnki.1006-3080.20180131002

    基于自适应互信息的红外/深度双摄像机时空配准

    Spatio-Temporal Registration of Infrared and Depth Cameras Based on Adaptive Mutual Information

    • 摘要: 红外、深度摄像机构成的双摄像机系统应用广泛,摄像机间的空间配准和时序配准影响着图像信息的整合。空间配准方面,利用不同材料的不同辐射率设计了标定板,解决了传统标定板无法标定红外、深度摄像机的问题。时序配准方面,利用搜索窗口解决了红外摄像机非一致性校正的问题;采用动态改变搜索窗口大小的方法消除了图像序列累积时间偏差;利用求取互信息的方法得到时序配准的红外、深度图像。通过实验验证了本文方法的有效性。

       

      Abstract: The dual camera system composed of the infrared camera and the depth camera has a widely application and the accuracy of spatial registration and temporal registration directly affects the integration of image information. However, the traditional calibration board cannot calibrate the infrared camera and the depth camera about spatial registration. In general, different materials may have different radiant rates. In order to deal with the spatial registration of the infrared camera and the depth camera, this paper designs a novel calibration board with different materials to achieve spatial registration. According to different radiant rates, the proposed calibration boards can solve the above shortcomings encountered in the traditional calibration board. In the temporal registration, many problems had to be taken into consideration. Different cameras might have different frame rates. Moreover, the frame rate may also fluctuate as the camera works. The precision difference of internal clock will bring cumulative time deviations to the camera image sequences. Furthermore, in order to maintain the accuracy measure signal of the temperature, the infrared camera will conduct regular non-uniformity corrections, which may yield about 1—2 s the time interruption of the camera. All of those above problems have impact on the temporal registration of cameras. To this end, this paper adopts adaptive search window to obtain the depth images and infrared images such that the effect of non-uniformity corrections from the infrared camera can be solved. By adaptively changing the size of the search window, the impact of the cumulative time deviations can be eliminated. Moreover, by calculating the mutual information between depth images and infrared images, we can obtain the depth images and infrared images that are temporal registration. Finally, the effectiveness of the proposed method is verified by experiments, which can effectively solve the temporal registration problem of different cameras with different frame rates.

       

    /

    返回文章
    返回