• Acta Photonica Sinica
  • Vol. 49, Issue 1, 0110001 (2020)
Yue DONG, Yue-ting CHEN, Hua-jun FENG*, Zhi-hai XU, and Qi LI
Author Affiliations
  • State Key Laboratory of Modern Optical Instrumentation, Zhejiang University, Hangzhou 310027, China
  • show less
    DOI: 10.3788/gzxb20204901.0110001 Cite this Article
    Yue DONG, Yue-ting CHEN, Hua-jun FENG, Zhi-hai XU, Qi LI. Scene Fusion System Based on Ambient Light Detection[J]. Acta Photonica Sinica, 2020, 49(1): 0110001 Copy Citation Text show less
    The diagram of scene fusion system
    Fig. 1. The diagram of scene fusion system
    The diagram of coordinate transformation model
    Fig. 2. The diagram of coordinate transformation model
    TCS34725芯片的归一化光谱响应曲线Normalized spectral response curve of TCS34725
    Fig. 3. TCS34725芯片的归一化光谱响应曲线Normalized spectral response curve of TCS34725
    蓝-红响应值之比与色温的关系曲线Relation curve between blue-red responseratio and color temperature
    Fig. 4. 蓝-红响应值之比与色温的关系曲线Relation curve between blue-red responseratio and color temperature
    实验系统侧视图Side view of our experimental system
    Fig. 5. 实验系统侧视图Side view of our experimental system
    人眼检测结果Human eyes detection results
    Fig. 6. 人眼检测结果Human eyes detection results
    场景融合实验(室内)Scene fusion experiments (indoor)
    Fig. 7. 场景融合实验(室内)Scene fusion experiments (indoor)
    场景融合实验(室外)Scene fusion experiments (outdoor)
    Fig. 8. 场景融合实验(室外)Scene fusion experiments (outdoor)
    Color temperature/KLuminance/(cd·m-2)BrightnessContrast
    5 000000
    5 000105
    5 0002010
    5 0003020
    5 0004030
    5 0005033
    5 0006036
    5 0007042
    5 0008045
    5 0009047
    5 00010049
    5 00011050
    5 00012150
    5 00013250
    5 00014350
    5 00015450
    Table 1. An example of display parameter mapping table
    ProcessProcedureTime/msTotal/ms
    Initialize (once)Initialize the image capture camera5454 906
    Initialize the position monitoring camera828
    Initialize MTCNN model3 453
    Get luminance and color temperature, adjust display80
    Adaptive scenetransformation (loop)Get one frame of scene image, convert to Mat format71283
    Get one frame of observer image, convert to Mat format135
    MTCNN human eye detection35
    Extract eyes’ depth, calculate eyes’ 3D coordinates6
    Calculate reasonable display area16
    Crop image and display20
    Table 2. Program execution time
    Yue DONG, Yue-ting CHEN, Hua-jun FENG, Zhi-hai XU, Qi LI. Scene Fusion System Based on Ambient Light Detection[J]. Acta Photonica Sinica, 2020, 49(1): 0110001
    Download Citation