• NUCLEAR TECHNIQUES
  • Vol. 47, Issue 10, 100403 (2024)
Kunlin SHANG1, Zhengheng LI1,*, Xudong JU1, Yue ZHOU1..., Ping HUAI1,2 and Zhi LIU1|Show fewer author(s)
Author Affiliations
  • 1ShanghaiTech University, Shanghai 201210, China
  • 2Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai 201210, China
  • show less
    DOI: 10.11889/j.0253-3219.2024.hjs.47.100403 Cite this Article
    Kunlin SHANG, Zhengheng LI, Xudong JU, Yue ZHOU, Ping HUAI, Zhi LIU. Research on distributed data acquisition software for high frame rate area detectors[J]. NUCLEAR TECHNIQUES, 2024, 47(10): 100403 Copy Citation Text show less
    DAQ hardware architecture of STARLIGHT area detector
    Fig. 1. DAQ hardware architecture of STARLIGHT area detector
    Overall software architecture and data flow
    Fig. 2. Overall software architecture and data flow
    Architectural design of event reconstruction
    Fig. 3. Architectural design of event reconstruction
    Data preprocessing workflow of bitshuffle
    Fig. 4. Data preprocessing workflow of bitshuffle
    TCP-based performance test (a) Comparison of the speed of synchronous transmission between kernel API direct call and boost library, (b) Comparison of synchronous and asynchronous speed under boost library, (c) Comparison of synchronous transmission with and without thread binding under boost library
    Fig. 5. TCP-based performance test (a) Comparison of the speed of synchronous transmission between kernel API direct call and boost library, (b) Comparison of synchronous and asynchronous speed under boost library, (c) Comparison of synchronous transmission with and without thread binding under boost library
    Bandwidth analysis for multi-node case reconstruction testing
    Fig. 6. Bandwidth analysis for multi-node case reconstruction testing
    Front-end interface illustration
    Fig. 7. Front-end interface illustration
    探测器像素数帧率数据速率
    DetectorNumber of pixels / MpixelFrame rate / kHzData rate / GB·s-1
    CSPAD2.30.120.5
    AGIPD-1M1.04 500 (Burst)7.0
    JUNGFRAU-4M4.01.117.0
    ePixHR4.05.040.0
    JUNGFRAU-16M16.02.270.4
    STARLIGHT-1M1.010.020.0
    STARLIGHT-4M4.010.080.0
    Table 1. Performance comparison of high frame rate area detectors
    服务器集群Server cluster

    服务器用途

    Server role

    CPU型号

    CPU model

    内存大小

    Memory size / GB

    网卡带宽

    Network card bandwidth / Gbps

    集群A

    Cluster A

    分布式测试

    Distributed testing

    Intel Xeon 6132192100

    集群B

    Cluster B

    性能测试(接收)

    Performance testing (receive)

    Intel Xeon 6342251100

    性能测试(发送)

    Performance testing (sending)

    Intel Xeon 633450325
    Table 2. Test server configuration
    压缩方式压缩速度压缩率
    Compress methodCompress speed / MB·s-1Compress ratio
    bitshuffle+LZ4771.21.98
    bitshuffle+ZSTD (1)432.73.91

    bitshuffle+ZSTD (5)

    bitshuffle+ZSTD (10)

    192.7

    84.6

    4.49

    4.78

    LZ4624.2<1
    ZSTD (5)195.11.71
    Table 3. Test for compression rate and compression ratio
    Kunlin SHANG, Zhengheng LI, Xudong JU, Yue ZHOU, Ping HUAI, Zhi LIU. Research on distributed data acquisition software for high frame rate area detectors[J]. NUCLEAR TECHNIQUES, 2024, 47(10): 100403
    Download Citation