高级检索

    基于卷积注意力和前景感知分支的液滴状态实时语义分割方法

    Real-Time Semantic Segmentation Method for Droplet State Based on Convolutional Attention and Foreground-Aware Branch

    • 摘要: 数字微流控(Digital Microfluidics, DMF)作为一种新兴的跨学科技术,旨在微尺度下对离散液滴进行操控,具有低试剂消耗、高灵敏度和集成度高等特点。DMF 系统的智能化发展受限于多状态液滴的实时、高精度识别,难以实现高效的闭环反馈控制。本文提出一种基于卷积注意力和前景感知分支的实时语义分割识别模型——FANeXt,能够快速高精度识别 DMF 设备液滴。首先,改进多尺度卷积注意力模块,引入可学习的权重参数和局部分支以动态调节不同尺度的特征贡献;同时,设计了轻量化的前景感知分支(Foreground-Aware Branch),通过显式建模前背景关系来抑制背景噪声。另外,构建了涵盖液滴多种典型运动状态的 DMF 公开液滴数据集。实验结果表明,FANeXt 模型在自建数据集上表现优异,实现了平均交并比(mIoU)与推理速度(FPS)的权衡。本研究为数字微流控技术的自动化与智能化提供了高效的视觉感知方案。

       

      Abstract: Digital Microfluidics (DMF) is an emerging interdisciplinary technology. It focuses on manipulating discrete liquid droplets at the microscale. This technology offers significant advantages, including low reagent consumption, high analytical sensitivity, and high system integration. However, the intelligent development of current DMF systems faces a major bottleneck. It is highly challenging to recognize multi-state droplets with high accuracy in real time. Because of this limitation, achieving efficient closed-loop feedback control remains a difficult task.To solve this problem, this paper proposes a real-time semantic segmentation model named FANeXt. This model is specifically designed to recognize droplets in DMF devices quickly and accurately. The overall architecture relies on an improved convolutional attention mechanism and a novel foreground perception branch.The proposed model features two main technical contributions. First, we improve the multi-scale convolutional attention module. We introduce learnable weight parameters and local functional branches into the network. These additions help the model dynamically adjust the importance of features extracted from different scales. Second, we design a lightweight Foreground-Aware Branch. This component explicitly models the relationship between the droplet foreground and the chip background. By doing so, it effectively suppresses complex background noise and sharpens the droplet boundaries.Furthermore, this study constructs a comprehensive DMF droplet dataset. This dataset includes various typical motion states of droplets, such as moving, splitting, and merging.Experimental results demonstrate that the FANeXt model performs excellently on the self-built dataset. It successfully achieves an optimal balance between segmentation accuracy (evaluated by mean Intersection over Union, mIoU) and processing speed (evaluated by Frames Per Second, FPS). Ultimately, this research provides a highly efficient visual perception solution for the automation and intelligent advancement of digital microfluidics technology.

       

    /

    返回文章
    返回