高级检索

    DCMC-Agent:动态人物表情包配文的自主智能体

    DCMC-Agent: An Autonomous Agent for Dynamic Character Meme Captioning

    • 摘要: 随着社交媒体的快速发展,动态人物表情包已成为网络文化传播的重要载体,但现有配文生成方法主要针对静态图像设计,难以处理视频时序特性,且依赖大规模数据集,成本高昂。为此,本文提出DCMC-Agent自主智能体框架,模拟人类“观察-思考-表达”的创作心流,以零样本的方式赋能任意视觉语言模型(Visual Language Model,VLM)。框架包含动态感知模块(Grid Image Embedding, GIE)、结构化推理模块(Semantic Richness Prompting, SR-prompt)和检索增强与自适应生成模块(Retrieval-Augmented Adaptive Generation, RAAG)。实验表明,在DFM-QA数据集上,DCMC-Agent赋能的DeepSeek-VL2各项指标均超越GPT-4o及微调模型等基线,验证了本框架在动态人物表情包配文任务上的可行性。

       

      Abstract: With the rapid proliferation of social media, dynamic character memes have become a pivotal vehicle for the dissemination of internet culture, posing significant challenges to the multimodal understanding and creative text generation capabilities of modern models. Existing methods, predominantly designed for static images, struggle to process the temporal dynamics of videos and often rely on costly large-scale datasets for training. To address these issues, this paper introduces DCMC-Agent, an autonomous agent framework that simulates the complete human creative workflow of “observe-think-express” for meme generation. The framework operates in a training-free, zero-shot manner and is capable of empowering any Vision-Language Model. Specifically, its Grid Image Embedding Module(GIE) efficiently encodes dynamic video signals into a static visual representation comprehensible to a VLM. Concurrently, the Semantic Richness Prompting Module(SR-Prompt) guides the model through deep analysis and creative ideation via multi-dimensional prompts, while the Retrieval-Augmented Adaptive Generation Module(RAAG) integrates external knowledge and user feedback for continuous content optimization. Experiments conducted on the DFM-QA dataset demonstrate that DCMC-Agent, empowering the DeepSeek-VL2 model, surpassed all baselines, including GPT-4o and fine-tuned models, across all metrics. This validates the framework's advanced design and effectiveness in handling complex, domain-specific multimodal tasks.

       

    /

    返回文章
    返回