Daily Tech Briefing
AI 科技速览

每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。

AI 快讯
arXiv AI · 2026/7/30 17:40:05

DualG-MRAG: Decoupling Macro-Reasoning and Micro-Matching for Multimodal Retrieval-Augmented Generation

AI 中文解读
多模态检索增强生成技术迎来新突破,科学家开发出一套"双网协同"系统,让AI在面对复杂问题时不再"看一抓一"地瞎蒙答案。这项研究的核心改进在于:AI在回答问题前,会先用一张"地图"规划全局推理路线,再用另一张"放大镜"仔细核对视觉细节,两张网络各司其职,避免了信息过载造成的推理混乱。传统方法要么只关注单张图片或文字片段,缺乏全局联系;要么试图把海量细节全部塞进模型,结果系统不堪重负、噪音干扰严重。新方案巧妙地把"想思路"和"找证据"分开处理,就像解题时先列提纲、再逐项验证,最后还能给出清晰的推理链条供人审查。对普通人来说,这意味着未来AI助手查资料会更靠谱——比如你问它"这张X光片显示骨折了吗",它能结合医学影像和病历记录得出逻辑严谨的结论,而不是简单堆砌匹配结果。这项技术还有望提升智能教育、医疗辅助诊断等场景下AI的可靠程度,减少"一本正经胡说八道"的情况。
While Multimodal Retrieval-Augmented Generation (MM-RAG) has shown promising results, it still struggles with complex multi-hop reasoning tasks. Existing methods primarily focus on independent instance-level matching, which often fails to capture explicit relationships across modalities and documents. Although Graph-enhanced methods introduce structural modeling, they face a fundamental challenge in multimodal scenarios: incorporating fine-grained visual features leads to rapid graph expansion and retrieval noise, whereas coarse-grained representations cause the discarding of critical local evidence. To address this dilemma, we propose DualG-MRAG, a Dual-tier framework that introduces a decoupled architecture comprising Macro-reasoning and Micro-matching Graphs for Multimodal RAG. Specifically, to suppress retrieval noise by isolating global structural reasoning from fine-grained evidence matching, we construct a Macro Graph for global topological routing and a Micro Graph for precise local verification. Subsequently, to enable dynamic relevance propagation across heterogeneous evidence sources, we formulate retrieval as a query-driven message passing process via a GNN Retriever. Furthermore, to provide the generative model with coherent structural guidance, we introduce a dynamic programming decoding mechanism that extracts explicit reasoning paths directly from the GNN's forward pass, replacing the standard input of isolated document chunks. Extensive experiments demonstrate that DualG-MRAG outperforms baselines in both evidence recall and complex QA accuracy.
分享
阅读原文