RRS-10K: A Multitask Vision-Language Model Benchmark for Rare Remote Sensing Image Interpretation

AI 中文解读

RRS-10K来了！这是首个专门评测AI在罕见遥感图像（比如军事基地、特殊设施）理解能力的基准测试。以前评测用的都是常见的城市、乡村照片，AI表现不错，但一遇到少见场景就露馅了。这个新基准收录了超过一万张一手军用遥感图像，搭配各种问答任务，从基础的感知识别到复杂的推理判断全面考验。结果发现，现有的顶尖视觉语言模型在罕见场景下只能算“及格”，尤其在视觉定位、分割出指定物体以及理解复杂语义关系时频频翻车。这项研究的意义在于，它为开发更可靠的遥感AI指明了方向——要想让AI真正读懂卫星图、无人机图像里的长尾场景，还有很长的路要走。对普通人而言，这意味着未来国防监控、灾害评估等领域的自动化分析会更精准，间接保障我们的安全和生活效率。

arXiv:2607.24810v1 Announce Type: new Abstract: Vision-language models (VLMs) have achieved strong performance on general remote sensing tasks. However, their capability for rare scenes remains insufficiently understood, because existing benchmarks are dominated by common urban and rural imagery. To address this gap, we present RRS-10K, a benchmark for rare remote sensing image interpretation. RRS-10K contains 10,738 military-related remote sensing images and corresponding multiple format question-answer pairs for comprehensive evaluation. All of the images are collected from first-hand sources and organized into three capability dimensions, six sub-dimensions, and 20 leaf tasks, covering perception, reasoning, and robustness. To improve the quality of multiple-choice questions, we introduce a similarity-based distractor filtering strategy (SDFS) during benchmark construction. We further evaluate 52 representative models and show that current VLMs achieve only moderate zero-shot performance on rare remote sensing image interpretation, with clear weaknesses in visual grounding, referring segmentation, and complex semantic reasoning tasks. RRS-10K enables systematic analysis of failure modes in long-tail remote sensing interpretation and provides guidance for developing more reliable remote sensing VLMs.