Measuring Distortion in the Empty Regions of Dimensionality Reduction Scatterplots with the Gap Index

AI 中文解读

搞懂高维数据可不容易，科学家常用“降维”技术把复杂数据压成平面散点图，但图上的空白区域往往藏着猫腻。这次提出的“Gap Index”指标，专门盯住这些空白区域，检查它们有没有被扭曲。以前的质量指标只关注点与点之间的关系，就像只看演员不看舞台布景，但空白区域的变形其实会严重影响我们看图时的直觉判断。这个新方法把空白区域拆成一个个小三角形，跟原始高维空间里的对应三角形对比，算出变形程度，还能用颜色叠加在图上，让人一眼看出哪里失真。最厉害的是，它比传统指标更敏感，一些结构上细微但视觉上很明显的变形都逃不过它的眼睛，而且算得快、好理解。对普通人来说，虽然平时用不到这么专业的技术，但这项研究能让数据可视化的工具变得更可靠，无论是医疗诊断、商业分析还是天气预报，未来我们用这些图表做判断时，被“漂亮但骗人”的图形误导的风险就大大降低了。

Quality metrics play a crucial role in the proper use of dimensionality reduction projections for visual analysis of high-dimensional data. They quantify the degree of distortion of a projection compared to the high-dimensional data and provide a reliable indication of how confident users can be in the structures they see in the resulting layouts. However, most popular metrics focus on capturing direct relationships between points (e.g., distances or neighborhoods) while neglecting distortions in empty areas of the layout, even though these often compose visually relevant features of a 2D layout. In this paper, we introduce the Gap Index (GI), a quality metric for 2D projections that captures visual distortion by measuring spatial distortion in empty areas of a projection. It does so by decomposing the space into empty triangles, which are then compared to their high-dimensional counterparts to compute the deformation. This per-triangle deformation can be aggregated into a single scalar value or overlaid on a projection to visualize regional distortion patterns. Results show that, contrary to popular quality metrics, the GI is sensitive to small structural deformations that have high visual impact. It is also fast to compute and interpretable.