Daily Tech Briefing
AI 科技速览
每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。
arXiv Machine Learning · 2026/8/2 08:18:56
Logit-Origin Centering for Singleton Test-Time Adaptation
AI 中文解读
日志中心化技术让AI模型在“单打独斗”时也能保持高水准。这项研究直击AI落地中的一大痛点:当模型部署到真实环境,遇到和训练数据不太一样的新数据时,表现往往会掉线。以往通过“参考队友的平均水平”来纠偏的批处理方法,在数据只能逐个到来时彻底失效。研究团队提出的PLOC方法极为轻巧,它只靠记录一个历史判断的“平均分”来微调自身,无需改动模型内部结构,也不依赖任何额外标签。
这项技术的实际意义在于,它能大幅提升AI在动态场景下的应变能力。比如在医院,不同批次病人的检查数据分布可能因设备或人群变化而产生偏移,PLOC方法能让辅助诊断模型在拿到每一个新病例时都即时校准判断;在金融风控、工业质检等领域,它也能让系统在数据流式涌入时实时适应,无需昂贵的重训练。更值得关注的是,该方案在保持模型原有区分能力(AUROC)的同时,仅占用一个数值的存储开销,为资源受限的边缘设备部署AI提供了新的可能。
Tabular data is used extensively in many real-world use cases. Deep learning models have been developed to deal with tabular data, but generally perform poorly when the test data distribution differs from that of the training data. Researchers have proposed test-time adaptation approaches to deal with this problem. The fully test-time adaptation (FTTA) setting involves adapting deployed classifiers to shifted target distributions using only unlabeled test data. Leading FTTA methods inherit a batch-dependent approach from computer vision literature. This paper demonstrates for the first time that such approaches degrade sharply in strict streaming regimes where examples arrive and must be classified one at a time. This occurs because at a batch size of one, batch-level statistics become unavailable or poorly estimated. We argue that singleton tabular FTTA is not merely a small-batch variant of ordinary FTTA, but a distinct identifiability problem where only the location of the model's score stream remains directly observable. To address this, we propose Prequential Logit-Origin Centering (PLOC), a lightweight approach that keeps the source model frozen and shifts the logit space at each step. PLOC stores only a single running number (the mean of past logits), requires no labels, estimates no priors, and bypasses weight updates entirely. A deferred variant applies a static shift that preserves the source ranking, and thus the AUROC, exactly. Evaluated across five tabular benchmarks, three architectures (MLP, FT-Transformer, and TabTransformer), and five independent source checkpoints, PLOC significantly outperforms strong tabular and entropy-based baselines.
分享
阅读原文 ↗