Weak-to-Strong Learning in Decision Making

AI 中文解读

想象一下，你只有几十张带标签的图片，却想训练一个能识别百万张图片的AI——这听起来像天方夜谭，但一篇最新论文提出了一种叫“弱到强学习”的方法，让不可能变成可能。它的核心思路很简单：先用少量高质量数据训练一个“弱老师”模型，再用这个老师去给大量无标签数据打上“软标签”，最后让一个“强学生”模型跟着这些软标签学习。结果发现，只要老师和学生学到的特征“相关性”够低，无标签数据就能帮学生避开老师的错误，从而做出更优决策。这项技术对普通人最直接的影响，就是那些依赖预测的决策会更靠谱。比如电商平台预测销量，或者社交平台审核违规评论——以前因为历史数据少、成本高，模型往往不准。现在用少量评论案例就能训练出高效模型，你的购物清单推荐会更精准，评论区也会更快被清理干净。说白了，“弱到强学习”就是用更少的花费，换来更聪明的AI。

arXiv:2607.18467v1 Announce Type: new Abstract: Many operational decisions rely on predictive models that estimate uncertain outcomes conditional on observable contexts. Training such models, however, often faces a fundamental data asymmetry: labeled outcomes are scarce or costly to obtain, while contextual covariates are abundant. Motivated by this data asymmetry, we develop a decision-aware weak-to-strong (W2S) framework that leverages both labeled and unlabeled data to improve contextual stochastic optimization. Specifically, we first train a weak model using limited labeled data and then use it to generate predicted outcome distributions on unlabeled contexts. These distributions provide soft supervision for training a strong model. We establish a non-asymptotic upper bound on the excess decision risk of W2S and a complementary lower bound for a strong-only benchmark. Their comparison yields explicit sufficient conditions under which W2S improves downstream decision performance. The key quantity is the correlation dimension between the weak and strong feature representations: when it is small, abundant unlabeled data reduce the effect of teacher errors along non-overlapping directions. A synthetic newsvendor experiment and a comment moderation experiment based on real-world data provide empirical evidence consistent with the theory.