Unified Semantic Modeling Framework for Large-Scale Job Understanding at LinkedIn

AI 中文解读

LinkedIn最近发布了一个统一语义建模框架，用小型语言模型就能高效理解海量招聘信息。核心亮点是：这个小模型不仅识别准确度大幅提升，还能自动适应各种不同格式的职位描述，大大降低了系统运维成本。简单来说，过去AI需要针对每种职位属性分别训练模型，就像给每把锁配一把钥匙；现在用同一个模型就能同时处理职位分类和关键信息提取，还能举一反三地应对没见过的招聘格式。这得益于团队用精心设计的合成任务对模型进行预训练，并加入推理过程让它变得更聪明。对于普通求职者而言，这将带来更精准的岗位推荐和更快速的匹配，比如你投简历时系统能自动理解“三年经验”和“熟悉Python”这些表述，不再因为理解偏差错过合适机会。对企业来说，招聘系统维护更简单，成本更低，未来我们刷招聘网站时可能会发现，推荐的职位越来越合心意了。

arXiv:2607.24783v1 Announce Type: new Abstract: Job understanding is critical to LinkedIn's mission of connecting talent with opportunity. This task involves transforming unstructured and noisy job postings into standardized or derived job attributes that power numerous LinkedIn products. However, building a scalable, cost-efficient, and high-performing job understanding system remains challenging. In this paper, we present a unified semantic modeling framework powered by a small language model (SLM) to address the challenges. We begin by fine-tuning an open-source SLM using a suite of carefully curated synthetic tasks augmented with reasoning traces. These tasks jointly target taxonomy-guided classification and taxonomy-agnostic entity extraction. This allows the resulting model to acquire robust zero-shot generalization for job understanding in structured and unstructured contexts. Building upon this foundation, we introduce a multi-adapter architecture with attribute grouping to facilitate efficient task-specific adaptation while streamlining model management across diverse downstream attributes. Offline evaluations and online A/B tests demonstrate significant performance improvement while reducing operational complexity. Our work provides practical insights into building industry-scale text understanding systems.