跳到主要导航 跳到搜索 跳到主要内容

Adaptive Preference Arithmetic: Modeling Dynamic Preference Strengths for LLM Agent Personalization

  • Hongyi Nie
  • , Yaqing Wang
  • , Mingyang Zhou
  • , Feiyang Pan
  • , Quanming Yao
  • , Zhen Wang
  • Northwestern Polytechnical University Xian
  • Beijing Institute of Mathematical Sciences and Applications
  • Tsinghua University

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

1 引用 (Scopus)

摘要

As large language models (LLMs) are increasingly used as personalized user assistants, effectively adapting to users' evolving preferences is critical for delivering high-quality personalized responses. While user preferences are often stable in content, their relative strengths shift over time due to changing goals and contexts. Therefore, modeling these dynamic preference strengths can enable finer-grained personalization. However, current methods face two major challenges: (i) limited user feedback makes it difficult to estimate preference strengths accurately, and (ii) natural language ambiguity limits the controllability of preference-guided generation. To address these issues, we propose AdaPA-Agent, a LLM-agent personalization framework that models dynamic preference strengths via Adaptive Preference Arithmetic. First, instead of requiring additional user feedback, AdaPA-Agent employs an alignment-based strength estimation module to estimate the strength of user preferences from the existing user-agent interaction. Then, it guides controllable personalized generation by linearly combining next-token distributions, weighted by the estimated strengths of individual preferences. Experiments on two personalization tasks-conversational recommendation and personalized web interaction-demonstrate that AdaPA-Agent better aligning with users' changing intents, and has achieved over 18.9% and 14.2% improvements compared to ReAct, the widely-used agent framework.

源语言英语
主期刊名39th Conference on Neural Information Processing Systems, NeurIPS 2025
出版商Neural information processing systems foundation
页115166-115191
页数26
ISBN(电子版)9798331338275
出版状态已出版 - 2025
活动39th Conference on Neural Information Processing Systems, NeurIPS 2025 - San Diego, 美国
期限: 2 12月 2025 → 7 12月 2025

丛书

姓名Advances in Neural Information Processing Systems
卷38
ISSN(印刷版)1049-5258

会议

会议39th Conference on Neural Information Processing Systems, NeurIPS 2025
国家/地区美国
市San Diego
时期2/12/25 → 7/12/25

学术指纹

探究 'Adaptive Preference Arithmetic: Modeling Dynamic Preference Strengths for LLM Agent Personalization' 的科研主题。它们共同构成独一无二的学术指纹。

引用此