Tag: Reinforcement Learning (9 articles)

Deep research agents combining internal and web data leak secrets through query logs; a new benchmark and privacy-aware RL training provide metrics and solutions.

OpenEnv evolves from a standalone tool into a universal interoperability protocol for open-source agentic RL, breaking closed-loop training monopolies and enabling seamless model-environment integration.

vLLM introduces native Reinforcement Learning APIs to standardize weight synchronization and improve asynchronous training support, addressing key pain points of framework fragmentation and fragile deployments in online RL for large models.

Hugging Face's TRL library introduces delta weight sync, transmitting only the ~1-2% of weights that change between RL steps, reducing sync overhead by two orders of magnitude and making trillion-parameter async RL training dramatically cheaper.

ServiceNow AI discovered that subtle differences in vLLM V1's inference engine could crash RL training, and restored stability by fixing four critical backend issues.

This work extends reinforcement learning environments from logic puzzles to e-commerce conversations, using 8 algorithmically verifiable scenarios to train AI agents from 'chatting well' to 'getting things done'.

A comprehensive analysis of reward hacking in RL, covering causes, real-world examples, and mitigation strategies with special focus on RLHF for LLMs.

Reward hacking presents challenges in reinforcement learning due to flaws in reward functions, particularly impacting language models, necessitating further research and mitigation strategies.

Lilian Weng's new article deeply explores the evolution and new features of Transformers, revealing their ongoing impact in natural language processing.