RUMAD: Reinforcement-Unifying Multi-Agent Debate
#RUMAD #Reinforcement learning #Multi‑agent debate #Dynamic topology control #PPO controller #Content‑agnostic observation #Multi‑objective reward #Dual‑threshold mechanism #Token efficiency #MMLU #GSM8K #GPQA #Zero‑shot generalization
📌 Key Takeaways
- RUMAD reframes dynamic communication topology in multi‑agent debate as a reinforcement learning task.
- Uses a content‑agnostic observation scheme that captures high‑level debate dynamics without accessing raw reasoning texts.
- Employs a multi‑objective reward combining solution quality, cohesion, and efficiency.
- A PPO‑trained controller dynamically adjusts edge weights in the communication graph.
- Dual‑threshold mechanism fine‑grains agent activation and information visibility.
- Experiments on MMLU, GSM8K, and GPQA reduce token costs by over 80% while improving accuracy.
- Model trained exclusively on MMLU demonstrates zero‑shot generalization to out‑of‑domain benchmarks.
📖 Full Retelling
In a February 2026 submission to the Artificial Intelligence category on arXiv, researchers Chao Wang, Han Lin, Huaze Tang, Huijing Lin, and Wenbo Ding introduce RUMAD: Reinforcement‑Unifying Multi‑Agent Debate, a framework that frames dynamic communication topology control in multi‑agent debate (MAD) as a reinforcement learning problem. The paper proposes a content‑agnostic observation scheme and a multi‑objective reward to balance solution quality, cohesion, and efficiency, with a PPO‑trained controller adjusting graph edge weights and a dual‑threshold mechanism controlling agent activation and information visibility. Experiments on MMLU, GSM8K, and GPQA show that RUMAD can cut token costs by over 80 % while improving reasoning accuracy, including robust zero‑shot generalization to out‑of‑domain tasks. The authors argue that RUMAD offers an efficient, robust approach for deploying resource‑constrained multi‑agent reasoning systems.
🏷️ Themes
Multi‑agent systems, Reinforcement learning for coordination, Efficient dialogue/debate frameworks, Scalable AI reasoning, Zero‑shot transfer learning
Entity Intersection Graph
No entity connections available yet for this article.
Original Source
--> Computer Science > Artificial Intelligence arXiv:2602.23864 [Submitted on 27 Feb 2026] Title: RUMAD: Reinforcement-Unifying Multi-Agent Debate Authors: Chao Wang , Han Lin , Huaze Tang , Huijing Lin , Wenbo Ding View a PDF of the paper titled RUMAD: Reinforcement-Unifying Multi-Agent Debate, by Chao Wang and 3 other authors View PDF HTML Abstract: Multi-agent debate systems leverage collective intelligence to enhance reasoning capabilities, yet existing approaches struggle to simultaneously optimize accuracy, consensus formation, and computational efficiency. Static topology methods lack adaptability to task complexity variations, while external LLM-based coordination risks introducing privileged knowledge that compromises debate neutrality. This work presents RUMAD (Reinforcement-Unifying Multi-Agent Debate), a novel framework that formulates dynamic communication topology control in MAD as a reinforcement learning problem. RUMAD employs a content-agnostic observation scheme that captures high-level debate dynamics avoiding access to raw agent reasoning content. RUMAD uses a multi-objective reward to model solution quality, cohesion and efficiency. A PPO-trained controller dynamically adjusts edge weights in the communication graph, while a dual-threshold mechanism enables fine-grained control over both agent activation and information visibility. Experimental evaluation across MMLU, GSM8K, and GPQA benchmarks demonstrates that RUMAD achieves substantial efficiency gains, reducing token costs by over 80\%, while still improving reasoning accuracy compared to single LLM model and multiple MAD baselines. Notably, RUMAD trained exclusively on MMLU exhibits robust zero-shot generalization to out-of-domain tasks, indicating that the learned communication strategies capture task-independent principles of effective multi-agent coordination. These results establish RUMAD as a efficient and robust approach for deploying multi-agent reasoning application with practical r...
Read full article at source