Baike.dev
All toolsOnline toolsAI codingTrendingOpen sourceNewsSubmit
Log in
< Back to tools
R

ReTool

> 编程语言
Open source

News!!! - [2025/07] The ReTool Recipe is fully open sourced. [New!] - [2025/04] We release the model checkpoints and inference code. In thi…

388 stars0 likes0 views
WebsiteGitHub

About

News!!! - [2025/07] The ReTool Recipe is fully open sourced. [New!] - [2025/04] We release the model checkpoints and inference code. In thi…

** News!!!**

  • [2025/07] The ReTool Recipe is fully open sourced. [New!]
  • [2025/04] We release the model checkpoints and inference code.

In this work, we embrace the RL paradigm and introduce ReTool, a Tool-augmented Reinforcement learning framework explicitly designed to guide LLMs towards optimal strategies for leveraging external computational tools during reasoning. Our comprehensive experiments on AIME2024 and AIME2025 demonstrate that ReTool not only achieves superior accuracy compared to conventional text-based RL approaches, but also converges with significantly fewer training steps.

ReTool achieves accuracy of 67.0% on AIME 2024 and 49.3% on AIME 2025 based on the Qwen2.5-32B-Instruct model, outperforming the text-based RL baseline with less than 50% training steps.

Model Use

We provide the model weights of ReTool-Qwen-32B and ReTool-DeepSeek-R1-Distill-Qwen-32B, which are trained based on Qwen2.5-32B-Instruct and DeepSeek-R1-Distill-Qwen-32B. Note: ReTool-Qwen-32B achieves 67% on AIME 24, and ReTool-DeepSeek-R1-Distill-Qwen-32B achieves 72% on AIME 24.

Environment Setup

bash
pip install vllm==0.7.3
pip install packaging
pip install ninja
pip install flash-attn --no-build-isolation
pip install deepspeed
pip install accelerate
pip install datasets
pip install "git+https://github.com/tongyx361/symeval.git"
pip install timeout_decorator

Inference

To speed up open-source progress, we are currently using STILL3's inference framework to evaluate our trained checkpoints.

Quick start for model inference:

python
cd evaluation
bash scripts/eval.sh

Datasets

We provide training and validation datasets for ReTool.

  • Cold-Start: ReTool-SFT.
  • RL Training: DAPO-Math-17k by DAPO, thanks for their great work!
  • RL Validation: AIME 2024, AIME 2025 (can be found in evaluation/dataset)

Acknowledgement

We thank the verl for providing the awesome open-source RL infrastructure.

Citation

If you find our project helpful, please cite:

@misc{feng2025retoolreinforcementlearningstrategic, title={ReTool: Reinforcement Learning for Strategic Tool Use in LLMs}, author={Jiazhan Feng and Shijue Huang and Xingwei Qu and Ge Zhang and Yujia Qin and Baoquan Zhong and Chengquan Jiang and Jinxin Chi and Wanjun Zhong}, year={2025}, eprint={2504.11536}, archivePrefix={arXiv}, primaryClass={cs.CL}, url={https://arxiv.org/abs/2504.11536}, }

Issues· 0 open

View all issuesOpen on GitHub

No open issues yet, or sync has not completed.

> Tags

Python

No comments yet. Be the first to share.

> Details

PublishedAug 1, 2026
UpdatedSep 17, 2026
Category编程语言
PricingOpen source

> Related tools

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言