Paper summary: Qwen3 Technical Report
Qwen3 merges a "thinking" mode for multi-step reasoning and a fast non-thinking mode in one model family (0.6B to 235B, dense and MoE), adds a thinking budget, and expands to 119 languages.
Problem
Users had to pick between chat models (fast) and dedicated reasoning models (slow but careful), often from different model families.
Method
Qwen3 is a family of dense and MoE models from 0.6B to 235B parameters with:
- thinking mode (multi-step reasoning) and non-thinking mode (quick answers) in one model, switchable per query or through the chat template
- a thinking budget, so users can choose how much compute to spend at inference
- smaller models built with knowledge from the flagship models, which cuts their training cost
Key results
From the abstract: state-of-the-art results across benchmarks including code generation, mathematical reasoning and agent tasks, competitive with larger MoE and proprietary models. Multilingual support grows from 29 to 119 languages and dialects compared with Qwen2.5. All models are released under Apache 2.0.
Limitations
There’s no dedicated limitations section in the extracted text. Results are reported by the developers.
Sources
- Qwen3 Technical Report (arXiv:2505.09388) — arXiv
- Hugging Face Daily Papers, 2025-05-19 — Hugging Face
- Qwen3 Technical Report (arXiv HTML full text) — arXiv
- Code repository (linked in the paper) — GitHub
This is a summary written from the linked public sources. Figures and numbers are as reported there.