Sahaj.blogs
19 May 2025 · Paper summary

Paper summary: Qwen3 Technical Report

Qwen3 merges a "thinking" mode for multi-step reasoning and a fast non-thinking mode in one model family (0.6B to 235B, dense and MoE), adds a thinking budget, and expands to 119 languages.

Problem

Users had to pick between chat models (fast) and dedicated reasoning models (slow but careful), often from different model families.

Method

Qwen3 is a family of dense and MoE models from 0.6B to 235B parameters with:

  • thinking mode (multi-step reasoning) and non-thinking mode (quick answers) in one model, switchable per query or through the chat template
  • a thinking budget, so users can choose how much compute to spend at inference
  • smaller models built with knowledge from the flagship models, which cuts their training cost

Key results

From the abstract: state-of-the-art results across benchmarks including code generation, mathematical reasoning and agent tasks, competitive with larger MoE and proprietary models. Multilingual support grows from 29 to 119 languages and dialects compared with Qwen2.5. All models are released under Apache 2.0.

Limitations

There’s no dedicated limitations section in the extracted text. Results are reported by the developers.

#llm#reasoning#open-weights

Sources

  1. Qwen3 Technical Report (arXiv:2505.09388) — arXiv
  2. Hugging Face Daily Papers, 2025-05-19 — Hugging Face
  3. Qwen3 Technical Report (arXiv HTML full text) — arXiv
  4. Code repository (linked in the paper) — GitHub

This is a summary written from the linked public sources. Figures and numbers are as reported there.