Paper summary
Paper summary: Qwen2.5-Coder Technical Report
Qwen2.5-Coder is a family of six code models (0.5B to 32B) continued-pretrained on over 5.5 trillion tokens, reported to set state-of-the-art results on more than 10 code benchmarks for their sizes.
- Data work is central: careful cleaning, scalable synthetic data and balanced mixing of code, maths and general text.
- The models aim to stay good at general and maths tasks while specialising in code.