#decoding

• 21 Jan 2026 · Study

  LLMs · Decoding: greedy, beam, sampling

  How a model's next-token probabilities become text: greedy, beam search, temperature, top-k and top-p sampling, compared on GPT-2.

• 16 Feb 2024 · Paper summary

  Paper summary: Chain-of-Thought Reasoning Without Prompting

  Chain-of-thought reasoning can appear without any prompting: branching on the top-k first tokens during decoding often reveals reasoning paths, and those paths come with higher answer confidence.