Sahaj.blogs

Day page

1 Jul 2024

Paper summary

Paper summary: Scaling Synthetic Data Creation with 1,000,000,000 Personas

Persona Hub collects one billion personas from web data and uses them to steer an LLM toward diverse viewpoints when generating synthetic data: maths problems, instructions, knowledge texts, game NPCs and tools.

  • Adding a persona to a data-generation prompt pushes the LLM to produce different content for the same request.
  • The persona collection is the scaling knob: 1 billion personas, about 13% of the world's population.

Read the post →