#meta

• 5 Apr 2025 · AI updates

  Llama 4 Scout and Maverick: Meta moves to mixture-of-experts

  Meta's Llama 4 introduces two natively multimodal MoE models with 17B active parameters each: Scout (~109B total, 16 experts) and Maverick (~400B total, 128 experts), trained on up to 40T tokens.

• 23 Jul 2024 · AI updates

  Llama 3.1: 405B open weights, long context, tool calling

  Meta released Llama 3.1 in 8B, 70B and 405B sizes with multilingual support and long context, plus Llama Guard 3 and Prompt Guard; Hugging Face provided FP8, AWQ and GPTQ quantised versions.

• 18 Apr 2024 · AI updates

  Meta releases Llama 3 (8B and 70B)

  Meta released Llama 3 in 8B and 70B sizes, base and instruct, plus Llama Guard 2 for safety classification, with an 8K context and day-one Hugging Face support.