AI updates
Llama 3.1: 405B open weights, long context, tool calling
Meta released Llama 3.1 in 8B, 70B and 405B sizes with multilingual support and long context, plus Llama Guard 3 and Prompt Guard; Hugging Face provided FP8, AWQ and GPTQ quantised versions.
- The 405B model is positioned for synthetic data generation, LLM-as-a-judge and distillation.
- Prompt Guard is a small classifier for detecting prompt injections and jailbreaks.