#inference

• 28 Jun 2024 · Study

  Probability and Statistics · Point and interval estimation

  Estimators and their bias, standard error, and building and interpreting 95% confidence intervals with the t distribution.

• 20 Dec 2023 · Paper summary

  Paper summary: LLM in a flash: Efficient Large Language Model Inference with Limited Memory

  Apple researchers run LLMs larger than the available DRAM by keeping weights in flash and loading only what is needed, with windowing and row–column bundling designed around how flash memory reads data.