Experiment

Local LLM Benchmark Method

A repeatable plan for comparing local coding models without invented numbers.

LLMBenchmarksEvaluation
Working hypothesis. Published Oct 26, 2026. Reviewed Oct 26, 2026.

Working technical note. Procedures and observations should be independently verified before operational use.

Working notes

Record model name, quantization, context size, offload settings, hardware, prompt, warm-up conditions, wall-clock time, output quality, and failures. Keep identical tasks across models. Report measured values and caveats rather than expectations.

Further validation

  • Confirm accuracy and reproduce any procedure in a safe lab.
  • Remove private identifiers, credentials, and infrastructure details.
  • Mark observations, hypotheses, and conclusions separately.
  • Approve this note for public publication.