Eight small LLMs ran overnight on a Pi 4: one 128-token answer took 25 to 53 seconds
I read the CSV from the first overnight benchmark of eight small LLMs on a Pi 4B (2026-10-26). Generation ran at 2.4 to 5.1 tokens per second, the smallest model was fastest, and longer context slowed each model by a different amount.