Summary
A developer has successfully run a 28.9-million-parameter language model, trained on the TinyStories dataset, on a $10 ESP32-S3 microcontroller, generating text at nearly 10 tokens per second offline. This was achieved by optimizing memory usage, including storing most parameters in flash storage, making it a notable advancement for running LLMs on limited hardware.