A tiny GPT you can watch write.
Mbind is a 2.2-million-parameter language model trained on La Fontaine, Hugo, Maupassant and a few others. It runs in your browser and hides nothing: the tokens, the attention, the probabilities. It writes in French only.
2.2M parameters4 layers256-token contexttrained in 4 min on a CPU