Skip to content
Mohan Selvan
All projects
LLMs and NLPIn progress2025

Smol GPT

A small GPT model built from scratch, as a sandbox for model-optimisation research.

Code

Goal

A small, reliable reasoning agent that runs entirely on local hardware. The current stage is the training setup itself; optimisation experiments come next.

What's built so far

  • The model itself, written from scratch and trained on educational web text.
  • Training that tracks how well the model is learning, how fast it trains and how much memory it uses.