Skip to content
ZogleAGI Lab

Research

Longer articles that explain what the experiments teach, written to be read from start to finish.

  • Cover image for “Gradient Descent: The One Loop Behind Every AI, From a Tiny Model to an LLM”

    Gradient Descent: The One Loop Behind Every AI, From a Tiny Model to an LLM

    Gradient descent is the loop that trains almost every AI model, including large language models. We run it on two tiny examples with real numbers: finding one best number, and teaching a model to pick the right next word. Then we see what changes when the same loop is scaled up to an LLM.

    9 min read

  • Neural Networks From Zero: Two Tiny Examples, Every Step Explained

    Neural Networks From Zero: Two Tiny Examples, Every Step Explained

    Where neural networks are used, why almost every use reduces to predicting a number or choosing a category, and how a single neuron learns both. Every term is defined before it is used, and every step is shown with real numbers.

    15 min read