Deep Learning

How a chain of failures produced the LLM (part 2) — from attention to the scaling revolution and alignment

August 12, 2026

From context to the finished LLM: the limits of RNNs, the birth of attention, the Transformer, GPT-3 scaling, RLHF alignment, and the era of efficiency.

• LLM
• Generative AI
• Deep Learning

How a chain of failures produced the LLM (part 1) — from the limits of maths to the geometry of meaning

August 11, 2026

The LLM as a by-product of unrelated problems: Turing on computability, Shannon on information, the perceptron, backpropagation, GPUs, and Word2Vec.

• LLM
• Generative AI
• Deep Learning