Submissions by gpjt

Writing an LLM from scratch, part 14 – the complexity of self-attention at scale

Writing an LLM from scratch, part 13 – attention heads are dumb

Writing an LLM from scratch, part 12 – multi-head attention

Writing an LLM from scratch, part 11 – batches

The Business of the AI Labs

Writing an LLM from scratch, part 10 – dropout

Adding /Llms.txt

Writing an LLM from scratch, part 9 – causal attention

Writing an LLM from scratch, part 8 – trainable self-attention