https://transformers-and-math.drmhse.com https://transformers-and-math.drmhse.com/course-map https://transformers-and-math.drmhse.com/glossary https://transformers-and-math.drmhse.com/modules/01-shapes-and-linear-algebra https://transformers-and-math.drmhse.com/modules/02-calculus-and-optimization https://transformers-and-math.drmhse.com/modules/03-probability-and-information https://transformers-and-math.drmhse.com/modules/04-how-a-model-learns https://transformers-and-math.drmhse.com/modules/05-sequences-before-transformers https://transformers-and-math.drmhse.com/modules/06-attention https://transformers-and-math.drmhse.com/modules/07-the-block-and-the-full-model https://transformers-and-math.drmhse.com/modules/08-three-families https://transformers-and-math.drmhse.com/modules/09-tokenization https://transformers-and-math.drmhse.com/modules/10-pretraining https://transformers-and-math.drmhse.com/modules/11-training-across-many-gpus https://transformers-and-math.drmhse.com/modules/12-generation https://transformers-and-math.drmhse.com/modules/13-evaluation https://transformers-and-math.drmhse.com/modules/14-what-the-model-learns https://transformers-and-math.drmhse.com/modules/15-the-llama-block https://transformers-and-math.drmhse.com/modules/16-efficient-and-long-attention https://transformers-and-math.drmhse.com/modules/17-mixture-of-experts https://transformers-and-math.drmhse.com/modules/18-beyond-attention https://transformers-and-math.drmhse.com/modules/19-reading-a-model-card https://transformers-and-math.drmhse.com/modules/20-adaptation https://transformers-and-math.drmhse.com/modules/21-preference-learning https://transformers-and-math.drmhse.com/modules/22-reasoning-models https://transformers-and-math.drmhse.com/modules/23-serving https://transformers-and-math.drmhse.com/modules/24-quantization https://transformers-and-math.drmhse.com/modules/25-vision-transformers https://transformers-and-math.drmhse.com/modules/26-vision-language-models https://transformers-and-math.drmhse.com/modules/27-recognition-with-ctc https://transformers-and-math.drmhse.com/modules/28-generating-audio https://transformers-and-math.drmhse.com/modules/29-capstone https://transformers-and-math.drmhse.com/glossary/cardinality https://transformers-and-math.drmhse.com/glossary/training https://transformers-and-math.drmhse.com/glossary/exp https://transformers-and-math.drmhse.com/glossary/log https://transformers-and-math.drmhse.com/glossary/sum https://transformers-and-math.drmhse.com/glossary/subscript-index https://transformers-and-math.drmhse.com/glossary/d-model https://transformers-and-math.drmhse.com/glossary/loss https://transformers-and-math.drmhse.com/glossary/matrix https://transformers-and-math.drmhse.com/glossary/vector-space-dim https://transformers-and-math.drmhse.com/glossary/reals https://transformers-and-math.drmhse.com/glossary/element-of https://transformers-and-math.drmhse.com/glossary/shape https://transformers-and-math.drmhse.com/glossary/scalar https://transformers-and-math.drmhse.com/glossary/vector https://transformers-and-math.drmhse.com/glossary/bold-vector https://transformers-and-math.drmhse.com/glossary/bmatrix https://transformers-and-math.drmhse.com/glossary/qkv https://transformers-and-math.drmhse.com/glossary/matmul https://transformers-and-math.drmhse.com/glossary/batch https://transformers-and-math.drmhse.com/glossary/tensor https://transformers-and-math.drmhse.com/glossary/hadamard https://transformers-and-math.drmhse.com/glossary/d-k https://transformers-and-math.drmhse.com/glossary/transpose https://transformers-and-math.drmhse.com/glossary/rank https://transformers-and-math.drmhse.com/glossary/dot-product https://transformers-and-math.drmhse.com/glossary/norm https://transformers-and-math.drmhse.com/glossary/theta-params https://transformers-and-math.drmhse.com/glossary/token https://transformers-and-math.drmhse.com/glossary/one-hot https://transformers-and-math.drmhse.com/glossary/embedding-matrix https://transformers-and-math.drmhse.com/glossary/big-o https://transformers-and-math.drmhse.com/glossary/weights https://transformers-and-math.drmhse.com/glossary/dtype https://transformers-and-math.drmhse.com/glossary/activation https://transformers-and-math.drmhse.com/glossary/limit https://transformers-and-math.drmhse.com/glossary/to https://transformers-and-math.drmhse.com/glossary/approx https://transformers-and-math.drmhse.com/glossary/delta https://transformers-and-math.drmhse.com/glossary/partial https://transformers-and-math.drmhse.com/glossary/gradient https://transformers-and-math.drmhse.com/glossary/eta https://transformers-and-math.drmhse.com/glossary/sigma https://transformers-and-math.drmhse.com/glossary/mu https://transformers-and-math.drmhse.com/glossary/sqrt https://transformers-and-math.drmhse.com/glossary/expectation https://transformers-and-math.drmhse.com/glossary/variance https://transformers-and-math.drmhse.com/glossary/conditional https://transformers-and-math.drmhse.com/glossary/chain-rule-prob https://transformers-and-math.drmhse.com/glossary/maximum-likelihood https://transformers-and-math.drmhse.com/glossary/entropy https://transformers-and-math.drmhse.com/glossary/cross-entropy https://transformers-and-math.drmhse.com/glossary/kl-divergence https://transformers-and-math.drmhse.com/glossary/perplexity https://transformers-and-math.drmhse.com/glossary/sigmoid https://transformers-and-math.drmhse.com/glossary/reward https://transformers-and-math.drmhse.com/glossary/self-supervised https://transformers-and-math.drmhse.com/glossary/neuron https://transformers-and-math.drmhse.com/glossary/activation-function https://transformers-and-math.drmhse.com/glossary/mlp https://transformers-and-math.drmhse.com/glossary/logit https://transformers-and-math.drmhse.com/glossary/softmax https://transformers-and-math.drmhse.com/glossary/infinity https://transformers-and-math.drmhse.com/glossary/temperature https://transformers-and-math.drmhse.com/glossary/argmax https://transformers-and-math.drmhse.com/glossary/cases https://transformers-and-math.drmhse.com/glossary/kronecker https://transformers-and-math.drmhse.com/glossary/sqrt-dk https://transformers-and-math.drmhse.com/glossary/generalization https://transformers-and-math.drmhse.com/glossary/hyperparameter https://transformers-and-math.drmhse.com/glossary/chain-rule-deriv https://transformers-and-math.drmhse.com/glossary/product https://transformers-and-math.drmhse.com/glossary/alpha https://transformers-and-math.drmhse.com/glossary/attention https://transformers-and-math.drmhse.com/glossary/masking https://transformers-and-math.drmhse.com/glossary/concat https://transformers-and-math.drmhse.com/glossary/seq-len https://transformers-and-math.drmhse.com/glossary/residual https://transformers-and-math.drmhse.com/glossary/beta https://transformers-and-math.drmhse.com/glossary/layernorm https://transformers-and-math.drmhse.com/glossary/epsilon https://transformers-and-math.drmhse.com/glossary/ffn https://transformers-and-math.drmhse.com/glossary/gelu https://transformers-and-math.drmhse.com/glossary/forall https://transformers-and-math.drmhse.com/glossary/implies https://transformers-and-math.drmhse.com/glossary/identity-matrix https://transformers-and-math.drmhse.com/glossary/hat https://transformers-and-math.drmhse.com/glossary/lambda https://transformers-and-math.drmhse.com/glossary/all-reduce https://transformers-and-math.drmhse.com/glossary/prefill-decode https://transformers-and-math.drmhse.com/glossary/kv-cache https://transformers-and-math.drmhse.com/glossary/superscript-time https://transformers-and-math.drmhse.com/glossary/induction-head https://transformers-and-math.drmhse.com/glossary/superposition https://transformers-and-math.drmhse.com/glossary/rope-angle https://transformers-and-math.drmhse.com/glossary/set-braces https://transformers-and-math.drmhse.com/glossary/orthogonal https://transformers-and-math.drmhse.com/glossary/rmsnorm https://transformers-and-math.drmhse.com/glossary/d-ff https://transformers-and-math.drmhse.com/glossary/moe https://transformers-and-math.drmhse.com/glossary/floor-ceil https://transformers-and-math.drmhse.com/glossary/svd https://transformers-and-math.drmhse.com/glossary/lora https://transformers-and-math.drmhse.com/glossary/distillation https://transformers-and-math.drmhse.com/glossary/chain-of-thought https://transformers-and-math.drmhse.com/glossary/quantization https://transformers-and-math.drmhse.com/glossary/convolution https://transformers-and-math.drmhse.com/glossary/contrastive https://transformers-and-math.drmhse.com/glossary/autoencoder https://transformers-and-math.drmhse.com/glossary/overfitting https://transformers-and-math.drmhse.com/glossary/epoch https://transformers-and-math.drmhse.com/glossary/policy https://transformers-and-math.drmhse.com/glossary/advantage