Superscript in parentheses — a label
Read x^(t) as "x at step t". A raised number or letter in parentheses is a label, such as a time step. It is never a power.
is the cache as it stands at step , not the cache raised to the power . The parentheses are there to make that clear.
The same convention appears in (the first image patch) and (the set of tokens kept by nucleus sampling at threshold ).
Example
With parentheses it is a label; without, a power.
Where the course uses it
Related terms
- The KV cacheRead "K cache" and "V cache". They store the keys and values of earlier tokens during generation, so each is computed once instead of again at every step.
- Subscripts — picking one itemRead x_i as "x sub i" or "x i". A small lowered letter picks out one item: the i-th entry of a vector, or the i-th vector in a sequence.