UMAP map over 5000 static token embeddings (W_te, i.e. the GPT-2 token embedding matrix). Numbered path = prompt token order.

Legend: gray cloud = precomputed 5k-token map, top-k candidates, trajectory tokens, in both sets, numeric labels = token order in the prompt.