Vector Addition
Combining two equal-length vectors by adding entries elementwise.
- Geometric: parallelogram (head-to-tail) rule.
- Commutative and associative.
- Underlies every gradient update.
When to use: Whenever you combine two same-shape numerical objects: gradient updates, residual connections.
Example: [1, 2] + [3, 4] = [4, 6]. word2vec: vec("king") - vec("man") + vec("woman") ≈ vec("queen").