Inequality
A statement that one quantity is less than, greater than, or unequal to another.
- Most rules of equations carry over.
- Multiplying both sides by a negative FLIPS the direction.
- Used in constraints, clipping, early stopping.
When to use: Constraints, gradient clipping, thresholding decisions, early stopping.
Example: Early stopping: if val_loss > best_loss for 5 consecutive epochs, stop training.