NLA Visualizations

2. Power Iteration — Spectral Decay

Visualizing vector decay when spectral radius ρ(A) < 1

Formulation

xk+1=Axkx_{k+1} = A x_k

When all eigenvalues of AA have absolute value less than 1 (i.e. spectral radius rho(A)<1\\rho(A) < 1), repeatedly multiplying by AA causes the vector to decay toward the origin.

Geometric Model

A=[0.80.300.5]A = \begin{bmatrix} 0.8 & 0.3 \\ 0 & 0.5 \end{bmatrix}

Eigenvalues: lambda1=0.8,λ2=0.5\\lambda_1 = 0.8, \lambda_2 = 0.5

  • Eigenvector p1p_1 (red) corresponds to lambda1=0.8\\lambda_1 = 0.8.
  • Eigenvector p2p_2 (red) corresponds to lambda2=0.5\\lambda_2 = 0.5.
  • Notice how both components decay, but the component along p2p_2 decays much faster, meaning the vector trajectory curls into the p1p_1 axis as it shrinks to zero.

Controls

45°
Iteration: 0