NLA Visualizations

SVD Computation

Understanding the elementwise construction of y=UΣVxy = U \Sigma V^* x

Formulation

y=UΣVxy = U \Sigma V^* x

By breaking down the matrix multiplication into its core components, we can see exactly how the Singular Value Decomposition maps the input vector xx to the output vector yy.

yi=jUijσj(Vj,:x)y_i = \sum_{j} U_{ij} \sigma_j (V^*_{j,:} \cdot x)

Notice that each entry yiy_i is constructed by taking the dot product of the input with the rows of VV^*, scaling by the singular values σ\sigma, and recombining using the columns (or rows) of UU.

Instructions

  • Hover over or click the elements in the grid to see how they interact.
  • Select an output index ii to see how yiy_i is computed.
  • Select a component index jj to isolate one singular value path.
Target Output Element (i)
Singular Value Path (j)
y
y1y_1
y2y_2
y3y_3
=
U
U11U_{11}
U21U_{21}
U31U_{31}
U12U_{12}
U22U_{22}
U32U_{32}
U13U_{13}
U23U_{23}
U33U_{33}
Σ
σ1\sigma_1
00
00
00
σ2\sigma_2
00
00
00
σ3\sigma_3
V*
V11V^*_{11}
V12V^*_{12}
V13V^*_{13}
V21V^*_{21}
V22V^*_{22}
V23V^*_{23}
V31V^*_{31}
V32V^*_{32}
V33V^*_{33}
x
x1x_1
x2x_2
x3x_3
Active Computation
y=j=13ujσj(vjx)y = \sum_{j=1}^3 \mathbf{u}_j \sigma_j (\mathbf{v}_j^* x)