For finite-dimensional real vectors in ${\displaystyle {\mathbb{R}}^n}$ with the usual Euclidean dot product, the Gram matrix is simply ${\displaystyle G=V^{\mathrm{T}}V}$, where ${\displaystyle V}$ is a matrix whose columns are the vectors ${\displaystyle v_k}$. For complex vectors in ${\displaystyle {\mathbb{C}}^n}$, ${\displaystyle G=V^{H}V}$, where ${\displaystyle V^H}$ is the conjugate transpose of ${\displaystyle V}$.

Given square-integrable functions ${\displaystyle \{{\ell }_i(\cdot ),i=1,\dots ,n\}}$ on the interval ${\displaystyle [t_0,t_f]}$, the Gram matrix ${\displaystyle G=[G_{ij}]}$ is:

${\displaystyle G_{ij}={\int }_{t_0}^{t_f}{\ell }_i(\tau )\overline{{\ell }_j}(\tau )d\tau .}$

For any bilinear form ${\displaystyle B}$ on a finite-dimensional vector space over any field we can define a Gram matrix ${\displaystyle G}$ attached to a set of vectors ${\displaystyle v_1,\dots ,v_n}$ by ${\displaystyle G_{ij}=B(v_i,v_j)}$. The matrix will be symmetric if the bilinear form ${\displaystyle B}$ is symmetric.

1.1. Applications

• In Riemannian geometry, given an embedded ${\displaystyle k}$-dimensional Riemannian manifold ${\displaystyle M\subset {\mathbb{R}}^n}$ and a coordinate chart ${\displaystyle \varphi :U\to M}$ for ${\displaystyle (x_1,\dots ,x_k)\in U\subset {\mathbb{R}}^k}$, the volume form ${\displaystyle \omega }$ on ${\displaystyle M}$ induced by the embedding may be computed using the Gramian of the coordinate tangent vectors:

$\text{Undefined control sequence tfrac}$

This generalizes the classical surface integral of a parametrized surface ${\displaystyle \varphi :U\to S\subset {\mathbb{R}}^3}$ for ${\displaystyle (x,y)\in U\subset {\mathbb{R}}^2}$:

$\text{Undefined control sequence tfrac}$

• If the vectors are centered random variables, the Gramian is approximately proportional to the covariance matrix, with the scaling determined by the number of elements in the vector.
• In quantum chemistry, the Gram matrix of a set of basis vectors is the overlap matrix.
• In control theory (or more generally systems theory), the controllability Gramian and observability Gramian determine properties of a linear system.
• Gramian matrices arise in covariance structure model fitting (see e.g., Jamshidian and Bentler, 1993, Applied Psychological Measurement, Volume 18, pp. 79–94).
• In the finite element method, the Gram matrix arises from approximating a function from a finite dimensional space; the Gram matrix entries are then the inner products of the basis functions of the finite dimensional subspace.
• In machine learning, kernel functions are often represented as Gram matrices.^[1]
• Since the Gram matrix over the reals is a symmetric matrix, it is diagonalizable and its eigenvalues are non-negative. The diagonalization of the Gram matrix is the singular value decomposition.

2.1. Positive-Semidefiniteness

The Gram matrix is symmetric in the case the real product is real-valued; it is Hermitian in the general, complex case by definition of an inner product.

The Gram matrix is positive semidefinite, and every positive semidefinite matrix is the Gramian matrix for some set of vectors. The fact that the Gramian matrix is positive-semidefinite can be seen from the following simple derivation:

${\displaystyle x^{\mathsf{\text{T}}}\mathbf{G}x=\sum _{i,j}{x}_i{x}_j⟨v_i,v_j⟩=\sum _{i,j}⟨x_i{v}_i,x_j{v}_j⟩=⟨\sum _i{x}_i{v}_i,\sum _j{x}_j{v}_j⟩={\Vert \sum _i{x}_i{v}_i\Vert }^2\ge 0.}$

The first equality follows from the definition of matrix multiplication, the second and third from the bi-linearity of the inner-product, and the last from the positive definiteness of the inner product. Note that this also shows that the Gramian matrix is positive definite if and only if the vectors ${\displaystyle v_i}$ are linearly independent (that is, ${\displaystyle \sum _i{x}_i{v}_i\ne 0}$ for all ${\displaystyle x}$).^[2]

2.2. Finding a Vector Realization

Given any positive semidefinite matrix ${\displaystyle M}$, one can be decompose it as:

${\displaystyle M=B^{\ast }B}$,

where ${\displaystyle B^{\ast }}$ is the conjugate transpose of ${\displaystyle B}$ (or ${\displaystyle M=B^{\mathsf{\text{T}}}B}$ in the real case). Here ${\displaystyle B}$ is a ${\displaystyle k\times n}$ matrix, where ${\displaystyle k}$ is the rank of ${\displaystyle M}$. Various ways to obtain such a decomposition include computing the Cholesky decomposition or taking the non-negative square root of ${\displaystyle M}$.

The columns ${\displaystyle b^{(1)},\dots ,b^{(n)}}$ of ${\displaystyle B}$ can be seen as n vectors in ${\displaystyle {\mathbb{C}}^k}$ (or k-dimensional Euclidean space ${\displaystyle {\mathbb{R}}^k}$, in the real case). Then

${\displaystyle M_{ij}=b^{(i)}\cdot b^{(j)}}$

where the dot product ${\displaystyle a\cdot b=\sum _{\ell =1}^k\overline{a_{\ell }}{b}_{\ell }}$ is the usual inner product on ${\displaystyle {\mathbb{C}}^k}$.

Thus a Hermitian matrix ${\displaystyle M}$ is positive semidefinite if and only if it is the Gram matrix of some vectors ${\displaystyle b^{(1)},\dots ,b^{(n)}}$. Such vectors are called a vector realization of ${\displaystyle M}$. The infinite-dimensional analog of this statement is Mercer's theorem.

2.3. Uniqueness of Vector Realizations

If ${\displaystyle M}$ is the Gram matrix of vectors ${\displaystyle v_1,\dots ,v_n}$ in ${\displaystyle {\mathbb{R}}^k}$, then applying any rotation or reflection of ${\displaystyle {\mathbb{R}}^k}$ (any orthogonal transformation, that is, any Euclidean isometry preserving 0) to the sequence of vectors results in the same Gram matrix. That is, for any ${\displaystyle k\times k}$ orthogonal matrix ${\displaystyle Q}$, the Gram matrix of ${\displaystyle Q{v}_1,\dots ,Q{v}_n}$ is also ${\displaystyle M}$.

This is the only way in which two real vector realizations of ${\displaystyle M}$ can differ: the vectors ${\displaystyle v_1,\dots ,v_n}$ are unique up to orthogonal transformations. In other words, the dot products ${\displaystyle v_i\cdot v_j}$ and ${\displaystyle w_i\cdot w_j}$ are equal if and only if some rigid transformation of ${\displaystyle {\mathbb{R}}^k}$ transforms the vectors ${\displaystyle v_1,\dots ,v_n}$ to ${\displaystyle w_1,\dots ,w_n}$ and 0 to 0.

The same holds in the complex case, with unitary transformations in place of orthogonal ones. That is, if the Gram matrix of vectors ${\displaystyle v_1,\dots ,v_n}$ is equal to the Gram matrix of vectors ${\displaystyle w_1,\dots ,w_n}$ in ${\displaystyle {\mathbb{C}}^k}$, then there is a unitary ${\displaystyle k\times k}$ matrix ${\displaystyle U}$ (meaning ${\displaystyle U^{\ast }U=I}$) such that ${\displaystyle v_i=U{w}_i}$ for ${\displaystyle i=1,\dots ,n}$.^[3]

2.4. Other Properties

• The Gram matrix of any orthonormal basis is the identity matrix.
• The rank of the Gram matrix of vectors in ${\displaystyle {\mathbb{R}}^k}$ or ${\displaystyle {\mathbb{C}}^k}$ equals the dimension of the space spanned by these vectors.^[2]

The Gram determinant or Gramian is the determinant of the Gram matrix:

$\text{Unknown environment 'vmatrix'}$

If ${\displaystyle x_1,\cdots ,x_n}$ are vectors in ${\displaystyle {\mathbb{R}}^n}$, then it is the square of the n-dimensional volume of the parallelotope formed by the vectors. In particular, the vectors are linearly independent if and only if the parallelotope has nonzero n-dimensional volume, if and only if Gram determinant is nonzero, if and only if the Gram matrix is nonsingular.

The Gram determinant can also be expressed in terms of the exterior product of vectors by

${\displaystyle G(x_1,\dots ,x_n)=\Vert x_1\wedge \cdots \wedge x_n{\Vert }^2.}$

The content is sourced from: https://handwiki.org/wiki/Gramian_matrix