Math 301 | Linear Algebra | Fall 2026
Contents
Vector Spaces
- A binary operation on a set \(V\) is a rule which, for any two elements \(u\) and \(v\) in \(V\), produces a third element in \(V\). (Produced element sometimes denoted by \(u+v\), \(u\oplus v\), \(u\cdot v\), or \(uv\).)
- A scalar operation on a set \(V\) is a rule which, for any real number \(k\) and any element \(u\) in \(V\), produces an element of \(V\). (Produced element sometimes denoted by \(k\cdot v\) or \(kv\).)
A vector space consists of the following:
- \(\bullet\ \) A set \(V\)
- \(\bullet\ \) A binary opertion on \(V\) (called addition, denoted \(+\))
- \(\bullet\ \) A scalar operation on \(V\) (called scalar multiplication, denoted \(\cdot\))
- \(\bu+\bv=\bv+\bu\)
- \((\bu+\bv)+\bw = \bu + (\bv+\bw)\)
- There exists an element \(\bz\) in \(V\) such that \(\bz + \bu=\bu\) for every \(\bu\) in \(V\).
- For every \(\bu\) in \(V\), there exists an element \(-\bu\) in \(V\) such that \(\bu + (-\bu) = \bz\).
- \(k\cdot (\bu + \bv) = k\cdot \bu + k\cdot \bv\)
- \((k+m)\cdot \bu = k\cdot \bu + m\cdot \bu\)
- \(k\cdot(m\cdot \bu) = (km)\cdot \bu\)
- \(1\cdot \bu=\bu\)
In Definition 1.2 of a vector space above, \(\bz\) is called the
additive identity or the zero vector of \(V\), and
for \(\bu\) in \(V\), \(-\bu\) is called the additive
inverse of \(\bu\).
Let \(V\) be a vector space, \(\bu\) a vector in \(V\), and
\(k\) a scalar. Then
- \(0 \bu=\bz\)
- \(k \bz = \bz\)
- \((-1) \bu = -\bu\)
A subspace of a vector space \(V\) is a subset \(W\) of
\(V\) which is itself a vector space.
Let \(V\) be a vector space and let \(W\) be a subset of
\(V\). Then \(W\) is a subspace of \(V\) if the following three
conditions are satisfied:
- for every \(\bu\) and \(\bv\) in \(W\), \(\bu+\bv\) is in \(W\) (i.e., \(W\) is closed under vector addition);
- for every \(\bu\) in \(W\) and scalar \(k\), \(k\bu\) is in \(W\) (i.e., \(W\) is closed under scalar multiplication);
- the zero vector of \(V\) lies in \(W\).
A linear combination of \(\bv_1,\ldots,\bv_r\) is a
vector of the form \(k_1\bv_1+\cdots +k_r\bv_r\), where
\(k_1,\ldots,k_r\) are scalars.
The span of \(\bv_1,\ldots,\bv_r\), denoted
\(\sspan\{\bv_1,\ldots,\bv_r\}\), is the set of all linear
combinations of \(\bv_1,\ldots,\bv_r\).
Let \(V\) be a vector space and let \(\bv_1,\ldots,\bv_r\) be
vectors in \(V\). Then \(\sspan\{\bv_1,\ldots,\bv_r\}\) is a
subspace of \(V\).
Let \(V\) be a vector space and let \(\bv_1,\ldots,\bv_r\) be
vectors in \(V\). Then \(\{\bv_1,\ldots,\bv_r\}\) is linearly
independent if \(k_1\bv_1+\cdots +k_r\bv_r=\bz\) implies
\(k_1=\cdots = k_r=0\).
A set \(\{\bv_1,\ldots,\bv_r\}\) of two or more vectors is
linearly dependent if and only if at least one of the vectors is
a linear combination of the others.
A basis for a vector space \(V\) is a set of vectors
\(\cB=\{\bv_1,\ldots,\bv_n\}\) such that
- \(\sspan\{\bv_1,\ldots,\bv_n\}=V\), and
- \(\{\bv_1,\ldots,\bv_n\}\) is linearly independent.
Let \(\cB=\{\bv_1,\ldots,\bv_n\}\) be a basis for a vector space
\(V\).
- If any vector of \(V\) is added to \(\cB\), then \(\cB\) is no longer linearly independent.
- If any vector is removed from \(\cB\), then \(\cB\) no longer spans \(V\).
Let \(\cB=\{\bv_1,\ldots\bv_n\}\) be a basis
of a vector space \(V\). Then every \(\bu\) in \(V\) can be
written in exactly one way as a linear combination of
\(\bv_1,\ldots, \bv_n\), that is, can be expressed as
\begin{equation*} \bu=c_1\bv_1+\cdots c_n\bv_n, \end{equation*}
for unique scalars \(c_1,\ldots,c_n\).
Let \(\cB=\{\bv_1,\ldots,\bv_n\}\) be a basis of a vector space
\(V\), and let \(\bu\) be a vector in \(V\). Then
\(\bu=c_1\bv_1+\cdots+c_n\bv_n\) for unique scalars
\(c_1,\ldots,c_n\), by Theorem 1.6. The scalars
\(c_1,\ldots,c_n\) are called the
coordinates of \(\bu\) relative to \(\cB\), and the
vector \begin{equation} \begin{bmatrix} c_1\\ \vdots\\ c_n
\end{bmatrix}, \end{equation} denoted by \([\bu]_\cB\), is
called the coordinate vector of \(\bu\) relative to
\(\cB\).
All bases of a vector space \(V\) have the same number of
elements.
The dimension of a nonzero vector space \(V\) is the
number of vectors in a basis for \(V\).
In \(\bR^n\), the following have the same solutions:
- The vector equation \(x_1\bv_1+\cdots +x_p\bv_p=\bu\).
- The linear system of equations with augmented matrix \([\bv_1\cdots \bv_p\mid \bu]\).
- The matrix equation \([\bv_1\, \cdots \bv_p]\,\bx=\bu\).
Let \(A=[\bv_1 \cdots \bv_n]\) be an \(m\times n\) matrix with
column vectors \(\bv_1,\ldots,\bv_n\), and let
\(\bx=\begin{bmatrix} x_1\\ \vdots\\ x_n \end{bmatrix} \) be a
vector in \(\bR^n\). Then \(A\bx = x_1\bv_1+\cdots + x_n\bv_n\).
Let \(A\) be an \(m\times n\) matrix. The nullspace of
\(A\), denoted by \(\nul A\), is the set of all solutions to
\(A\bx = \bz\).
Let \(A\) be an \(m\times n\) matrix. The column space of
\(A\), denoted by \(\col A\), is the span of the column vectors
of \(A\).
Let \(A\) be an \(m\times n\) matrix, let \(\bu,\bv\) be vectors
in \(\bR^n\), and let \(c\) be a scalar. Then
- \(A(\bu+\bv)=A\bu+A\bv\), and
- \(A(c\bu)=c(A\bu)\).
Let \(A\) be an \(m\times n\) matrix. Then
- \(\nul A\) is a subspace of \(\bR^n\).
- \(\col A\) is a subspace of \(\bR^m\).
Let \(A\) be a matrix with \(n\) columns. Then \({\dim (\nul A)
+ \dim (\col A) = n}\).
Linear Transformations
Let \(V\) and \(W\) be vector spaces. A transformation (or
mapping) \(T:V\to W\) is linear if it satisfies the
following conditions:
- For every \(\bu,\bv\) in \(V\), \(T(\bu+\bv)=T(\bu)+T(\bv)\).
- For every \(\bu\) in \(V\) and scalar \(c\), \(T(c\bu)=cT(\bu)\).
Let \(T:V\to W\) be linear. Then
- \(T(\bz)=\bz\).
- \(T(c_1\bv_1+\cdots +c_p\bv_p)=c_1T(\bv_1)+\cdots+c_pT(\bv_p)\), for any scalars \(c_1,\ldots,c_p\) and vectors \(\bv_1,\ldots,\bv_p\) in \(V\).
A matrix transformation is a mapping \(T:\bR^n\to \bR^m\)
given by \(T(\bx)=A\bx\), for some fixed \(m\times n\) matrix
\(A\).
A matrix transformation is linear.
Let \(T:V\to W\) be linear. Then
- The kernel of \(T\), denoted \(\kernel(T)\), is the set of vectors in \(V\) which \(T\) maps to \(\bz\).
- The range of \(T\), denoted \(R(T)\), is the set of vectors in \(W\) which have at least one vector in \(V\) mapping to them.
Let \(T:V\to W\) be linear. Then \(\kernel(T)\) is a subspace of
\(V\) and \(R(T)\) is a subspace of \(W\).
Let \(A\) be an \(m\times n\) matrix, and let \(T:\bR^n\to
\bR^m\) be the matrix transformation \(T(\bx)=A\bx\). Then
\(\kernel(T)=\nul A\) and \(R(T)=\col A\).
Let \(T:V\to W\) be linear. Then \(\dim(\ker T) + \dim (R(T)) =
\dim V\).
Let \(T:V\to W\) be linear.
- \(T\) is one-to-one if and only if \(\ker T=\{\bz\}\).
- \(T\) is onto if and only if \(R(T) = W\).
Let \(W\) be a subspace of \(V\). If \(\dim W=\dim V\), then
\(W=V\).
Let \(T:V\to W\) be linear, and suppose that \(\dim V=\dim
W\). Then \(T\) is one-to-one if and only if \(T\) is onto.
Let \(T:U\to V\) and \(S:V\to W\) be linear
transformations. Then the
composition of \(S\) with \(T\), denoted \(S\circ T\), is
the map from \(U\) to \(W\) defined by \((S\circ
T)(\bu)=S(T(\bu))\) for \(\bu\in U\).
Let \(T:U\to V\) and \(S:V\to W\) be linear
transformations. Then the composition \(S\circ T:U\to W\) is a
linear transformation.
For any vector space \(V\), the identity transformation
\(I:V\to V\) is defined by \(I(\bv)=\bv\) for all \(\bv\) in
\(V\).
Let \(T:V\to W\) be a linear transformation. Then \(T\circ
I=I\circ T=T\).
Let \(T:V\to W\) be one-to-one. Then there exists an inverse
transformation \(T^{-1}:R(T)\to V\) such that
\(T^{-1}(T(\bv))=\bv\) for all \(\bv\) in \(V\).
Let \(T:V\to W\) be one-to-one. Then \(T^{-1}\circ T=I\).
An isomorphism is a bijective linear transformation.
If \(T:V\to W\) is an isomorphism, then \(V\) and \(W\) are said
to
isomorphic.
If \(T:V\to W\) is an isomorphism, then \(\dim V=\dim W\).
Suppose that \(V\) is a vector space and
\(B=\{\bv_1,\ldots,\bv_n\}\) is a basis for \(V\). Then the
mapping \(T:V\to \bR^n\) given by \(T(\bu)=[\bu]_B\) is an
isomorphism.
The Matrix of a Linear Transformation
Let \(T:\bR^n\to \bR^m\) be a mapping. Then \(T\) is a linear
transformation if and only if \(T\) is a matrix transformation.
Let \(T:\bR^n\to \bR^n\) be a linear transformation. By the
above theorem, \(T(\bx) = A\bx\), for some matrix \(A\). This
matrix is called the standard matrix for \(T\).
Let \(T:\bR^n\to \bR^m\) be a linear transformation. The
standard matrix for \(T\) is \([T(\be_1)\cdots T(\be_n)]\).
Suppose that the standard matrix for \(S\) is \(A\) and the
standard matrix for \(T\) is \(B\). Then the standard matrix for
\(S\circ T\) is \(AB\).
Let \(A\) be an \(n\times n\) matrix. Then \(A\) is said to be
invertible if there exists an \(n\times n\) matrix \(B\)
such that \(AB=BA=I_n\). In this case, \(B\) is called
the inverse of \(A\), and we write \(B=A^{-1}\).
Let \(T:\bR^n\to \bR^n\) be a linear transformation, and let
\(A\) be the standard matrix for \(T\). Then \(T\) is an
isomorphism if and only if \(A\) is invertible. In this case,
the standard matrix for \(T^{-1}\) is \(A^{-1}\).
Let \(A\) be an \(n\times n\) matrix. Then \(A\) is invertible
if and only if \(A\) can be row reduced to \(I_n\).
Let \(A\) be an \(n\times n\) matrix, and let \(\bb\) be a
vector in \(\bR^n\). If \(A\) is invertible, then \(A\bx=\bb\)
has a unique solution, namely, \(\bx=A^{-1}\bb\).
Let \(A\) be an \(n\times n\) matrix, and let \(T\colon \bR^n\to
\bR^n\) be given by \(T(\bx)=A\bx\). The following are
equivalent:
- \(T\) is an isomorphism.
- \(T\) is one-to-one.
- \(T\) is onto.
- \(\ker T = \{\bz\}\).
- \(R(T) = \bR^n\).
- \(A\) is invertible.
- \(A\) row-reduces to \(I_n\).
- \(\nul A = \{\bz\}\).
- The columns of \(A\) are linearly independent.
- \(\col A = \bR^n\).
- The columns of \(A\) span \(\bR^n\).
Let \(T:V\to W\) be linear. Let \(\cB=\{\bu_1,\ldots,\bu_n\}\)
be a basis for \(V\) and \(\cB'=\{\bw_1,\ldots,\bw_m\}\) a basis
for \(W\). Then there exists a matrix \([T]_{\cB',\cB}\) such
that for every \(\bv\) in \(V\),
\([T(\bv)]_{\cB'}=[T]_{\cB',\cB}\cdot [\bv]_{\cB}\).
Let \(T:V\to W\) be linear. Let \(\cB=\{\bu_1,\ldots,\bu_n\}\)
be a basis for \(V\) and \(\cB'=\{\bw_1,\ldots,\bw_m\}\) a basis
for \(W\). Then \begin{equation*}
[T]_{\cB',\cB}=\bigg[[T(\bu_1)]_{\cB'}\, \cdots\,
[T(\bu_n)]_{\cB'}\bigg] \end{equation*}
Let \(T:U\to V\) and \(S:V\to W\) be linear. Let
\(\cB,\cB',\cB''\) be bases for vector spaces \(U,V,W\)
respectively. Then \([S\circ
T]_{\cB'',\cB}=[S]_{\cB'',\cB'}\cdot [T]_{\cB',\cB}\).
Let \(\cB,\cB'\) be bases for a vector space \(V\). Then
\([I]_{\cB',\cB}\) is called the change of coordinates
matrix from \(\cB\) to \(\cB'\) coordinates.
Let \(\cB,\cB'\) be bases for a vector space \(V\). Then
- For any \(\bv\) in \(V\), \([\bv]_{\cB'}=[I]_{\cB',\cB}\cdot [\bv]_\cB\).
- \([I]_{\cB,\cB}=I_n\), where \(n=\dim V\).
- \([I]_{\cB',\cB}\) is invertible.
- \(([I]_{\cB',\cB})^{-1}=[I]_{\cB,\cB'}\).
\([T]_{\cB,\cB}\) is often denoted by just \([T]_{\cB}\).
Let \(T:V\to V\) be a linear operator. Let \(\cB,\cB'\) be bases
for \(V\). Then \begin{equation*} [T]_{\cB'}=[I]_{\cB',\cB}\cdot
[T]_{\cB}\cdot [I]_{\cB,\cB'} \end{equation*}
Inner Product Spaces
Let \(V\) be a vector space. An inner product on \(V\) is
a rule which assigns to each pair of vectors \(\bu,\bv\) in
\(V\) a scalar, denoted \(\ip{\bu}{\bv}\), such that for all
\(\bu,\bv,\bw\) in \(V\) and all scalars \(c\),
- \(\ip{\bu}{\bv}=\ip{\bv}{\bu}\).
- \(\ip{\bu+\bv}{\bw}=\ip{\bu}{\bw}+\ip{\bv}{\bw}\).
- \(\ip{c\bu}{\bv}=c\ip{\bu}{\bv}\).
- \(\ip{\bv}{\bv}\geq 0\), with equality if and only if \(\bv=\bz\).
Let \(V\) be an inner product space.
- For \(\bv\) in \(V\), the norm (or length) of \(\bv\) is defined by \(\|\bv\|=\sqrt{\ip{\bv}{\bv}}\).
- For \(\bu,\bv\) in \(V\), the distance between \(\bu\) and \(\bv\) is \(d(\bu,\bv)=\|\bu-\bv\|\).
- A unit vector is a vector of norm 1.
- The set of all unit vectors in \(V\) is called the unit circle of \(V\).
Let \(V\) be an inner product space. Vectors \(\bu\) and \(\bv\)
in \(V\) are orthogonal if \(\ip{\bu}{\bv}=0\).
A set \(S\) of two or more vectors in an inner product space is
said to be orthogonal if every two distinct vectors in
\(S\) are orthogonal. The set \(S\) is orthonormal if
\(S\) is orthogonal and consists entirely of unit vectors.
Let \(V\) be an inner product space and let \(W\) be a subspace
of \(V\). The orthogonal complement of \(W\), denoted
\(W^{\perp}\), is the set of vectors of \(V\) which are
orthogonal to all vectors in \(W\).
Let \(V\) be an inner product space. Then
- \(\ip{\bv}{\bz}=0\) and \(\ip{\bz}{\bv}=0\), for every \(\bv\) in \(V\).
- \(\ip{c_1\bv_1+\cdots +c_n\bv_n}{\bw}=c_1\ip{\bv_1}{\bw}+\cdots+c_n\ip{\bv_n}{\bw}\), for all scalars \(c_1,\ldots,c_n\) and vectors \(\bv_1,\ldots,\bv_n,\bw\).
Let \(V\) be an inner product space. Let \(\bu,\bv,\bw\) be in
\(V\) and let \(c\) be a scalar. Then
- \(\ip{\bu}{\bv+\bw}=\ip{\bu}{\bv}+\ip{\bu}{\bw}\).
- \(\ip{\bu}{c\bv}=c\ip{\bu}{\bv}\).
Let \(V\) be an inner product space. Let \(\bv\) be in \(V\) and
let \(c\) be a scalar. Then
- \(\|c\bv\|=|c|\|\bv\|\).
- \(\dfrac{\bv}{\|\bv\|}\) is a unit vector, if \(\bv\neq \bz\).
If \(S=\{\bu_1,\ldots,\bu_n\}\) is an orthogonal set of nonzero
vectors in an inner product space, then \(S\) is linearly
independent.
Let \(V\) be an inner product space, and let
\(B=\{\bv_1,\ldots,\bv_n\}\) be an orthogonal basis for
\(V\). Then for \(\bu\) in \(V\),
\(\bu=c_1\bv_1+\cdots+c_n\bv_n\), where \begin{equation*}
c_i=\frac{\ip{\bu}{\bv_i}}{\|\bv_i\|^2},\ \text{ for
}i=1,\ldots,n. \end{equation*} If \(B\) is an orthonormal
basis, then \begin{equation*} c_i=\ip{\bu}{\bv_i}\ \text{ for
}i=1,\ldots,n. \end{equation*}
Let \(W\) be a subspace of an inner product space \(V\). Then
- \(W^{\perp}\) is a subspace of \(V\); and
- \(W\cap W^{\perp}=\{\bz\}\).
Let \(\bu,\bv\) be vectors in an inner product space \(V\) with
\(\bv\neq \bz\). Let \({L=\sspan\{\bv\}}\), a one-dimensional
subspace of \(V\). The we can uniquely write \({\bu=\by+\bz}\),
with \(\by\) in \(L\) and \(\bz\) in \(L^{\perp}\). Explicitly,
\begin{equation*} \by = \frac{\ip{\bu}{\bv}}{\|\bv\|^2}\bv,\
\text{ and }\ \bz=\bu-\by. \end{equation*} The vector \(\by\)
is called the orthogonal projection of \(\bu\) onto \(L\)
and denoted by \(\proj_L\bu\) or \(\proj_{\bv}\bu\).
Let \(\bu\) be a nonzero vector in an inner product space \(V\),
and let \(W\) be a finite dimensional subspace of \(V\). Then we
can uniquely write \(\bu=\by+\bz\), with \(\by\) in \(W\) and
\(\bz\) in \(W^{\perp}\). The vector \(\by\) is called
the orthogonal projection of \(\bu\) onto \(W\) and
denoted by \(\proj_W\bu\), and \(\bz\) is called the
component of \(\bu\) orthogonal to \(W\).
Determinants
Let \(A\) be a square matrix.
- If two rows of \(A\) are interchanged to produce a matrix \(B\), then \({\det B=-\det A}\).
- If one row of \(A\) is multiplied by a constant \(k\) to produce \(B\), then \({\det B=k\det A}\).
- If a multiple of one row of \(A\) is added to another row to produce \(B\), then \({\det B=\det A}\).
Let \(A\) be a square matrix. Then \(A\) is invertible if and
only if \({\det A\neq 0}\).
Eigenvectors and Eigenvalues
Let \(A\) be an \(n\times n\) matrix. An eigenvector of
\(A\) is a nonzero vector \(\bx\) such that \(A\bx=\lambda \bx\)
for some scalar \(\lambda\). The scalar \(\lambda\) is called
the eigenvalue corresponding to \(\bv\).
Let \(A\) be an \(n\times n\) matrix. Then \(\lambda\) is an
eigenvalue of \(A\) if and only if \(\det(\lambda I_n-A)=0\).
Let \(A\) be an \(n\times n\) matrix. The characteristic
polynomial of \(A\) is \(\det(\lambda I_n - A)\).
Let \(A\) be an \(n\times n\) matrix, and let \(\lambda\) be an
eigenvalue of \(A\). Then \(\bx\) is an eigenvector of \(A\)
corresponding to \(\lambda\) if and only if \(\bx\neq \bz\) and
\(\bx\) is in \({\nul(\lambda I_n-A)}\).
Let \(A\) be an \(n\times n\) matrix and let \(\lambda\) be an
eigenvalue of \(A\). Then \(\nul(\lambda I_n - A)\) is called
the eigenspace of \(A\) corresponding to \(\lambda\) (or
sometimes just the \(\lambda\)-eigenspace of \(A\)).
Let \(A\) be an \(n\times n\) matrix, and let \(T:\bR^n\to
\bR^n\) be the matrix transformation \(T(\bx)=A\bx\). Suppose
that \(B=\{\bv_1,\ldots,\bv_n\}\) is a basis for \(\bR^n\)
consisting of eigenvectors for \(A\) (i.e., an eigenbasis
for \(A\)). Suppose that the eigenvalues of
\(\bv_1,\ldots,\bv_n\) are \(\lambda_1,\ldots,\lambda_n\). Then
\([T]_B\) is the following diagonal matrix: \begin{equation*}
[T]_B= \begin{bmatrix} \lambda_1 & &
&\\ & \lambda_2 & & \\ & & \ddots & \\ & & & \lambda_n
\end{bmatrix} \end{equation*} If \(B'\) is the standard basis
for \(\bR^n\), then by the change of basis theorem, \(
[T]_{B'}=[I]_{B',B}[T]_B[I]_{B,B'} \). This is often written
\(A=PDP^{-1}\).
An \(n\times n\) matrix is said to be diagonalizable if
it has an eigenbasis, i.e., a basis for \(\bR^n\) consisting of
eigenvectors for \(A\).
Let \(A\) be an \(n\times n\) matrix. If
\(\lambda_1,\ldots,\lambda_k\) are distinct eigenvalues of
\(A\), and if \(\bv_1,\ldots,\bv_k\) are corresponding
eigenvectors, then \(\{\bv_1,\ldots,\bv_k\}\) is linearly
independent.
Let \(\lambda\) be an eigenvalue of \(A\).
- The algebraic multiplicity of \(\lambda\) is the multiplicity of \(A\) as a zero of the characteristic polynomial of \(A\).
- The geometric multiplicity of \(\lambda\) is the dimension of the \(\lambda\) eigenspace of \(A\).
Let \(A\) be an \(n\times n\) matrix, and let
\(\lambda_1,\ldots,\lambda_k\) be the distinct eigenvalues of
\(A\).
- The geometric multiplicity of any eigenvalue is less than or equal to its algebraic multiplicity.
- \(A\) is diagonalizable if and only if the geometric multiplicity of each eigenvalue is equal to its algebraic multplicity.