Math 301 | Linear Algebra | Fall 2026

This study guide gives the main definitions and theorems covered in the course.
Vector Spaces
  1. A binary operation on a set \(V\) is a rule which, for any two elements \(u\) and \(v\) in \(V\), produces a third element in \(V\). (Produced element sometimes denoted by \(u+v\), \(u\oplus v\), \(u\cdot v\), or \(uv\).)
  2. A scalar operation on a set \(V\) is a rule which, for any real number \(k\) and any element \(u\) in \(V\), produces an element of \(V\). (Produced element sometimes denoted by \(k\cdot v\) or \(kv\).)
A vector space consists of the following:
  • \(\bullet\ \) A set \(V\)
  • \(\bullet\ \) A binary opertion on \(V\) (called addition, denoted \(+\))
  • \(\bullet\ \) A scalar operation on \(V\) (called scalar multiplication, denoted \(\cdot\))
such that for all \(\bu, \bv, \bw\) in \(V\) and \(k,m\) in \(\bR\),
  1. \(\bu+\bv=\bv+\bu\)
  2. \((\bu+\bv)+\bw = \bu + (\bv+\bw)\)
  3. There exists an element \(\bz\) in \(V\) such that \(\bz + \bu=\bu\) for every \(\bu\) in \(V\).
  4. For every \(\bu\) in \(V\), there exists an element \(-\bu\) in \(V\) such that \(\bu + (-\bu) = \bz\).
  5. \(k\cdot (\bu + \bv) = k\cdot \bu + k\cdot \bv\)
  6. \((k+m)\cdot \bu = k\cdot \bu + m\cdot \bu\)
  7. \(k\cdot(m\cdot \bu) = (km)\cdot \bu\)
  8. \(1\cdot \bu=\bu\)
In Definition 1.2 of a vector space above, \(\bz\) is called the additive identity or the zero vector of \(V\), and for \(\bu\) in \(V\), \(-\bu\) is called the additive inverse of \(\bu\).
Let \(V\) be a vector space, \(\bu\) a vector in \(V\), and \(k\) a scalar. Then
  1. \(0 \bu=\bz\)
  2. \(k \bz = \bz\)
  3. \((-1) \bu = -\bu\)
A subspace of a vector space \(V\) is a subset \(W\) of \(V\) which is itself a vector space.
Let \(V\) be a vector space and let \(W\) be a subset of \(V\). Then \(W\) is a subspace of \(V\) if the following three conditions are satisfied:
  1. for every \(\bu\) and \(\bv\) in \(W\), \(\bu+\bv\) is in \(W\) (i.e., \(W\) is closed under vector addition);
  2. for every \(\bu\) in \(W\) and scalar \(k\), \(k\bu\) is in \(W\) (i.e., \(W\) is closed under scalar multiplication);
  3. the zero vector of \(V\) lies in \(W\).
A linear combination of \(\bv_1,\ldots,\bv_r\) is a vector of the form \(k_1\bv_1+\cdots +k_r\bv_r\), where \(k_1,\ldots,k_r\) are scalars.
The span of \(\bv_1,\ldots,\bv_r\), denoted \(\sspan\{\bv_1,\ldots,\bv_r\}\), is the set of all linear combinations of \(\bv_1,\ldots,\bv_r\).
Let \(V\) be a vector space and let \(\bv_1,\ldots,\bv_r\) be vectors in \(V\). Then \(\sspan\{\bv_1,\ldots,\bv_r\}\) is a subspace of \(V\).
Let \(V\) be a vector space and let \(\bv_1,\ldots,\bv_r\) be vectors in \(V\). Then \(\{\bv_1,\ldots,\bv_r\}\) is linearly independent if \(k_1\bv_1+\cdots +k_r\bv_r=\bz\) implies \(k_1=\cdots = k_r=0\).
A set \(\{\bv_1,\ldots,\bv_r\}\) of two or more vectors is linearly dependent if and only if at least one of the vectors is a linear combination of the others.
A basis for a vector space \(V\) is a set of vectors \(\cB=\{\bv_1,\ldots,\bv_n\}\) such that
  1. \(\sspan\{\bv_1,\ldots,\bv_n\}=V\), and
  2. \(\{\bv_1,\ldots,\bv_n\}\) is linearly independent.
Let \(\cB=\{\bv_1,\ldots,\bv_n\}\) be a basis for a vector space \(V\).
  1. If any vector of \(V\) is added to \(\cB\), then \(\cB\) is no longer linearly independent.
  2. If any vector is removed from \(\cB\), then \(\cB\) no longer spans \(V\).
Let \(\cB=\{\bv_1,\ldots\bv_n\}\) be a basis of a vector space \(V\). Then every \(\bu\) in \(V\) can be written in exactly one way as a linear combination of \(\bv_1,\ldots, \bv_n\), that is, can be expressed as \begin{equation*} \bu=c_1\bv_1+\cdots c_n\bv_n, \end{equation*} for unique scalars \(c_1,\ldots,c_n\).
Let \(\cB=\{\bv_1,\ldots,\bv_n\}\) be a basis of a vector space \(V\), and let \(\bu\) be a vector in \(V\). Then \(\bu=c_1\bv_1+\cdots+c_n\bv_n\) for unique scalars \(c_1,\ldots,c_n\), by Theorem 1.6. The scalars \(c_1,\ldots,c_n\) are called the coordinates of \(\bu\) relative to \(\cB\), and the vector \begin{equation} \begin{bmatrix} c_1\\ \vdots\\ c_n \end{bmatrix}, \end{equation} denoted by \([\bu]_\cB\), is called the coordinate vector of \(\bu\) relative to \(\cB\).
All bases of a vector space \(V\) have the same number of elements.
The dimension of a nonzero vector space \(V\) is the number of vectors in a basis for \(V\).
In \(\bR^n\), the following have the same solutions:
  1. The vector equation \(x_1\bv_1+\cdots +x_p\bv_p=\bu\).
  2. The linear system of equations with augmented matrix \([\bv_1\cdots \bv_p\mid \bu]\).
  3. The matrix equation \([\bv_1\, \cdots \bv_p]\,\bx=\bu\).
Let \(A=[\bv_1 \cdots \bv_n]\) be an \(m\times n\) matrix with column vectors \(\bv_1,\ldots,\bv_n\), and let \(\bx=\begin{bmatrix} x_1\\ \vdots\\ x_n \end{bmatrix} \) be a vector in \(\bR^n\). Then \(A\bx = x_1\bv_1+\cdots + x_n\bv_n\).
Let \(A\) be an \(m\times n\) matrix. The nullspace of \(A\), denoted by \(\nul A\), is the set of all solutions to \(A\bx = \bz\).
Let \(A\) be an \(m\times n\) matrix. The column space of \(A\), denoted by \(\col A\), is the span of the column vectors of \(A\).
Let \(A\) be an \(m\times n\) matrix, let \(\bu,\bv\) be vectors in \(\bR^n\), and let \(c\) be a scalar. Then
  1. \(A(\bu+\bv)=A\bu+A\bv\), and
  2. \(A(c\bu)=c(A\bu)\).
Let \(A\) be an \(m\times n\) matrix. Then
  1. \(\nul A\) is a subspace of \(\bR^n\).
  2. \(\col A\) is a subspace of \(\bR^m\).
Let \(A\) be a matrix with \(n\) columns. Then \({\dim (\nul A) + \dim (\col A) = n}\).
Linear Transformations
Let \(V\) and \(W\) be vector spaces. A transformation (or mapping) \(T:V\to W\) is linear if it satisfies the following conditions:
  1. For every \(\bu,\bv\) in \(V\), \(T(\bu+\bv)=T(\bu)+T(\bv)\).
  2. For every \(\bu\) in \(V\) and scalar \(c\), \(T(c\bu)=cT(\bu)\).
Let \(T:V\to W\) be linear. Then
  1. \(T(\bz)=\bz\).
  2. \(T(c_1\bv_1+\cdots +c_p\bv_p)=c_1T(\bv_1)+\cdots+c_pT(\bv_p)\), for any scalars \(c_1,\ldots,c_p\) and vectors \(\bv_1,\ldots,\bv_p\) in \(V\).
A matrix transformation is a mapping \(T:\bR^n\to \bR^m\) given by \(T(\bx)=A\bx\), for some fixed \(m\times n\) matrix \(A\).
A matrix transformation is linear.
Let \(T:V\to W\) be linear. Then
  1. The kernel of \(T\), denoted \(\kernel(T)\), is the set of vectors in \(V\) which \(T\) maps to \(\bz\).
  2. The range of \(T\), denoted \(R(T)\), is the set of vectors in \(W\) which have at least one vector in \(V\) mapping to them.
Let \(T:V\to W\) be linear. Then \(\kernel(T)\) is a subspace of \(V\) and \(R(T)\) is a subspace of \(W\).
Let \(A\) be an \(m\times n\) matrix, and let \(T:\bR^n\to \bR^m\) be the matrix transformation \(T(\bx)=A\bx\). Then \(\kernel(T)=\nul A\) and \(R(T)=\col A\).
Let \(T:V\to W\) be linear. Then \(\dim(\ker T) + \dim (R(T)) = \dim V\).
Let \(T:V\to W\) be linear.
  1. \(T\) is one-to-one if and only if \(\ker T=\{\bz\}\).
  2. \(T\) is onto if and only if \(R(T) = W\).
Let \(W\) be a subspace of \(V\). If \(\dim W=\dim V\), then \(W=V\).
Let \(T:V\to W\) be linear, and suppose that \(\dim V=\dim W\). Then \(T\) is one-to-one if and only if \(T\) is onto.
Let \(T:U\to V\) and \(S:V\to W\) be linear transformations. Then the composition of \(S\) with \(T\), denoted \(S\circ T\), is the map from \(U\) to \(W\) defined by \((S\circ T)(\bu)=S(T(\bu))\) for \(\bu\in U\).
Let \(T:U\to V\) and \(S:V\to W\) be linear transformations. Then the composition \(S\circ T:U\to W\) is a linear transformation.
For any vector space \(V\), the identity transformation \(I:V\to V\) is defined by \(I(\bv)=\bv\) for all \(\bv\) in \(V\).
Let \(T:V\to W\) be a linear transformation. Then \(T\circ I=I\circ T=T\).
Let \(T:V\to W\) be one-to-one. Then there exists an inverse transformation \(T^{-1}:R(T)\to V\) such that \(T^{-1}(T(\bv))=\bv\) for all \(\bv\) in \(V\).
Let \(T:V\to W\) be one-to-one. Then \(T^{-1}\circ T=I\).
An isomorphism is a bijective linear transformation.
If \(T:V\to W\) is an isomorphism, then \(V\) and \(W\) are said to isomorphic.
If \(T:V\to W\) is an isomorphism, then \(\dim V=\dim W\).
Suppose that \(V\) is a vector space and \(B=\{\bv_1,\ldots,\bv_n\}\) is a basis for \(V\). Then the mapping \(T:V\to \bR^n\) given by \(T(\bu)=[\bu]_B\) is an isomorphism.
The Matrix of a Linear Transformation
Let \(T:\bR^n\to \bR^m\) be a mapping. Then \(T\) is a linear transformation if and only if \(T\) is a matrix transformation.
Let \(T:\bR^n\to \bR^n\) be a linear transformation. By the above theorem, \(T(\bx) = A\bx\), for some matrix \(A\). This matrix is called the standard matrix for \(T\).
Let \(T:\bR^n\to \bR^m\) be a linear transformation. The standard matrix for \(T\) is \([T(\be_1)\cdots T(\be_n)]\).
Suppose that the standard matrix for \(S\) is \(A\) and the standard matrix for \(T\) is \(B\). Then the standard matrix for \(S\circ T\) is \(AB\).
Let \(A\) be an \(n\times n\) matrix. Then \(A\) is said to be invertible if there exists an \(n\times n\) matrix \(B\) such that \(AB=BA=I_n\). In this case, \(B\) is called the inverse of \(A\), and we write \(B=A^{-1}\).
Let \(T:\bR^n\to \bR^n\) be a linear transformation, and let \(A\) be the standard matrix for \(T\). Then \(T\) is an isomorphism if and only if \(A\) is invertible. In this case, the standard matrix for \(T^{-1}\) is \(A^{-1}\).
Let \(A\) be an \(n\times n\) matrix. Then \(A\) is invertible if and only if \(A\) can be row reduced to \(I_n\).
Let \(A\) be an \(n\times n\) matrix, and let \(\bb\) be a vector in \(\bR^n\). If \(A\) is invertible, then \(A\bx=\bb\) has a unique solution, namely, \(\bx=A^{-1}\bb\).
Let \(A\) be an \(n\times n\) matrix, and let \(T\colon \bR^n\to \bR^n\) be given by \(T(\bx)=A\bx\). The following are equivalent:
  1. \(T\) is an isomorphism.
  2. \(T\) is one-to-one.
  3. \(T\) is onto.
  4. \(\ker T = \{\bz\}\).
  5. \(R(T) = \bR^n\).
  6. \(A\) is invertible.
  7. \(A\) row-reduces to \(I_n\).
  8. \(\nul A = \{\bz\}\).
  9. The columns of \(A\) are linearly independent.
  10. \(\col A = \bR^n\).
  11. The columns of \(A\) span \(\bR^n\).
Let \(T:V\to W\) be linear. Let \(\cB=\{\bu_1,\ldots,\bu_n\}\) be a basis for \(V\) and \(\cB'=\{\bw_1,\ldots,\bw_m\}\) a basis for \(W\). Then there exists a matrix \([T]_{\cB',\cB}\) such that for every \(\bv\) in \(V\), \([T(\bv)]_{\cB'}=[T]_{\cB',\cB}\cdot [\bv]_{\cB}\).
Let \(T:V\to W\) be linear. Let \(\cB=\{\bu_1,\ldots,\bu_n\}\) be a basis for \(V\) and \(\cB'=\{\bw_1,\ldots,\bw_m\}\) a basis for \(W\). Then \begin{equation*} [T]_{\cB',\cB}=\bigg[[T(\bu_1)]_{\cB'}\, \cdots\, [T(\bu_n)]_{\cB'}\bigg] \end{equation*}
Let \(T:U\to V\) and \(S:V\to W\) be linear. Let \(\cB,\cB',\cB''\) be bases for vector spaces \(U,V,W\) respectively. Then \([S\circ T]_{\cB'',\cB}=[S]_{\cB'',\cB'}\cdot [T]_{\cB',\cB}\).
Let \(\cB,\cB'\) be bases for a vector space \(V\). Then \([I]_{\cB',\cB}\) is called the change of coordinates matrix from \(\cB\) to \(\cB'\) coordinates.
Let \(\cB,\cB'\) be bases for a vector space \(V\). Then
  1. For any \(\bv\) in \(V\), \([\bv]_{\cB'}=[I]_{\cB',\cB}\cdot [\bv]_\cB\).
  2. \([I]_{\cB,\cB}=I_n\), where \(n=\dim V\).
  3. \([I]_{\cB',\cB}\) is invertible.
  4. \(([I]_{\cB',\cB})^{-1}=[I]_{\cB,\cB'}\).
\([T]_{\cB,\cB}\) is often denoted by just \([T]_{\cB}\).
Let \(T:V\to V\) be a linear operator. Let \(\cB,\cB'\) be bases for \(V\). Then \begin{equation*} [T]_{\cB'}=[I]_{\cB',\cB}\cdot [T]_{\cB}\cdot [I]_{\cB,\cB'} \end{equation*}
Inner Product Spaces
Let \(V\) be a vector space. An inner product on \(V\) is a rule which assigns to each pair of vectors \(\bu,\bv\) in \(V\) a scalar, denoted \(\ip{\bu}{\bv}\), such that for all \(\bu,\bv,\bw\) in \(V\) and all scalars \(c\),
  1. \(\ip{\bu}{\bv}=\ip{\bv}{\bu}\).
  2. \(\ip{\bu+\bv}{\bw}=\ip{\bu}{\bw}+\ip{\bv}{\bw}\).
  3. \(\ip{c\bu}{\bv}=c\ip{\bu}{\bv}\).
  4. \(\ip{\bv}{\bv}\geq 0\), with equality if and only if \(\bv=\bz\).
A vector space with an inner product is called an inner product space.
Let \(V\) be an inner product space.
  1. For \(\bv\) in \(V\), the norm (or length) of \(\bv\) is defined by \(\|\bv\|=\sqrt{\ip{\bv}{\bv}}\).
  2. For \(\bu,\bv\) in \(V\), the distance between \(\bu\) and \(\bv\) is \(d(\bu,\bv)=\|\bu-\bv\|\).
  3. A unit vector is a vector of norm 1.
  4. The set of all unit vectors in \(V\) is called the unit circle of \(V\).
Let \(V\) be an inner product space. Vectors \(\bu\) and \(\bv\) in \(V\) are orthogonal if \(\ip{\bu}{\bv}=0\).
A set \(S\) of two or more vectors in an inner product space is said to be orthogonal if every two distinct vectors in \(S\) are orthogonal. The set \(S\) is orthonormal if \(S\) is orthogonal and consists entirely of unit vectors.
Let \(V\) be an inner product space and let \(W\) be a subspace of \(V\). The orthogonal complement of \(W\), denoted \(W^{\perp}\), is the set of vectors of \(V\) which are orthogonal to all vectors in \(W\).
Let \(V\) be an inner product space. Then
  1. \(\ip{\bv}{\bz}=0\) and \(\ip{\bz}{\bv}=0\), for every \(\bv\) in \(V\).
  2. \(\ip{c_1\bv_1+\cdots +c_n\bv_n}{\bw}=c_1\ip{\bv_1}{\bw}+\cdots+c_n\ip{\bv_n}{\bw}\), for all scalars \(c_1,\ldots,c_n\) and vectors \(\bv_1,\ldots,\bv_n,\bw\).
Let \(V\) be an inner product space. Let \(\bu,\bv,\bw\) be in \(V\) and let \(c\) be a scalar. Then
  1. \(\ip{\bu}{\bv+\bw}=\ip{\bu}{\bv}+\ip{\bu}{\bw}\).
  2. \(\ip{\bu}{c\bv}=c\ip{\bu}{\bv}\).
Let \(V\) be an inner product space. Let \(\bv\) be in \(V\) and let \(c\) be a scalar. Then
  1. \(\|c\bv\|=|c|\|\bv\|\).
  2. \(\dfrac{\bv}{\|\bv\|}\) is a unit vector, if \(\bv\neq \bz\).
If \(S=\{\bu_1,\ldots,\bu_n\}\) is an orthogonal set of nonzero vectors in an inner product space, then \(S\) is linearly independent.
Let \(V\) be an inner product space, and let \(B=\{\bv_1,\ldots,\bv_n\}\) be an orthogonal basis for \(V\). Then for \(\bu\) in \(V\), \(\bu=c_1\bv_1+\cdots+c_n\bv_n\), where \begin{equation*} c_i=\frac{\ip{\bu}{\bv_i}}{\|\bv_i\|^2},\ \text{ for }i=1,\ldots,n. \end{equation*} If \(B\) is an orthonormal basis, then \begin{equation*} c_i=\ip{\bu}{\bv_i}\ \text{ for }i=1,\ldots,n. \end{equation*}
Let \(W\) be a subspace of an inner product space \(V\). Then
  1. \(W^{\perp}\) is a subspace of \(V\); and
  2. \(W\cap W^{\perp}=\{\bz\}\).
Let \(\bu,\bv\) be vectors in an inner product space \(V\) with \(\bv\neq \bz\). Let \({L=\sspan\{\bv\}}\), a one-dimensional subspace of \(V\). The we can uniquely write \({\bu=\by+\bz}\), with \(\by\) in \(L\) and \(\bz\) in \(L^{\perp}\). Explicitly, \begin{equation*} \by = \frac{\ip{\bu}{\bv}}{\|\bv\|^2}\bv,\ \text{ and }\ \bz=\bu-\by. \end{equation*} The vector \(\by\) is called the orthogonal projection of \(\bu\) onto \(L\) and denoted by \(\proj_L\bu\) or \(\proj_{\bv}\bu\).
Let \(\bu\) be a nonzero vector in an inner product space \(V\), and let \(W\) be a finite dimensional subspace of \(V\). Then we can uniquely write \(\bu=\by+\bz\), with \(\by\) in \(W\) and \(\bz\) in \(W^{\perp}\). The vector \(\by\) is called the orthogonal projection of \(\bu\) onto \(W\) and denoted by \(\proj_W\bu\), and \(\bz\) is called the component of \(\bu\) orthogonal to \(W\).
Determinants
Let \(A\) be a square matrix.
  1. If two rows of \(A\) are interchanged to produce a matrix \(B\), then \({\det B=-\det A}\).
  2. If one row of \(A\) is multiplied by a constant \(k\) to produce \(B\), then \({\det B=k\det A}\).
  3. If a multiple of one row of \(A\) is added to another row to produce \(B\), then \({\det B=\det A}\).
Let \(A\) be a square matrix. Then \(A\) is invertible if and only if \({\det A\neq 0}\).
Eigenvectors and Eigenvalues
Let \(A\) be an \(n\times n\) matrix. An eigenvector of \(A\) is a nonzero vector \(\bx\) such that \(A\bx=\lambda \bx\) for some scalar \(\lambda\). The scalar \(\lambda\) is called the eigenvalue corresponding to \(\bv\).
Let \(A\) be an \(n\times n\) matrix. Then \(\lambda\) is an eigenvalue of \(A\) if and only if \(\det(\lambda I_n-A)=0\).
Let \(A\) be an \(n\times n\) matrix. The characteristic polynomial of \(A\) is \(\det(\lambda I_n - A)\).
Let \(A\) be an \(n\times n\) matrix, and let \(\lambda\) be an eigenvalue of \(A\). Then \(\bx\) is an eigenvector of \(A\) corresponding to \(\lambda\) if and only if \(\bx\neq \bz\) and \(\bx\) is in \({\nul(\lambda I_n-A)}\).
Let \(A\) be an \(n\times n\) matrix and let \(\lambda\) be an eigenvalue of \(A\). Then \(\nul(\lambda I_n - A)\) is called the eigenspace of \(A\) corresponding to \(\lambda\) (or sometimes just the \(\lambda\)-eigenspace of \(A\)).
Let \(A\) be an \(n\times n\) matrix, and let \(T:\bR^n\to \bR^n\) be the matrix transformation \(T(\bx)=A\bx\). Suppose that \(B=\{\bv_1,\ldots,\bv_n\}\) is a basis for \(\bR^n\) consisting of eigenvectors for \(A\) (i.e., an eigenbasis for \(A\)). Suppose that the eigenvalues of \(\bv_1,\ldots,\bv_n\) are \(\lambda_1,\ldots,\lambda_n\). Then \([T]_B\) is the following diagonal matrix: \begin{equation*} [T]_B= \begin{bmatrix} \lambda_1 & & &\\ & \lambda_2 & & \\ & & \ddots & \\ & & & \lambda_n \end{bmatrix} \end{equation*} If \(B'\) is the standard basis for \(\bR^n\), then by the change of basis theorem, \( [T]_{B'}=[I]_{B',B}[T]_B[I]_{B,B'} \). This is often written \(A=PDP^{-1}\).
An \(n\times n\) matrix is said to be diagonalizable if it has an eigenbasis, i.e., a basis for \(\bR^n\) consisting of eigenvectors for \(A\).
Let \(A\) be an \(n\times n\) matrix. If \(\lambda_1,\ldots,\lambda_k\) are distinct eigenvalues of \(A\), and if \(\bv_1,\ldots,\bv_k\) are corresponding eigenvectors, then \(\{\bv_1,\ldots,\bv_k\}\) is linearly independent.
Let \(\lambda\) be an eigenvalue of \(A\).
  1. The algebraic multiplicity of \(\lambda\) is the multiplicity of \(A\) as a zero of the characteristic polynomial of \(A\).
  2. The geometric multiplicity of \(\lambda\) is the dimension of the \(\lambda\) eigenspace of \(A\).
Let \(A\) be an \(n\times n\) matrix, and let \(\lambda_1,\ldots,\lambda_k\) be the distinct eigenvalues of \(A\).
  1. The geometric multiplicity of any eigenvalue is less than or equal to its algebraic multiplicity.
  2. \(A\) is diagonalizable if and only if the geometric multiplicity of each eigenvalue is equal to its algebraic multplicity.