Linear Algebra for Team-Based Inquiry Learning

2023 Edition

Steven Clontz Drew Lewis
University of South Alabama

August 24, 2023

Section 2.4: Linear Independence (EV4)

Activity 2.4.1 (~10 min)

Consider the two sets

\begin{equation*} S=\left\{ \left[\begin{array}{c}2\\3\\1\end{array}\right], \left[\begin{array}{c}1\\1\\4\end{array}\right] \right\} \hspace{3em} T=\left\{ \left[\begin{array}{c}2\\3\\1\end{array}\right], \left[\begin{array}{c}1\\1\\4\end{array}\right], \left[\begin{array}{c}-1\\0\\-11\end{array}\right] \right\}\text{.} \end{equation*}
Which of the following is true?

  1. \(\vspan S\) is bigger than \(\vspan T\text{.}\)
  2. \(\vspan S\) and \(\vspan T\) are the same size.
  3. \(\vspan S\) is smaller than \(\vspan T\text{.}\)

Definition 2.4.1

We say that a set of vectors is linearly dependent if one vector in the set belongs to the span of the others. Otherwise, we say the set is linearly independent.

Figure 1. A linearly dependent set of three vectors

You can think of linearly dependent sets as containing a redundant vector, in the sense that you can drop a vector out without reducing the span of the set. In the above image, all three vectors lay in the same planar subspace, but only two vectors are needed to span the plane, so the set is linearly dependent.

Activity 2.4.2 (~10 min)

Consider the following three vectors in \(\IR^3\text{:}\)

\begin{equation*} \vec v_1=\left[\begin{array}{c}-2 \\ 0 \\ 0\end{array}\right], \vec v_2=\left[\begin{array}{c}1 \\ 3 \\ 0\end{array}\right], \text{ and } \vec v_3=\left[\begin{array}{c}-2 \\ 5 \\ 4\end{array}\right]\text{.} \end{equation*}

Part 1.

Let \(\vec w = 3\vec v_1 - \vec v_2 - 5 \vec v_3 = \left[\begin{array}{c}\unknown \\ \unknown \\ \unknown\end{array}\right]\text{.}\) The set \(\{\vec v_1,\vec v_2,\vec v_3,\vec w\}\) is...

  1. linearly dependent: at least one vector is a linear combination of others

  2. linearly independent: no vector is a linear combination of others

Activity 2.4.2 (~10 min)

Consider the following three vectors in \(\IR^3\text{:}\)

\begin{equation*} \vec v_1=\left[\begin{array}{c}-2 \\ 0 \\ 0\end{array}\right], \vec v_2=\left[\begin{array}{c}1 \\ 3 \\ 0\end{array}\right], \text{ and } \vec v_3=\left[\begin{array}{c}-2 \\ 5 \\ 4\end{array}\right]\text{.} \end{equation*}

Part 2.

Find

\begin{equation*} \RREF \left[\begin{array}{cccc} \vec v_1 & \vec v_2 & \vec v_3 & \vec w \\ \end{array}\right]= \RREF \left[\begin{array}{cccc} -2 & 1 &-2 & \unknown \\ 0 & 3 & 5 & \unknown \\ 0 &0 &4 & \unknown \end{array}\right]= \unknown . \end{equation*}

What does this tell you about solution set for the vector equation \(x_1\vec{v}_1+x_2\vec{v}_2+x_3\vec{v}_3 + x_4\vec w=\vec{0}\text{?}\)

  1. It is inconsistent.

  2. It is consistent with one solution.

  3. It is consistent with infinitely many solutions.

Activity 2.4.2 (~10 min)

Consider the following three vectors in \(\IR^3\text{:}\)

\begin{equation*} \vec v_1=\left[\begin{array}{c}-2 \\ 0 \\ 0\end{array}\right], \vec v_2=\left[\begin{array}{c}1 \\ 3 \\ 0\end{array}\right], \text{ and } \vec v_3=\left[\begin{array}{c}-2 \\ 5 \\ 4\end{array}\right]\text{.} \end{equation*}

Part 3.

Which of these might explain the connection?

  1. A pivot column establishes linear independence and creates a contradiction.

  2. A non-pivot column both describes a linear combination and reveals the number of solutions.

  3. A pivot row describes the bound variables and prevents a contradiction.

  4. A non-pivot row prevents contradictions and makes the vector equation solvable.

Fact 2.4.2

For any vector space, the set \(\{\vec v_1,\dots\vec v_n\}\) is linearly dependent if and only if the vector equation \(x_1\vec v_1+ x_2 \vec v_2+\dots+x_n\vec v_n=\vec{0}\) is consistent with infinitely many solutions.

Likewise, the set of vectors \(\{\vec v_1,\dots\vec v_n\}\) is linearly independent if and only the vector equation

\begin{equation*} x_1\vec v_1+ x_2 \vec v_2 + \cdots + x_n\vec v_n = 0 \end{equation*}
has exactly one solution: \(\left[\begin{array}{c} x_1 \\ \vdots \\ x_n \end{array}\right]=\left[\begin{array}{c} 0 \\ \vdots \\ 0 \end{array}\right]\text{.}\)

Activity 2.4.3 (~10 min)

Find

\begin{equation*} \RREF\left[\begin{array}{ccccc|c} 2&2&3&-1&4&0\\ 3&0&13&10&3&0\\ 0&0&7&7&0&0\\ -1&3&16&14&1&0 \end{array}\right] \end{equation*}
and mark the part of the matrix that demonstrates that
\begin{equation*} S=\left\{ \left[\begin{array}{c}2\\3\\0\\-1\end{array}\right], \left[\begin{array}{c}2\\0\\0\\3\end{array}\right], \left[\begin{array}{c}3\\13\\7\\16\end{array}\right], \left[\begin{array}{c}-1\\10\\7\\14\end{array}\right], \left[\begin{array}{c}4\\3\\0\\1\end{array}\right] \right\} \end{equation*}
is linearly dependent (the part that shows its linear system has infinitely many solutions).

Observation 2.4.3

Compare the following results:

  • A set of \(\IR^m\) vectors \(\{\vec v_1,\dots\vec v_n\}\) is linearly independent if and only if \(\RREF\left[\begin{array}{ccc}\vec v_1&\dots&\vec v_n\end{array}\right]\) has all pivot columns.

  • A set of \(\IR^m\) vectors \(\{\vec v_1,\dots\vec v_n\}\) is linearly dependent if and only if \(\RREF\left[\begin{array}{ccc}\vec v_1&\dots&\vec v_n\end{array}\right]\) has at least one non-pivot column.

  • A set of \(\IR^m\) vectors \(\{\vec v_1,\dots\vec v_n\}\) spans \(\IR^m\) if and only if \(\RREF\left[\begin{array}{ccc}\vec v_1&\dots&\vec v_n\end{array}\right]\) has all pivot rows.

  • A set of \(\IR^m\) vectors \(\{\vec v_1,\dots\vec v_n\}\) fails to span \(\IR^m\) if and only if \(\RREF\left[\begin{array}{ccc}\vec v_1&\dots&\vec v_n\end{array}\right]\) has at least one non-pivot row.

Activity 2.4.4

Part 1.

Write a statement involving the solutions of a vector equation that’s equivalent to each claim:

Activity 2.4.4

Part 1.

“The set of vectors \(\left\{ \left[\begin{array}{c} 1 \\ -1 \\ 0 \\ -1 \end{array}\right] , \left[\begin{array}{c} 5 \\ 5 \\ 3 \\ 1 \end{array}\right] , \left[\begin{array}{c} 9 \\ 11 \\ 6 \\ 3 \end{array}\right] \right\}\) is linearly independent.”

Activity 2.4.4

Part 2.

“The set of vectors \(\left\{ \left[\begin{array}{c} 1 \\ -1 \\ 0 \\ -1 \end{array}\right] , \left[\begin{array}{c} 5 \\ 5 \\ 3 \\ 1 \end{array}\right] , \left[\begin{array}{c} 9 \\ 11 \\ 6 \\ 3 \end{array}\right] \right\}\) is linearly dependent.”

Activity 2.4.4

Part 2.

Explain how to determine which of these statements is true.

Activity 2.4.5 (~5 min)

What is the largest number of \(\IR^4\) vectors that can form a linearly independent set?

  1. \(\displaystyle 3\)

  2. \(\displaystyle 4\)

  3. \(\displaystyle 5\)

  4. You can have infinitely many vectors and still be linearly independent.

Activity 2.4.6 (~5 min)

Is is possible for the set of Euclidean vectors \(\{\vec v_1, \vec v_2,\ldots, \vec v_n, \vec 0\}\) to be linearly independent?

  1. Yes

  2. No