Skip to main content

Section 1.2 Row Reduction of Matrices (LE2)

Subsection 1.2.1 Class Activities

Definition 1.2.1.

Two systems of linear equations (and their corresponding augmented matrices) are said to be equivalent if they have the same solution set.
For example, both of these systems share the same solution set \(\setList{ \left[\begin{array}{c} 1 \\ 1\end{array}\right] }\text{.}\)
\begin{alignat*}{3} 3x_1 &\,-\,& 2x_2 &\,=\,& 1 \\ x_1 &\,+\,& 4x_2 &\,=\,& 5 \end{alignat*}
\begin{alignat*}{3} 3x_1 &\,-\,& 2x_2 &\,=\,& 1 \\ 4x_1 &\,+\,& 2x_2 &\,=\,& 6 \end{alignat*}
Therefore these augmented matrices are equivalent (even though they’re not equal), which we denote with \(\sim\text{:}\)
\begin{equation*} \left[\begin{array}{cc|c} 3 & -2 & 1\\ 1 & 4 & 5\\ \end{array}\right] \not= \left[\begin{array}{cc|c} 3 & -2 & 1\\ 4 & 2 & 6\\ \end{array}\right] \end{equation*}
\begin{equation*} \left[\begin{array}{cc|c} 3 & -2 & 1\\ 1 & 4 & 5\\ \end{array}\right] \sim \left[\begin{array}{cc|c} 3 & -2 & 1\\ 4 & 2 & 6\\ \end{array}\right] \end{equation*}

Activity 1.2.2.

Following are seven procedures used to manipulate an augmented matrix. Label the procedures that would result in an equivalent augmented matrix as valid, and label the procedures that might change the solution set of the corresponding linear system as invalid.
  1. Swap two rows.
  2. Swap two columns.
  3. Add a constant to every term in a row.
  4. Multiply a row by a nonzero constant.
  5. Add a constant multiple of one row to another row.
  6. Replace a column with zeros.
  7. Replace a row with zeros.

Definition 1.2.3.

The following three row operations produce equivalent augmented matrices.
  1. Swap two rows, for example, \(R_1\leftrightarrow R_2\text{:}\)
    \begin{equation*} \left[\begin{array}{cc|c} 1 & 2 & 3 \\ 4 & 5 & 6 \end{array}\right] \sim \left[\begin{array}{cc|c} 4 & 5 & 6 \\ 1 & 2 & 3 \end{array}\right] \end{equation*}
  2. Multiply a row by a nonzero constant, for example, \(2R_1\rightarrow R_1\text{:}\)
    \begin{equation*} \left[\begin{array}{cc|c} 1 & 2 & 3 \\ 4 & 5 & 6 \end{array}\right] \sim \left[\begin{array}{cc|c} 2(1) & 2(2) & 2(3) \\ 4 & 5 & 6 \end{array}\right] \end{equation*}
  3. Add a constant multiple of one row to another row, for example, \(R_2-4R_1\rightarrow R_2\text{:}\)
    \begin{equation*} \left[\begin{array}{cc|c} 1 & 2 & 3 \\ 4 & 5 & 6 \end{array}\right] \sim \left[\begin{array}{cc|c} 1 & 2 & 3 \\ 4-4(1) & 5-4(2) & 6-4(3) \end{array}\right] \end{equation*}

Activity 1.2.4.

Consider the following (equivalent) linear systems.
A)
\begin{alignat*}{4} x &\,+\,& 2y &\,+\,& z &\,=\,& 3 \\ -x &\,-\,& y &\,+\,& z &\,=\,& 1 \\ 2x &\,+\,& 5y &\,+\,& 3z &\,=\,& 7 \end{alignat*}
B)
\begin{alignat*}{4} 2x &\,+\,& 5y &\,+\,& 3z &\,=\,& 7 \\ -x &\,-\,& y &\,+\,& z &\,=\,& 1 \\ x &\,+\,& 2y &\,+\,& z &\,=\,& 3 \end{alignat*}
C)
\begin{alignat*}{4} x & & &\,-\,& z &\,=\,& 1 \\ & & y &\,+\,& 2z &\,=\,& 4 \\ & & y &\,+\,& z &\,=\,& 1 \end{alignat*}
D)
\begin{alignat*}{4} x &\,+\,& 2y &\,+\,& z &\,=\,& 3 \\ & & y &\,+\,& 2z &\,=\,& 4 \\ 2x &\,+\,& 5y &\,+\,& 3z &\,=\,& 7 \end{alignat*}
E)
\begin{alignat*}{4} x & & &\,-\,& z &\,=\,& 1 \\ & & y &\,+\,& z &\,=\,& 1 \\ & & & & z &\,=\,& 3 \end{alignat*}
F)
\begin{alignat*}{4} x &\,+\,& 2y &\,+\,& z &\,=\,& 3 \\ & & y &\,+\,& 2z &\,=\,& 4 \\ & & y &\,+\,& z &\,=\,& 1 \end{alignat*}
Rank the six linear systems from most complicated to simplest.

Activity 1.2.5.

We can rewrite the previous in terms of equivalences of augmented matrices
\begin{alignat*}{3} \left[\begin{array}{ccc|c} 2 & 5 & 3 & 7 \\ -1 & -1 & 1 & 1 \\ 1 & 2 & 1 & 3 \end{array}\right] & \sim & \left[\begin{array}{ccc|c} \markedPivot{1} & 2 & 1 & 3 \\ -1 & -1 & 1 & 1 \\ 2 & 5 & 3 & 7 \end{array}\right] & \sim & \left[\begin{array}{ccc|c} \markedPivot{1} & 2 & 1 & 3 \\ 0 & 1 & 2 & 4 \\ 2 & 5 & 3 & 7 \end{array}\right] \sim \\ \left[\begin{array}{ccc|c} \markedPivot{1} & 2 & 1 & 3 \\ 0 & \markedPivot{1} & 2 & 4 \\ 0 & 1 & 1 & 1 \end{array}\right] & \sim & \left[\begin{array}{ccc|c} \markedPivot{1} & 0 & -1 & 1 \\ 0 & \markedPivot{1} & 2 & 4 \\ 0 & 1 & 1 & 1 \end{array}\right] & \sim & \left[\begin{array}{ccc|c} \markedPivot{1} & 0 & -1 & 1 \\ 0 & \markedPivot{1} & 1 & 1 \\ 0 & 0 & -1 & -3 \end{array}\right] \end{alignat*}
Determine the row operation(s) necessary in each step to transform the most complicated system’s augmented matrix into the simplest.

Definition 1.2.6.

A matrix is in reduced row echelon form (RREF) if
  1. The leading term (first nonzero term) of each nonzero row is a 1. Call these terms pivots.
  2. Each pivot is to the right of every higher pivot.
  3. Each term above or below a pivot is zero.
  4. All rows of zeroes are at the bottom of the matrix.
Every matrix has a unique reduced row echelon form. If \(A\) is a matrix, we write \(\RREF(A)\) for the reduced row echelon form of that matrix.

Activity 1.2.7.

Recall that a matrix is in reduced row echelon form (RREF) if
  1. The leading term (first nonzero term) of each nonzero row is a 1. Call these terms pivots.
  2. Each pivot is to the right of every higher pivot.
  3. Each term above or below a pivot is zero.
  4. All rows of zeroes are at the bottom of the matrix.
For each matrix, circle the leading terms, and label it as RREF or not RREF. For the ones not in RREF, find their RREF.
\begin{equation*} A=\left[\begin{array}{ccc|c} 1 & 0 & 0 & 3 \\ 0 & 0 & 1 & -1 \\ 0 & 0 & 0 & 0 \end{array}\right] \end{equation*}
\begin{equation*} B=\left[\begin{array}{ccc|c} 1 & 2 & 4 & 3 \\ 0 & 0 & 1 & -1 \\ 0 & 0 & 0 & 0 \end{array}\right] \end{equation*}
\begin{equation*} C=\left[\begin{array}{ccc|c} 0 & 0 & 0 & 0 \\ 1 & 2 & 0 & 3 \\ 0 & 0 & 1 & -1 \end{array}\right] \end{equation*}

Activity 1.2.8.

Recall that a matrix is in reduced row echelon form (RREF) if
  1. The leading term (first nonzero term) of each nonzero row is a 1. Call these terms pivots.
  2. Each pivot is to the right of every higher pivot.
  3. Each term above or below a pivot is zero.
  4. All rows of zeroes are at the bottom of the matrix.
For each matrix, circle the leading terms, and label it as RREF or not RREF. For the ones not in RREF, find their RREF.
\begin{equation*} D=\left[\begin{array}{ccc|c} 1 & 0 & 2 & -3 \\ 0 & 3 & 3 & -3 \\ 0 & 0 & 0 & 0 \end{array}\right] \end{equation*}
\begin{equation*} E=\left[\begin{array}{ccc|c} 0 & 1 & 0 & 7 \\ 1 & 0 & 0 & 4 \\ 0 & 0 & 0 & 0 \end{array}\right] \end{equation*}
\begin{equation*} F=\left[\begin{array}{ccc|c} 1 & 0 & 0 & 4 \\ 0 & 1 & 0 & 7 \\ 0 & 0 & 1 & 0 \end{array}\right] \end{equation*}

Remark 1.2.9.

In practice, if we simply need to convert a matrix into reduced row echelon form, we use technology to do so.
However, it is also important to understand the Gauss-Jordan elimination algorithm that a computer or calculator uses to convert a matrix (augmented or not) into reduced row echelon form. Understanding this algorithm will help us better understand how to interpret the results in many applications we use it for in Module V.

Activity 1.2.10.

Consider the matrix
\begin{equation*} \left[\begin{array}{cccc}2 & 6 & -1 & 6 \\ 1 & 3 & -1 & 2 \\ -1 & -3 & 2 & 0 \end{array}\right]. \end{equation*}
Which row operation is the best choice for the first move in converting to RREF?
  1. Add row 3 to row 2 (\(R_2+R_3 \rightarrow R_2\))
  2. Add row 2 to row 3 (\(R_3+R_2 \rightarrow R_3\))
  3. Swap row 1 to row 2 (\(R_1 \leftrightarrow R_2\))
  4. Add -2 row 2 to row 1 (\(R_1-2R_2 \rightarrow R_1\))

Activity 1.2.11.

Consider the matrix
\begin{equation*} \left[\begin{array}{cccc} \markedPivot{1} & 3 & -1 & 2 \\ 2 & 6 & -1 & 6 \\ -1 & -3 & 2 & 0 \end{array}\right]. \end{equation*}
Which row operation is the best choice for the next move in converting to RREF?
  1. Add row 1 to row 3 (\(R_3+R_1 \rightarrow R_3\))
  2. Add -2 row 1 to row 2 (\(R_2-2R_1 \rightarrow R_2\))
  3. Add 2 row 2 to row 3 (\(R_3+2R_2 \rightarrow R_3\))
  4. Add 2 row 3 to row 2 (\(R_2+2R_3 \rightarrow R_2\))

Activity 1.2.12.

Consider the matrix
\begin{equation*} \left[\begin{array}{cccc}\markedPivot{1} & 3 & -1 & 2 \\ 0 & 0 & 1 & 2 \\ 0 & 0 & 1 & 2 \end{array}\right]. \end{equation*}
Which row operation is the best choice for the next move in converting to RREF?
  1. Add row 1 to row 2 (\(R_2+R_1 \rightarrow R_2\))
  2. Add -1 row 3 to row 2 (\(R_2-R_3 \rightarrow R_2\))
  3. Add -1 row 2 to row 3 (\(R_3-R_2 \rightarrow R_3\))
  4. Add row 2 to row 1 (\(R_1+R_2 \rightarrow R_1\))

Activity 1.2.13.

Consider the matrix
\begin{equation*} \left[\begin{array}{ccc}2 & 1 & 0 \\ 1 & 0 & 0 \\ 3 & -1 & 1 \end{array}\right]. \end{equation*}
(a)
Perform three row operations to produce a matrix closer to RREF.
(b)
Finish putting it in RREF.

Activity 1.2.14.

Consider the matrix
\begin{equation*} A=\left[\begin{array}{cccc}2 & 3 & 2 & 3 \\ -2 & 1 & 6 & 1 \\ -1 & -3 & -4 & 1 \end{array}\right]. \end{equation*}
Compute \(\RREF(A)\text{.}\)

Activity 1.2.15.

Consider the matrix
\begin{equation*} A=\left[\begin{array}{cccc} 2 & 4 & 2 & -4 \\ -2 & -4 & 1 & 1 \\ 3 & 6 & -1 & -4 \end{array}\right]. \end{equation*}
Compute \(\RREF(A)\text{.}\)

Activity 1.2.16.

Consider the matrix
\begin{equation*} B=\left[\begin{array}{ccc|c} 2 & 4 & 2 & -4 \\ -2 & -4 & 1 & 1 \\ 3 & 6 & -1 & -4 \end{array}\right]. \end{equation*}
which has the same terms as \(A\) from the previous activity.
Can \(\RREF(A)\) be used to find \(\RREF(B)\text{?}\)
  1. No, a new calculuation is required.
  2. Yes, \(\RREF(A)\) and \(\RREF(B)\) are exactly the same.
  3. Yes, \(\RREF(A)\) may be slightly modified to find \(\RREF(B)\text{.}\)

Activity 1.2.17.

Free browser-based technologies for mathematical computation are available online.
  • In the dropdown on the right, you can select a number of different languages. Select "Octave" for the Matlab-compatible syntax used by this text.
  • Type rref([1,3,2;2,5,7]) and then press the Evaluate button to compute the \(\RREF\) of \(\left[\begin{array}{ccc} 1 & 3 & 2 \\ 2 & 5 & 7 \end{array}\right]\text{.}\)

Activity 1.2.18.

In the HTML version of this text, code cells are often embedded for your convenience when RREFs need to be computed.
Try this out to compute \(\RREF\left[\begin{array}{cc|c} 2 & 3 & 1 \\ 3 & 0 & 6 \end{array}\right]\text{.}\)

Subsection 1.2.2 Videos

Figure 2. Video: Row reduction

Subsection 1.2.3 Slideshow

Exercises 1.2.4 Exercises

Subsection 1.2.5 Mathematical Writing Explorations

Exploration 1.2.19.

Prove that Gauss-Jordan Elimination preserves the solution set of a system of linear equations in \(n\) variables. Make sure your proof includes each of the following. Just because I’ve used bullet points here does not mean you should use bullet points in your proof.
  • Write an arbitrary system of linear equations in \(n\) variables. Your notation should be unambiguous.
  • Label an element of your solution set. You won’t know what it is exactly, so you’ll have to use a variable. Remember what it means (by definition!) to be in the solution set.
  • Describe the three operations used in Gauss-Jordan Elimination.
  • Consider all three operations in Gauss-Jordan Elimination. After each one is used, show that the element of the solution set you picked still satisfies the definition.

Exploration 1.2.20.

Let \(M_{2,2}\) indicate the set of all \(2 \times 2\) matrices with real entries. Show that equivalence of matrices as defined in this section is an equivalence relation, as in exploration Exploration 1.1.17

Subsection 1.2.6 Sample Problem and Solution

Sample problem Example B.1.2.