Skip to main content

Discovery guide 39.1 Discovery guide

Recall.

The standard inner product on \(\R^n\) (i.e. the dot product) can be calculated as a matrix product of column vectors:

\begin{equation*} \uvecinprod{u}{v} = \utrans{\uvec{v}} \uvec{u} \text{.} \end{equation*}

Similarly, the standard inner product on \(\C^n\) (i.e. the complex dot product) can be calculated as a matrix product of column vectors:

\begin{equation*} \uvecinprod{u}{v} = \adjoint{\uvec{v}} \uvec{u} \text{,} \end{equation*}

where \(\adjoint{\uvec{v}}\) means conjugate-transpose.

Notation.

In this discovery guide we will write

\begin{align*} \amp {\inprod{\blank}{\blank}}_{\R} \text{,} \amp \amp {\inprod{\blank}{\blank}}_{\C} \end{align*}

to distinguish between the real and complex dot products, respectively.

Discovery 39.1.
(a)

Fill in the blank with a matrix so that the formula below is valid for all vectors \(\uvec{u},\uvec{v}\) in \(\R^n\text{,}\) and would be true no matter what real \(n\times n\) matrix \(A\) is used:

\begin{equation*} {\inprod{\uvec{u}}{A \uvec{v}}}_{\R} = {\inprod{\underline{\hspace{0.909090909090909em}} \uvec{u}}{\uvec{v}}}_{\R} \text{.} \end{equation*}

Similarly, what matrix fills in the blank in the formula

\begin{equation*} {\inprod{A \uvec{u}}{\uvec{v}}}_{\R} = {\inprod{\uvec{u}}{\underline{\hspace{0.909090909090909em}} \uvec{v}}}_{\R} \text{?} \end{equation*}
(b)

Based on your answer to Task a, what property would a real matrix \(B\) need to possess in order for the formula

\begin{equation*} {\inprod{B \uvec{u}}{\uvec{v}}}_{\R} = {\inprod{\uvec{u}}{B \uvec{v}}}_{\R} \end{equation*}

to be true for all real vectors \(\uvec{u},\uvec{v}\text{?}\)

(c)

Again, using your answer to Task a as a guide, what property would a real matrix \(C\) need to possess in order for the formula

\begin{gather} {\inprod{C \uvec{u}}{C \uvec{v}}}_{\R} = {\inprod{\uvec{u}}{\uvec{v}}}_{\R}\label{equation-matrix-adjoints-discovery-first-principles-orthogonal}\tag{\(\star\)} \end{gather}

to be true for all real vectors \(\uvec{u},\uvec{v}\text{?}\)

Hint

First apply the pattern you found Task a to the left-hand side of (\(\star\)). Then perhaps insert an identity matrix into the right-hand side, and re-evaluate the new equality in light of the pattern of Task a.

Alternatively, you could turn both sides of (\(\star\)) into the matrix-multiplication version of the dot product, and investigate what happens when you take both of \(\uvec{u},\uvec{v}\) to be standard basis vectors.

(d)

Fill in the blank with a matrix so that the formula below is valid for all vectors \(\uvec{u},\uvec{v}\) in \(\C^n\text{,}\) and would be true no matter what complex \(n\times n\) matrix \(A\) is used:

\begin{equation*} {\inprod{\uvec{u}}{A \uvec{v}}}_{\C} = {\inprod{\underline{\hspace{0.909090909090909em}} \uvec{u}}{\uvec{v}}}_{\C} \text{.} \end{equation*}

Similarly, what matrix fills in the blank in the formula

\begin{equation*} {\inprod{A \uvec{u}}{\uvec{v}}}_{\C} = {\inprod{\uvec{u}}{\underline{\hspace{0.909090909090909em}} \uvec{v}}}_{\C} \text{?} \end{equation*}
(e)

Based on your answer to Task d, what property would a complex matrix \(B\) need to possess in order for the formula

\begin{equation*} {\inprod{B \uvec{u}}{\uvec{v}}}_{\C} = {\inprod{\uvec{u}}{B \uvec{v}}}_{\C} \end{equation*}

to be true for all complex vectors \(\uvec{u},\uvec{v}\text{?}\)

(f)

Again, using your answer to Task d as a guide, what property would a complex matrix \(C\) need to possess in order for the formula

\begin{equation*} {\inprod{C \uvec{u}}{C \uvec{v}}}_{\C} = {\inprod{\uvec{u}}{\uvec{v}}}_{\C} \end{equation*}

to be true for all complex vectors \(\uvec{u},\uvec{v}\text{?}\)

Hint

Employ the same strategy as for Task c. Or you probably could just infer the new complex pattern from the real pattern discovered in Task c.

While we already have names for some of these things, they are examples of more abstract concepts, so we will use new terminology consistent with the abstract context.

(real) adjoint matrix

the matrix that filled in the blank in Discovery 39.1.a

(complex) adjoint matrix

the matrix that filled in the blank in Discovery 39.1.d

self-adjoint matrix

a real matrix that satisfies the condition identified in Discovery 39.1.b (also referred to as symmetric), or a complex matrix that satisfies the condition identified in Discovery 39.1.e (also referred to as Hermitian)

orthogonal matrix

a real matrix that satisfies the condition identified in Discovery 39.1.c

unitary matrix

a complex matrix that satisfies the condition identified in Discovery 39.1.f

Discovery 39.2.

What is the adjoint of the adjoint of a matrix \(A\text{?}\)

Verify your conjecture against the inner product-based version of what adjoint means using the patterns of Discovery 39.1.a (real case) and Discovery 39.1.d (complex case).

Discovery 39.3. Orthogonal matrices: initial properties.
(b)

What can you say about the columns of an orthogonal matrix?

Hint

A row times a column is the pattern of a dot product.

Our motivation for studying inner products was to connect algebra with geometry. Discovery 39.3.b suggests a strong connection between an orthogonal matrix and the geometry of \(\R^n\text{.}\) Let's explore that more through the inner product rather than through inspection of the matrix.

Discovery 39.4. Orthogonal matrices: geometry.

A real matrix \(A\) is orthogonal if it satisfies

\begin{gather} {\inprod{A \uvec{u}}{A \uvec{v}}}_{\R} = {\inprod{\uvec{u}}{\uvec{v}}}_{\R}\label{equation-matrix-adjoints-discovery-orthog-by-inner-prod}\tag{\(\star\star\)} \end{gather}

for every pair of vectors \(\uvec{u},\uvec{v}\) in \(\R^n\text{.}\)

(b)

What if we apply rule (\(\star\star\)) with both \(\uvec{u},\uvec{v}\) to be the same vector \(\uvec{x}\text{?}\) What does

\begin{equation*} {\inprod{A \uvec{x}}{A \uvec{x}}}_{\R} = {\inprod{\uvec{x}}{\uvec{x}}}_{\R} \end{equation*}

say about about the geometry of how multiplication by \(A\) transforms vectors in \(\R^n\text{?}\)

Summarize the pattern: Orthogonal \(A\) preserves .

(c)

If we apply the previous pattern to the norm \(\norm{A \uvec{u} - A \uvec{v}}\text{,}\) we can also say:

Orthogonal \(A\) preserves .

(d)

Compare the angle between \(\uvec{u},\uvec{v}\) with the angle between \(A \uvec{u}, A \uvec{v}\text{:}\)

\begin{align*} \cos \theta_1 \amp = \frac{\uvecinprod{u}{v}}{\unorm{u} \unorm{v}} \text{,} \amp \cos \theta_2 \amp = \frac{\inprod{A \uvec{u}}{A \uvec{v}}}{\norm{A \uvec{u}} \norm{A \uvec{v}}}\text{.} \end{align*}

Combine two of the previous patterns into a new one:

Orthogonal \(A\) preserves .

(e)

What about when \(\theta = \pi/2\) ?

Orthogonal \(A\) preserves .

Discovery 39.5. Unitary matrices.
(b)

Which of the conclusions of Discovery 39.4 are the same for unitary complex matrices as for orthogonal real matrices? Which parts need to be updated, and how?

Discovery 39.6.

Suppose that \(A\) is an \(n \times n\) complex matrix and that \(W\) is an \(A\)-invariant subspace of \(\C^n\text{.}\) Verify that the orthogonal complement \(W^\perp\) is \(\adjoint{A}\)-invariant: assume \(\uvec{x}\) is orthogonal to every vector in \(W\) and verify that \(\adjoint{A} \uvec{x}\) is as well.

Discovery 39.7.

Suppose \(V\) is a finite-dimensional complex inner product space, \(\basisfont{B} = \{ \uvec{v}_1, \uvec{v}_2, \dotsc, \uvec{v}_n \}\) is an orthonormal basis for \(V\text{,}\) and \(\basisfont{B'} = \{ \uvec{v}_1', \uvec{v}_2', \dotsc, \uvec{v}_n' \}\) is some other basis of \(V\text{.}\)

(a)

What is the \((i,j)\) entry of the transition matrix \(\ucobmtrx{B'}{B}\text{?}\)

Hint

Columns of a transition matrix are coordinate vectors of “old” basis vectors relative to the “new” basis. Here the “new” basis \(\basisfont{B}\) is orthonormal, so the Expansion theorem might help.

(b)

Use Task a to verify that if \(\basisfont{B'}\) is also orthonormal, then \(\ucobmtrx{B'}{B}\) is a unitary matrix.

Hint

What does the pattern of Task a say is the relationship between the entries of \(\ucobmtrx{B'}{B}\) and \(\ucobmtrx{B}{B'}\text{?}\)

Also, recall that \(\uinvcobmtrx{B'}{B} = \ucobmtrx{B}{B'}\text{.}\)

(c)

Explain how every unitary matrix can somehow be considered as a transition matrix between orthonormal bases of \(\C^n\text{.}\)