search
Search
Login
Unlock 100+ guides
menu
menu
web
search toc
close
Comments
Log in or sign up
Cancel
Post
account_circle
Profile
exit_to_app
Sign out
What does this mean?
Why is this true?
Give me some examples!
search
keyboard_voice
close
Searching Tips
Search for a recipe:
"Creating a table in MySQL"
Search for an API documentation: "@append"
Search for code: "!dataframe"
Apply a tag filter: "#python"
Useful Shortcuts
/ to open search panel
Esc to close search panel
to navigate between search results
d to clear all current filters
Enter to expand content preview
icon_star
Doc Search
icon_star
Code Search Beta
SORRY NOTHING FOUND!
mic
Start speaking...
Voice search is only supported in Safari and Chrome.
Navigate to
check_circle
Mark as learned
thumb_up
0
thumb_down
0
chat_bubble_outline
0
Comment
auto_stories Bi-column layout
settings

Symmetric matrices and their basic properties

schedule Aug 11, 2023
Last updated
local_offer
Linear Algebra
Tags
mode_heat
Master the mathematics behind data science with 100+ top-tier guides
Start your free 7-days trial now!
Definition.

Symmetric matrix

Matrix $\boldsymbol{A}$ is called symmetric if and only if $\boldsymbol{A}^T=\boldsymbol{A}$. This means that a matrix is symmetric if the matrix remains unchanged after flipping the rows and columns.

Example.

Symmetric matrices

The following are examples of symmetric matrices:

$$\begin{pmatrix}1&3\\3&2\end{pmatrix} ,\;\;\;\;\;\;\; \begin{pmatrix} 1&2&3\\2&5&6\\3&6&9 \end{pmatrix},\;\;\;\;\;\;\; \begin{pmatrix} 2&0&0\\0&3&0\\0&0&0 \end{pmatrix}$$
Theorem.

Symmetric matrices are square

If $\boldsymbol{A}$ is a symmetric matrix, then $\boldsymbol{A}$ is square.

Proof. Let $\boldsymbol{A}$ be an $m\times{n}$ matrix, which means that the shape of $\boldsymbol{A}^T$ is $n\times{m}$. By definition, if matrix $\boldsymbol{A}$ is symmetric, then $\boldsymbol{A}^T=\boldsymbol{A}$. For this equality to hold, the shapes of $\boldsymbol{A}^T$ and $\boldsymbol{A}$ must match, that is, $m=n$. This completes the proof.

Theorem.

Sum of two symmetric matrices is symmetric

If $\boldsymbol{A}$ and $\boldsymbol{B}$ are symmetric matrices, then $\boldsymbol{A}+\boldsymbol{B}$ is also symmetric.

Proof. Let $\boldsymbol{A}$ and $\boldsymbol{B}$ be symmetric matrices. To show that $\boldsymbol{A}+\boldsymbol{B}$ is symmetric, we must show that the following holds:

$$(\boldsymbol{A}+\boldsymbol{B})^T =\boldsymbol{A}+\boldsymbol{B} $$

By the propertylink of transpose, we have that:

$$\begin{align*} (\boldsymbol{A}+\boldsymbol{B})^T &=\boldsymbol{A}^T+\boldsymbol{B}^T \end{align*}$$

Because $\boldsymbol{A}$ and $\boldsymbol{B}$ are symmetric, $\boldsymbol{A}^T=\boldsymbol{A}$ and $\boldsymbol{B}^T=\boldsymbol{B}$. Therefore, we end up with:

$$\begin{align*} (\boldsymbol{A}+\boldsymbol{B})^T &=\boldsymbol{A}+\boldsymbol{B} \end{align*}$$

This completes the proof.

Theorem.

Scalar multiples of a symmetric matrix is also symmetric

If $\boldsymbol{A}$ is a symmetric matrix, then $k\boldsymbol{A}$ is also symmetric for any scalar $k$.

Proof. Let $\boldsymbol{A}$ be a symmetric matrix and $k$ be any scalar. By the propertylink of matrices, we have that:

$$\begin{align*} (k\boldsymbol{A})^T&= k\boldsymbol{A}^T\\ &=k\boldsymbol{A}\\ \end{align*}$$

By definition of symmetric matrices, $k\boldsymbol{A}$ is symmetric. This completes the proof.

Theorem.

If A and B are symmetric, then AB+BA is symmetric

If $\boldsymbol{A}$ and $\boldsymbol{B}$ are symmetric matrices, then $\boldsymbol{AB}+\boldsymbol{BA}$ is a symmetric matrix.

Proof. The transpose of $\boldsymbol{AB}+\boldsymbol{BA}$ is:

$$\begin{align*} (\boldsymbol{AB}+\boldsymbol{BA})^T &=(\boldsymbol{AB})^T+(\boldsymbol{BA})^T\\ &=\boldsymbol{B}^T\boldsymbol{A}^T+ \boldsymbol{A}^T\boldsymbol{B}^T\\ &=\boldsymbol{B}\boldsymbol{A}+ \boldsymbol{A}\boldsymbol{B}\\ &=\boldsymbol{A}\boldsymbol{B}+ \boldsymbol{B}\boldsymbol{A} \end{align*}$$

Here:

By definition of symmetric matrices, we conclude that $\boldsymbol{AB}+\boldsymbol{BA}$ is symmetric. This completes the proof.

Theorem.

Powers of symmetric matrices is also symmetric

If $\boldsymbol{A}$ is a symmetric matrix, then $\boldsymbol{A}^n$ is symmetric where $n$ is any positive integer.

Proof. The transpose of $\boldsymbol{A}^n$ is:

$$\begin{align*} (\boldsymbol{A}^n)^T &=(\boldsymbol{A}\boldsymbol{A}\cdots\boldsymbol{A})^T\\ &=\boldsymbol{A}^T\boldsymbol{A}^T\cdots\boldsymbol{A}^T\\ &=\boldsymbol{A}\boldsymbol{A}\cdots\boldsymbol{A}\\ &=\boldsymbol{A}^n \end{align*}$$

Here, we used theoremlink for the second equality. $\boldsymbol{A}^n$ is thus symmetric by definition. This completes the proof.

Theorem.

Symmetric matrix is invertible if and only if its inverse is symmetric

Let $\boldsymbol{A}$ be a symmetric matrix. $\boldsymbol{A}$ is invertible if and only if $\boldsymbol{A}^{-1}$ is symmetric.

Proof. By propertylink of invertible matrices:

$$\begin{align*} (\boldsymbol{A}^{-1})^{T}&= (\boldsymbol{A}^{T})^{-1}\\ &= \boldsymbol{A}^{-1} \end{align*}$$

By definition, $\boldsymbol{A}^{-1}$ is therefore symmetric. The backward proposition also holds because every step is based on equality. This completes the proof.

Theorem.

Product of symmetric matrices is commutative if and only if the product is symmetric

Let $\boldsymbol{A}$ and $\boldsymbol{B}$ be two symmetric matrices. $\boldsymbol{AB}=\boldsymbol{BA}$ if and only if $\boldsymbol{AB}$ is symmetric.

Proof. We will first prove the forward proposition. Assume $\boldsymbol{AB}=\boldsymbol{BA}$. The transpose of $\boldsymbol{AB}$ is:

$$\begin{align*} (\boldsymbol{AB})^T&= \boldsymbol{B}^T\boldsymbol{A}^T\\ &=\boldsymbol{B}\boldsymbol{A}\\ &=\boldsymbol{A}\boldsymbol{B} \end{align*}$$

By definition, $\boldsymbol{AB}$ is therefore symmetric.

Next we will prove the converse. Assume $\boldsymbol{AB}$ is symmetric. $\boldsymbol{AB}$ is:

$$\begin{align*} \boldsymbol{BA} &=\boldsymbol{B}^T\boldsymbol{A}^T\\ &=(\boldsymbol{A}\boldsymbol{B})^T\\ &=\boldsymbol{A}\boldsymbol{B} \end{align*}$$

This completes the proof.

Theorem.

Symmetric matrices and dot products

An $n\times{n}$ matrix $\boldsymbol{A}$ is symmetric if and only if the following is true:

$$(\boldsymbol{Ax})\cdot \boldsymbol{y}= \boldsymbol{x}\cdot(\boldsymbol{Ay})$$

Where $\boldsymbol{x}$ and $\boldsymbol{y}$ are any vectors in $\mathbb{R}^n$.

Proof. We prove the forward proposition first. Suppose $\boldsymbol{A}$ is an $n\times{n}$ symmetric matrix. For any vectors $\boldsymbol{x},\boldsymbol{y}\in\mathbb{R}^n$, we have that:

$$\begin{align*} (\boldsymbol{Ax})\cdot{\boldsymbol{y}} &=(\boldsymbol{Ax})^T{\boldsymbol{y}}\\ &=\boldsymbol{x}^T\boldsymbol{A}^T{\boldsymbol{y}}\\ &=\boldsymbol{x}^T\boldsymbol{A}{\boldsymbol{y}}\\ &=\boldsymbol{x}\cdot(\boldsymbol{A}{\boldsymbol{y}})\\ \end{align*}$$

Note that the final step follows by theoremlink.

Now, let's prove the converse:

$$\begin{align*} (\boldsymbol{Ax})\cdot \boldsymbol{y}&= \boldsymbol{x}\cdot(\boldsymbol{Ay})\\ \boldsymbol{y}^T\boldsymbol{Ax} &=(\boldsymbol{Ay})^T\boldsymbol{x}\\ \boldsymbol{y}^T\boldsymbol{Ax}&= \boldsymbol{y}^T\boldsymbol{A}^T\boldsymbol{x}\\ \boldsymbol{y}^T\boldsymbol{Ax}- \boldsymbol{y}^T\boldsymbol{A}^T\boldsymbol{x}&=\boldsymbol{0}\\ \boldsymbol{y}^T(\boldsymbol{A}-\boldsymbol{A}^T)\boldsymbol{x}&=\boldsymbol{0} \end{align*}$$

Therefore $\boldsymbol{A}=\boldsymbol{A}^T$, which means $\boldsymbol{A}$ is symmetric. This completes the proof.

Theorem.

Product of a matrix and its transpose is symmetric

If $\boldsymbol{A}$ is an $m\times{n}$ matrix, then $\boldsymbol{A}^T\boldsymbol{A}$ and $\boldsymbol{AA}^T$ are symmetric.

Proof. If $\boldsymbol{A}$ is an $m\times{n}$ matrix, then the shape of $\boldsymbol{A}^T$ is $n\times{m}$. Therefore, the shape of $\boldsymbol{A}^T\boldsymbol{A}$ is $m\times{m}$, which means $\boldsymbol{A}^T\boldsymbol{A}$ is square. Next, $\boldsymbol{A}^T\boldsymbol{A}$ can be written as:

$$\begin{align*} (\boldsymbol{A}^T\boldsymbol{A})^T&= \boldsymbol{A}^T(\boldsymbol{A}^T)^T\\ &=\boldsymbol{A}^T\boldsymbol{A} \end{align*}$$

Here, the first equality holds by propertylink of transpose. Since the transpose of $\boldsymbol{A}^T\boldsymbol{A}$ is itself, $\boldsymbol{A}^T\boldsymbol{A}$ is symmetric by definitionlink. Similarly, we can easily show that $\boldsymbol{AA}^T$ is symmetric:

$$\begin{align*} (\boldsymbol{A}\boldsymbol{A}^T)^T&= (\boldsymbol{A}^T)^T\boldsymbol{A}^T\\ &=\boldsymbol{A}\boldsymbol{A}^T \end{align*}$$

By definitionlink, $\boldsymbol{AA}^T$ is symmetric. This completes the proof.

robocat
Published by Isshin Inada
Edited by 0 others
Did you find this page useful?
thumb_up
thumb_down
Comment
Citation
Ask a question or leave a feedback...