It immediately follows from SVD that for $A$ symmetric, $A^2$ is orthonormally diagonalisable. We need to show that we can find an orthonormal basis consisting of eigenvectors of $A$.
For this, let $v$ be an eigenvector of $A^2$ and $w:=Av$. If $w$ is a multiple of $v$, then we can add $v$ into the collection and continue in $v^\perp$ (which is $A$-invariant). Otherwise we have that $Av=w$, $Aw=\lambda v$. This means that $A$ sends $\sqrt{\lambda} v\pm w$ to the $\pm\sqrt{\lambda}$-multiple of itself. These are eigenvectors of $A$ and, moreover, they are orthogonal to each other due to
$$
\langle \sqrt\lambda v + w, \sqrt{\lambda} v - w\rangle
=\lambda \langle v,v\rangle - \langle w,w\rangle
=\lambda \langle v,v\rangle - \langle Av, Av\rangle
=\lambda \langle v,v\rangle - \langle A^2v, v\rangle=0.
$$
Again, you can continue inductively in $v^\perp\cap w^\perp$.
This looks very awkward indeed. Usually you do it the other way around, first prove the spectral theorem and then SVD.