I wanted to show the above ($\mathbf{X}$ is nonsingular btw), but I don't think my current proof is complete/quite right, wondering if this is ok:
Let $\mathbf{M} = \mathbf{XYX}^{-1}$. Given that we can represent a matrix $\mathbf{M}$ this way, then we know $\mathbf{M}$ is diagonalizable. Notice that $\mathbf{M}$ and $\mathbf{Y}$ are similar matrices. So, $\mathbf{Y}$ is a diagonal matrix, that shows the eigenvalues of $\mathbf{M}$ on its diagonal.
Taking $\mathbf{Y}$ on its own, we know that one of the properties of a diagonal matrix is that its eigenvalues are on the diagonal. Since $\mathbf{Y}$ is a diagonal matrix, its eigenvalues are on its diagonal. $$ \therefore \sigma(\mathbf{M}) = \sigma(\mathbf{XYX}^{-1}) = \sigma(\mathbf{Y}) $$
(Note: I realize $\mathbf{Y}$ is not always diagonal, how would I circumvent this?)