I don't think it's so much that $5$ is special but that $2,3$ and $4$ are exceptional. For an irreducible polynomial $p(x) \in \mathbb Q[x]$ there's a general expression for the roots of $p(x)$ in terms of radicals if and only if $\deg p(x) <5$. Now what exactly makes $2,3$ and $4$ different from every other numbers? Well we need some Galois theory and some group theory. To an irreducible polynomial you can associate a group $G$ called it's Galois Group. As it turns out a polynomial is solvable by radicals if and only if its Galois group is solvable. Now because of some elementary group actions arguments it turns out that a $G$ is a subgroup of $S_{\deg p(x)}$ that is the symmetric group on $\deg p(x)$ elements. So the exceptional part is that $S_n$ is only solvable when $n<5$.
That there are polynomials with Galois group $S_n$ is also a somewhat non-trivial fact. Essentially at low degrees nothing can go wrong with solvability, but at higher degrees everything falls apart.