Here is part of an incomplete proof that I made. First let me establish that, $p_n(x) = \sum_{k=0}^{n}=\frac{x^k}{k!}$ for $n = 1, 2, 3 \ldots$
Lemma 1: $p_2(x)$ is always greater than $0$.
Proof:
$p_2'(x) = 1 + x$ meaning $p_2$'s one and only stationary point occurs at $x = -1$. $p_2(-1) = \frac{1}{2}$. But $p_2''(x)=1$, meaning that this stationary point is a global minimum. Therefore $p_2(x) \geq \frac{1}{2}\ \forall\ x \in \mathbb{R}$. Lemma proven
Lemma 2:
$p_3(x) = 1 + x + \frac{x^2}{2!}+ \frac{x^3}{3!}$ has exactly one root.
Proof:
$p_3'(x) = 1 + x + \frac{x^2}{2!} = p_2(x)$
Therefore $p_3$ is monotonically increasing. It is also differentiable and continuous across $\mathbb{R}$. $p_3(-2)=-\frac{1}{3}$ and $p_3(-1)=\frac{1}{3}$. And so by the intermediate value theorem, there exists a zero for $p_3$ between $-2$ and $-1$. This must be the only zero, since $p_3$ is monotonically increasing. Lemma proven.
Original Proof:
$p_4'(x) = p_3(x)$ and $p_4''(x)=p_2(x)$. And so it is known that there is exactly one stationary point because of Lemma 1 and that this stationary point must be a global minimum from the Lemma 2.
This global minimum will occur at $p_3(x) = 0$, which is beteween $-2$ and $-1$ as shown in Lemma 2. Incomplete. All that's needed is to show that the minimum in this interval is greater than 0.
Let $x=-a$ with $a\in]0,1[$. Then we have $1+x > 0$. Furthermore, we have $\frac{x^2}{2!} + \frac{x^3}{3!} > \frac{x^2}{3!} + \frac{x^3}{3!} = \frac{a^2 - a^3}{3!} > \frac{a^2 - a^2}{3!} =0$. Trivially, $\frac{x^4}{4!}>0$ and so the whole sum $p_4(x)>0$.
Notice also that $p_4(-1) = \frac{1}{2} - \frac{1}{6} + \frac{1}{24} > 0$. I leave the final case, of $x=-a$ with $a\in]1,\infty[$ to you.
– Jürgen Sukumaran Jan 17 '22 at 00:49