So we want to find a $\delta>0$ such that for all $2-\delta<x<2+\delta$ , we will have $4-\epsilon<x^{2}<4+\epsilon$ for all $\epsilon>0$ . If we can find a way to express $\delta$ as a function $\delta (\epsilon)$, $\delta:\mathbb{R}_+ \to \mathbb{R}_+ $ then we will have solved the problem. But I can't see how to relate $\epsilon$ to $\delta$ in this case.
My initial reaction is write $(2-\delta)^2<x^2<(2+\delta)^2$, this makes the two inequalities look related, but I am not sure where to go from here.