Consider the function $f(x) = \mathrm{e}^{-1/x^2}$ on the reals. Although not defined at zero, it clearly has a limit at zero and that limit is zero. Now look at its derivatives: $$f'(x) = \frac{2}{x^3} f(x)$$ $$f''(x) = \frac{4-6x^2}{x^6} f(x)$$ $$f'''(x) = \frac{8-36x^2+24x^4}{x^9} f(x)$$ and so on, with the exponential overwhelming the rational function as we take limits at zero. We find, in fact, that this limiting process gives us zeroes for every derivative at zero.
Is this the zero function? No. Therefore, its power series expansion is not faithful at zero.
Why? Take a step back and look at the complex plane and notice the essential singularities pressed up against the real line at zero and discover that I "cheated" by taking limits at zero. In the reals, the limits exist, but in the complexes they do not. In short, the real line can be blind to essential features of functions. (Especially if the person posing functions to investigate is aware of this deficiency.) However, having looked at a neighborhood in the complexes, there is nothing left to know since there is nowhere for a feature to hide.


(I spent some time trying to clean up what amounts to random moire pattern in the center of the argument plot. The best I could manage follows, but is misleading about the violent flailing of the complex angle near the origin.)

(What we should really be seeing is infinitely many thinner and thinner strips as we get closer to the origin. Of course, the strips are already one pixel wide in the given image -- if we attempt to thin them further, all we render is a continuous blob of contour lines.)