I understand why we add or subtract from $f(x)$ to move the graph vertically. To move it up, we move all the values up by adding whatever constant value we want.
However, when it comes to horizontal shifting, we do the opposite, why is it so? Obviously I can understand how to do so (by plotting the values or using a graphing calculator, simple!). But what is the logic behind it. What if I forget how to use the other two methods and have to literally shift instead of plotting individual values of $(x, f(x))$?