You can use a decoration, like in the answers pointed by Claudio Fiandrino, and this can be specially useful if you have several arrows like this in your drawing.
A different approach, which can be useful for single particular cases, could be the following:
\usetikzlibrary{calc}
\begin{tikzpicture}
\node[] (1) at (0,0) {1};
\node[] (2) at (1,1) {2}
edge (1);
\draw[->] ($(1)!0.3!(2)!1mm!90:(2)$) -- ($(1)!0.7!(2)!1mm!90:(2)$)
node[midway,sloped,above] {\tiny label};
\end{tikzpicture}

The syntax used for this is called "interpolated coordinates". In the above code you can tweak the amounts 0.3 and 0.7 (which are the fraction of the segment length at which the arrow will start and end) and 1mm (which is the distance between the parallel arrow and the main segment). You can also replace 90 by -90 if you want the parallel arrow below the original segment (and in this case, of course, you should use below option for the label).
\tikzsetis the recommended way to define styles while\tikzstyleis deprecated, as per Should \tikzset or \tikzstyle be used to define TikZ styles?. – Claudio Fiandrino Apr 01 '13 at 12:33