You could place your image in the margin, this ensures that it does not influence the layout of the main text.
To do this you could use \marginpar{....} or as @Skillmon suggested in the comments \marginnote{} from the package of the same name for better placement.
Unrelated to the problem, but you should not use $$...$$, see Why is \[ ... \] preferable to $$ ... $$? for further information.
\documentclass{article}
\usepackage{graphicx}
\usepackage{marginnote}
\reversemarginpar
\begin{document}
Hello world
[
x^2+1
]
\marginnote{\includegraphics[width=1cm]{example-image-duck}}
Hello world
\end{document}

Since @samcarter allowed me to, here are some edits I'd use:
I'd put the macro into a \begingroup-\endgroup pair and keep the \reversemarginpar into that group, so that we don't affect other macros using it.
I'd put the \includegraphics into an \rlap so that it doesn't matter how wide the image is.
I'd change the alignment of \marginnote put into the left margin locally.
Put into code:
\newcommand\mymark[2][]
{%
\begingroup
\reversemarginpar
\renewcommand*\raggedleftmarginnote{\raggedright}%
\marginnote{\rlap{\includegraphics[#1]{#2}}}%
\endgroup
}
Now you can use \mymark as you'd do with \includegraphics but putting the image into the margin.
Note: Don't forget to place it inside equations, if you want proper alignment:
\[ \mymark x^2 +1 \]
works, whereas
\mymark \[x^2 +1 \]
would produce a misalignment.
\marginpar{}? – samcarter_is_at_topanswers.xyz Oct 19 '18 at 09:21$$– samcarter_is_at_topanswers.xyz Oct 19 '18 at 09:21\marginnote(better placement). – Skillmon Oct 19 '18 at 09:22\margin" :) – samcarter_is_at_topanswers.xyz Oct 19 '18 at 09:23\mark. Perhaps use\newcommand\mymark{...}instead. – Skillmon Oct 19 '18 at 09:28tabtopackage:\tabto*{-1cm}X\tabto{\TabPrevPos}– Steven B. Segletes Oct 19 '18 at 09:48\rlap{\includegraphics{path}}, which will lap the image to the right. – Martin Scharrer Oct 22 '18 at 05:16