I would prefer to work with a prime symbol that is less rotated. I tried the following
\usepackage[figuresright]{rotating}
\newcommand*{\p}{\turnbox{12}{$\,'$}\;}
which is visually what I desire. If I now write something like
$a+b\p$
things work fine, but when I use \p in subscript contexts
$a_{c\p,d}+b\p$
the symbol is not scaled and not placed right. Of course one can always work with hacks such as
$a_c\turnbox{12}{${}_{'}$}_{,d}+b\p$
but perhaps anyone knows of a simple solution?

textcomppackage provides\text{\textquotesingle}. – Chel Mar 12 '12 at 23:24