EPS was designed to import postscript code, which did not include fonts. The necessary fonts had to either be installed on the output device or downloaded with the job. PDF was created to allow pages to stand alone, including embedding fonts. So, when using EPS in publishing, standard practice was to convert any type to outlines when saving (say from Illustrator) to ensure fidelity in the final output. With PDF, you could choose to save the type without having to convert it to outlines by embedding the font. It was a great step forward.
So, as barbara beeton said, the likely culprit is that your EPS is using a typeface which is being substituted in the output process by another one with a different glyph in the bullet slot. You have two solutions. If you created the EPS, then convert the type to outlines/paths before saving, or save as PDF with embedded fonts. If you don't have the original source, try converting to PDF, but it may not work as expected if you don't have the appropriate type faces installed.
latexorpdflatex? – Sigur Nov 21 '14 at 17:39mathptmxfor your document? – egreg Nov 21 '14 at 17:41latex+dvips+ps2pdforpdflatex? – egreg Nov 21 '14 at 17:47epsfile available for download from somewhere and add a link here). – Ian Thompson May 15 '16 at 13:07