I'm able to typeset a ~50 page set of lecture notes with heavy math using
\usepackage{libertine}
\usepackage[libertine]{newtxmath}
with both PDFLaTeX and XeLaTeX. I know that the libertine package automatically loads and uses fontspec if used with XeTeX. However, someone here mentioned that it's not a good idea to use Type1 and OpenType fonts together. So, what could go wrong?