(Minor update, April 2022: loading the textcomp package to access the glyph generated by \textquotesingle is not necessary if the vintage of your TeX distribution is more recent than 2019.)
You write
I ... just [want to] get the occasional straight quote.
The typographically correct marks for "feet" and "inches" are not (single or double, resp.) straight quote marks, but angled quote marks. These may be produced in "normal LaTeX" via $'$ and $''$, resp.
Addendum, prompted by the OP's comment that interest lies only in "straight" (vertical) quotes. In addition to the "single-quote" command \textquotesingle (requires loading the textcomp package -- if the vintage of your TeX distribution is older than 2020), there's also the \textquotedbl macro, which is available as long as a font encoding other than the original TeX font encoding (aka OT1) is used.
Here, then, is a quick MWE. Note that the text font is TNR (Times New Roman). If your publisher wants to use a font encoding other than T1 -- which is what I use in the MWE -- that's no problem at all, as long as your publisher's template doesn't impose OT1...
\documentclass{article}
% access \textquotedbl:
\usepackage[T1]{fontenc}
% access \textquotesingle:
\usepackage{textcomp} % not needed for TeX vintages more recent than 2019)
% load "Times New Roman" text font:
\usepackage{mathptmx} % (note: the "times" package is obsolete!)
\begin{document}
He exclaimed, \textquotedbl Hello,
\textquotesingle Stranger\textquotesingle.\textquotedbl
\end{document}

Second Addendum, to address a late comment by @FlashSheridan, who claims that
\textquotesingle (with or without textcomp) produces a curly closing quote, not the straight quote I need for a short C fragment.
This claim simply cannot be correct in general. As \textquotesingle is defined in the textcomp package but not the LaTeX kernel, \textquotesingle without textcomp produces an error message, not a curly closing quote. (Update April 2022: This paragraph is irrelevant if your TeX distribution is more recent than 2019.)
The following screenshots (first for Latin Modern, then for Times Roman) demonstrate conclusively that \textquotesingle does produce a straight vertical quote. In contrast, \textsf{'} does not produce a straight vertical quote -- unless, of course, some sans-serif font with straight single quote glyphs has been loaded.


Finally, the code to produce the preceding screenshots:
\documentclass[border=1pt,preview]{standalone}
\usepackage[T1]{fontenc}
\usepackage{textcomp} % for \textquotesingle macro
\usepackage{mathptmx} % or: lmodern
\begin{document}
Times Roman
\verb+\textquotesingle+: \textquotesingle
\verb+\textsf{'}+: \textsf{'}
\end{document}
\textquotesinglealso via http://detexify.kirelabs.org/classify.html. – Stephen Apr 19 '12 at 18:000x27); one Unicode alias is "apostrophe-quote." Its glyph on the Unicode code chart is vertical and symmetric. It can be found on some typewriters. In my youth I used a typewriter that did not have an exclamation point. Instead, you typed'[backspace].The Apple II, Atari 400, and Commodore 64 all had straight quotes (see Damien Guard's article, Typography in 8 bits: System fonts). StackExchange has straight quotes. – Ana Nimbus Apr 21 '18 at 01:38