https://arxiv.org/help/faq/texlive.html states
Our goal is to provide a stable TeX processing system where we are able to reprocess papers from TeX source at any point in the future. arXiv maintains all past TeX trees such that existing papers are processed using the TeX tree in effect when the paper was originally submitted. This preserves the original presentation (look-and-feel) of the paper.
and later on
Users may choose to replace older documents where such updates will improve the rendering of documents impacted by bugs in the previous TL2011-based tree.
If you are replacing a paper with older TeX source that rendered fine under the previous release we strongly encourage you to carefully examine your final PDF.
This suggests that papers are rendered with the TeX live version that was used at the time of uploading. So submissions that look fine on the day of upload will continue to do so. There is nothing you have to worry about once you got arXiv to compile your document and are happy with the output.
The general way to be safe here is to use as little packages as possible. Cut down on the bells and whistles and flamboyant output. If you want to use extra packages, try to avoid low-level commands (and \makeatletter...\makeatother hackery of internals) and try to rely on high-level commands instead. High-level commands are more likely to stay stable than low-level (or even undocumented) macros.
biblatexas an example. That package is quite actively maintained and relatively young (first release in 2006, official stable release v1.0 in 2010) and has undergone its fair share of incompatible changes. The most prominent of those (v3.3) broke contributed and user-defined styles if they used low-level commands, higher-level features continued to work with a deprecation warning. If you only ever used the standard styles and only modified the output via options chances are the document was not broken by any of the updates. – moewe Apr 24 '18 at 15:13biblatex(which was at 1.0 back then and is at v3.11 now) almost worked flawlessly (that is to say it compiled the horrible code I provided it to the expected output, not that the input or output was flawless) had it not been for my hubris to mess with the deepest internals of the name format. Of course there were deprecation warnings. ... – moewe Apr 24 '18 at 15:46.bbxand.cbxfiles for the document (they redefined all bibdrivers and many bibmacros) and those did the expected thing save for the name issue where I used low-level commands. This is anecdotal, but it goes to show that you can get stability if you use high-level functions and go the extra mile to provide used definitions yourself. – moewe Apr 24 '18 at 15:54