For me using \usepackage[nonatbib, preprint]{neurips_2021} and removing \usepackage{biblatex} worked.
e.g.
\documentclass{article}
% if you need to pass options to natbib, use, e.g.:
% \PassOptionsToPackage{numbers, compress}{natbib}
% before loading neurips_2021
% ready for submission
% \usepackage{neurips_2021}
% to compile a preprint version, e.g., for submission to arXiv, add add the
% [preprint] option:
% \usepackage[preprint]{neurips_2021}
% to compile a camera-ready version, add the [final] option, e.g.:
% \usepackage[final]{neurips_2021}
% \usepackage[preprint]{neurips_2021}
% to avoid loading the natbib package, add option nonatbib:
% \usepackage[nonatbib]{neurips_2021}
\usepackage[nonatbib, preprint]{neurips_2021}
\usepackage[utf8]{inputenc} % allow utf-8 input
\usepackage[T1]{fontenc} % use 8-bit T1 fonts
\usepackage{hyperref} % hyperlinks
\usepackage{url} % simple URL typesetting
\usepackage{booktabs} % professional-quality tables
\usepackage{amsfonts} % blackboard math symbols
\usepackage{nicefrac} % compact symbols for 1/2, etc.
\usepackage{microtype} % microtypography
\usepackage{xcolor} % colors
\newcommand{\yx}[1]{{\small\color{blue}{\bf yx: #1}}}
\newcommand{\sk}[1]{{\small\color{red}{\bf sk: #1}}}
\newcommand{\bm}[1]{{\small\color{green}{\bf bm: #1}}}
%% my imports
\usepackage{biblatex}
\addbibresource{egbib.bib}
...
\usepackage{biblatex}I had many new errors arising and even the pdf in overleaf failed to display. What do you want us to do? – Charlie Parker Dec 24 '21 at 19:41\usepackage[nonatbib, preprint]{neurips_2021}? I think that solved my problems. – Charlie Parker Dec 24 '21 at 19:47