The sequence of numbers you see depends on the hierarchy level of the structure (\paragraph in your case). Therefore removing the last (or first) number would not be "LaTeX style".
IMHO the better way is to use the next higher structure (\subsubsection) any change its layout as mentioned in this answer:
Change size of section, subsection, subsubsection, paragraph and subparagraph title
Without any change the result of \subsubsection is quite close to what you want:
\documentclass[10pt,a4paper]{article}
\usepackage[utf8]{inputenc}
\usepackage{amsmath}
\usepackage{amsfonts}
\usepackage{amssymb}
\begin{document}
\section{test}
\subsection{test}
\paragraph{test}
bla bla bla
\section{test}
\subsection{test}
\subsubsection{test}
bla bla bla
\end{document}
