As was the case in my answer to your earlier query (which was about how to indicate the dimensions of the components of a row vector), I would not use arrows here. Instead, I would use vertical curly braces to the right of the column vector.
I would also like to suggest that you use \vdots ("vertical dots") instead of \dotso\\ \dotso.
The following answer assumes that it's a good idea to indicate the dimensions of the sub-vectors to the right of rather than inside the column vector.
Asides: (i) \mathstrut inserts a (typographic) strut: an object with zero width (hence making it invisible) and the height and depth of a parenthesis, i.e., ")". (ii) Do please make a habit of using \mathbf instead of \textbf in math environments.

\documentclass{article}
\usepackage{amsmath} % for 'bmatrix' env.
\usepackage{mleftright} % for cramped versions of \left and \right
\usepackage{booktabs} % for '\addlinespace' macro
\newcommand{\mathstrutx}{\vphantom{\vdots}} % extra-tall typographic strut
\begin{document}
\[
Q\mathbf{w}=
\begin{bmatrix}
(2n-1)^2+(n-1)^2+n\\
(2n-1)+(n-1)^2+(n-2)(n-1)\\
\vdots \\
(2n-1)+(n-1)^2+(n-2)(n-1)\\ \addlinespace
(2n-1)+1\\
\vdots\\
(2n-1)+1
\end{bmatrix}\mkern-9mu % less horiz. separation
%% Now for the stuff to the right of the column vector:
\begin{array}{@{}l@{}}
\mathstrut\\
\mleft.\begin{array}{@{}l@{}}
\mathstrut \\ \mathstrutx \\ \mathstrut
\end{array}\mright\}\text{\footnotesize $n-1$ times}\\ \addlinespace
\mleft.\begin{array}{@{}l@{}}
\mathstrut \\ \mathstrutx \\ \mathstrut
\end{array}\mright\}\text{\footnotesize $n$ times}
\end{array}
\]
\end{document}