A more direct answer using the definitions and the definition of subspace topology:
Suppose $A \subseteq B \subseteq \overline{A}$ are subsets of a space $X$ and suppose that $A$ is connected. I claim that $B$ is connected as well. (This is a bit more general, and is the same amount of work.)
So suppose $B = U \cup V$ where $U,V$ are disjoint open subsets of $B$. By the definition of the subspace topology, we can write $U = \hat{U} \cap B$, $V = \hat{V} \cap B$, where $\hat{U}, \hat{V}$ are open subsets of $X$.
Then clearly $A \subseteq B = U \cup V \subseteq \hat{U} \cup \hat{V}$, so $A = (\hat{U} \cap A) \cup (\hat{V} \cap A)$. Also $(\hat{U} \cap A) \cap (\hat{V} \cap A) \subseteq (\hat{U} \cap B) \cap (\hat{V} \cap B) = U \cap V = \emptyset$. As $\hat{U} \cap A$ and $\hat{V} \cap A$ are open subsets of $A$ (in the subspace topology), and as $A$ is connected the previous two facts imply that one of $\hat{U} \cap A$ and $\hat{V} \cap A$ is the whole of $A$ and the other is empty.
So assume wlog that $A = \hat{U} \cap A$, or equivalently $A \subseteq \hat{U}$. And so $\hat{V} \cap A = \emptyset$ or equivalently $A \subseteq X \setminus \hat{V}$.
Now we use that $\hat{V}$ is open, so its complement is closed and so $\overline{A} \subseteq \overline{X \setminus \hat{V}} = X \setminus \hat{V}$. This implies that $\overline{A} \cap \hat{V} = \emptyset$ and so a fortiori $B \cap \hat{V} = V$ is also empty. So we have shown one of $U$ and $V$ to be empty, and so $B$ is connected.