The fact is that in general the question is false, but if one add the hypothesis,
that the group $G$ is nilpotent (e.g. a $p$-group for some prime $p$), then the result become true:
Indeed, we have the chain $\gamma_{3}(G)\subset \gamma_{2}(G)\subset G$,
where $\gamma_{2}(G)= G'$ and $\gamma_{3}(G)=[\gamma_{2}(G), G]$ (the commutator). Now from the last relation we have $\frac{\gamma_{2}(G)}{\gamma_{3}(G)}=Z( \frac{G}{\gamma_{3}(G)} ) $ (the center);
so the quotient $\frac{\frac{G}{\gamma_{3}(G)}}{Z( \frac{G}{\gamma_{3}(G)} ) }=\frac{G}{\gamma_{2}(G)}$ and this is cyclic, and as someone have remarked above, this implies that $\frac{G}{\gamma_{3}(G)}$ is abelian and then $G'=\gamma_{2}(G)\subset \gamma_{3}(G)$ and finally $\gamma_{2}(G)= \gamma_{3}(G)$. Since $\gamma_{3}(G)=[\gamma_{2}(G),G]=[\gamma_{3}(G),G]=\gamma_{4}(G)$ and so on... But in last we know that $G$ is nilpotent and so there is a $c \in \mathbb{N}^{+}$ such that $\gamma_{c}(G)=1$ and so $G'=1$ that means $G$ is abelian.
For the general case one can see to the alternating group $A_{4}$:
indeed one can prove that $|A_{4}|=12$, $|A'_{4}|=4$ so that the quotient $\frac{A_{4}}{A'_{4}}$ has 3 element and it is cyclic; but $A_{4}$ is not abelian.