Assuming that the Peano Axioms hold (without the axiom of induction), and assuming one of Robinson's Axioms, namely
Every natural number is either $0$ or the successor of a natural number.
It can be shown that you cannot use the above axiom to prove mathematical induction, since there's an inherent circularity, but I can't seem to pin down what will go wrong.