There is another fundamental force of nature apart from the electromagnetic and the gravitational force. This is the strong nuclear force. Its presence is in between the interactions of protons and neutrons themselves or between protons and neutrons.
Unfortunately, the strong force has no macroscopic effect as to feel the interaction themselves because the typical range where they are stronger than the electromagnetic interactions is at the range of femtometres ($10^{-15}\ \mathrm m$).
At such ranges, the strong force is stronger than the electromagnetic repulsion between the protons to hold them together.
As for your second question on the nucleus itself travelling to the electron, if you think in terms of the centre of mass, the nucleus has higher mass than the electron and so the centre of mass of the system would be closer to the nucleus than it is to the electron. But in this case, the centre of mass is probably within the nucleus itself which is why it is a feasible idea to say that the electron reveolves around the nucleus. Although it is correct to say that the electron revolves around the combined centre of mass of the system.
EDIT: There is something that I have to add on for completeness -
As @dmckee has pointed out in his comment, the strong nuclear force is not fundamental by itself (I apologise) but is instead the result of a fundamental strong nuclear interaction originating between the gluons and the quarks that constitute these protons and neutrons.
But essentially the strong nuclear force arises from this interaction. And hence the nucleus is stable from electromangetic repulsions due to the charge the protons carry.