The EMF created by a changing magnetic field is not considered to arise from a potential. This can easily be seen because when there is an emf, a charge can move around in a complete circle and dissipate energy the whole way around, but a potential cannot drive a charge around in a circle, because potentials are conservative.
The two pieces of the electric field $\mathbf{E}$ can be seen explicitly if you express the electric field in terms of the electric potential $\phi$ and the magnetic vector potential $\mathbf{A}$: $$\mathbf{E} = - \mathbf{\nabla} \phi - \partial_t \mathbf{A}.$$
The two pieces of the electric field are the conservative piece $- \mathbf{\nabla} \phi$, and the emf piece $ - \partial_t \mathbf{A}$. The first piece comes from charges and you are familiar with it from electrostatics. In your problem, there are no net charges, so $\phi$ is zero, the potential is the same everywhere, and there is no electric field originating from the existance of net charges. The other piece, $- \partial_t \mathbf{A}$ does not occur in electrostatics, and in fact only occurs when there are changing currents. It is probably new and unfamiliar to you, which is probably why you are confused. The electric field from your problem is entirely due to this piece (since we saw the other piece was zero).
So as you can see, even though you have a non-zero electric field, the electric potential $\phi$ is in fact zero (since there are no net charges), and so every point is at the same potential. The non-zero electric field is instead entirely due to a second piece given by $- \partial_t \mathbf{A}$.