Question: "If I have an affine scheme X=SpecA, and an open subscheme Y=SpecB which is also affine and whose topological space is different from X, does it follow that X and Y are non-isomorphic?"
Answer: Two affine schemes $X:=Spec(A), Y:=Spec(B)$ are isomorphic iff $A\cong B$ are isomorphic rings. In particular this implies that $X$ and $Y$ have "isomorphic" topological spaces. Hence if $X \cong Y$ are "abstractly isomorphic", this implies the topological spaces are isomorphic.
In general two schemes (or ringed spaces) $(X, \mathcal{O}_X), (Y, \mathcal{O}_Y)$ are "isomorphic" iff there are maps $f:(X, \mathcal{O}_X) \rightarrow (Y, \mathcal{O}_Y), g:(Y, \mathcal{O}_Y)\rightarrow (X, \mathcal{O}_X)$ with $f\circ g =Id,g \circ f=Id$. In particular the maps $f,g$ induce homeomorphisms of topological spaces $X \cong Y$. If a strict open subscheme $U \subsetneq V$ is abstractly isomorphic to $V$ you end up with a topological space $U_t \subsetneq V_t$ realizable as a strict subspace of $V_t$, but where there is an abstract isomorphism $U_t \cong V_t$. This stuation is "paradoxical" - the topological space $V_t$ would then be homeomorphic to a strict subspace of itself.
Remark: "But if X and Y would be isomorphic, then we'd have A≅B and hence Y and X must actually be the same as subsets of X, because the prime ideals of A are 1:1 to the prime ideals in B. I think I'm confused here in this situation about the interplay of "being the same" and "being isomorphic"."
Answer: Here is an example (the affine line over an algebraically closed field) to show that there are no strict open subschemes $U \subsetneq \mathbb{A}^1$ with $U_t \cong \mathbb{A}^1_t$ a homeomorphism induced by a map of schemes. Hence in this situation you avoid such paradoxes.
Example: Let $k$ be an algebraically closed field and let $A:=k[x]$ be the polynomial ring in one variable $x$ over $k$. Let
$$f(x):=(x-u_1)^{l_1}\cdots (x-u_m)^{l_m}$$
with $u_i \neq u_j\in k$. Let $X:=Spec(A)$ and $U:=D(f) \subsetneq X$ be a strict open subscheme of $X$ and assume $X \cong D(f)$ is an abstract isomorphism of schemes over $k$, induced by a map of $k$-algebras $\tilde{\phi}: A \cong A_f$. The map $\tilde{\phi}$ induce a map of $k$-algebras
$$\phi:k[x] \rightarrow k[x]$$
with $\phi(x)=a(x)$ and $\phi(f(x)):=f(a(x))\in k^*$ a unit. It follows
$\phi(a(x)):=a_0\in k^*$ is a unit with $a_0\neq u_i$ for all $i$. Hence the map $\phi$ factors as follows
$$ k[x] \rightarrow k[x]/(x-a_0) \rightarrow k \subseteq k[x].$$
Hence the induced map $k[x]\rightarrow A_f \rightarrow A$ is the "constant map": The induced map of affine schemes
$$ D(f) \rightarrow X$$
identifies $D(f) \cong \{(x-a_0)\} \subseteq X$ as a topological space with one point which contradicts the assumption that $D(f) \subseteq X$ is an open subscheme.
There are problems related to infinite sets and maps of infinite sets - an infinite set can be embedded as a strict subset of itself. In the above discussion we see that if we consider maps of schemes and open subschemes, in the case of the affine line we can not construct a strict open subscheme which is isomorphic to the affine line. Hence in this situation we avoid such "paradoxes". If you ignore the algebraic structure you can - as mentioned in the comments - easily construct such examples, but then you are not doing algebraic geometry, you are doing set theory.
For a discussion of this and the "Peano curve" see the following post:
"Infinity" in mathematics and an elementary question on dimension.
https://en.wikipedia.org/wiki/Dedekind-infinite_set