On the basis of two answers, I present a proof in detail. The motivation for this re-formalization is that I would like to write down the proof on my own words, so that I can truly understand every tiny detail of it. All credits go to @Vera and @bang.
Lemma 1: The Cartesian product of a finite amount of countable sets is countable. (I presented a proof here)
Lemma 2: $\mathcal{P}(\mathbb N)$ is uncountable.
Let $J_1 := \{ i \in I \mid |A_i| \ge 2\}$, $J_2 :=J \setminus J_1 = \{i \in I \mid |A_i| = 1\}$, and $a_i$ be the element of $A_i$ for all $i \in J_2$. Consider
$$\begin
{array}{l|rcl}
G : & \prod\limits_{i\in J_1}A_i
& \longrightarrow & \prod\limits_{i\in J}A_i \\
& \phi & \longmapsto & G(\phi) \end{array}$$
where $\phi:J_1 \to \bigcup_{i\in J_1}A_i$ such that $\phi(i) \in A_i$ for all $i \in J_1$.
$G(\phi)$ is defined by
$$G(\phi)(i)=\begin{cases}\phi(i) & \text{ if } i \in J_1\\
a_i & \text{ if } i \in J_2
\end {cases}$$
a. $G$ is injective
For $\phi_1,\phi_2 \in \prod\limits_{i\in J_1}A_i$ and $G(\phi_1)=G(\phi_2)$. Then ${G(\phi_1)|}_{J_1}={G(\phi_2)|}_{J_1}$ and ${G(\phi_1)|}_{J_2}={G(\phi_2)|}_{J_2}$. Then $\phi_1(i)=\phi_2(i)$ for all $i \in J_1$ and $a_i = a_i$ for all $i \in J_2$. Thus $\phi_1 = \phi_2$. Hence $G$ is injective.
b. $G$ is surjective
For $\psi \in \prod\limits_{i\in J}A_i$, we define $\phi \in \prod\limits_{i\in J_1}A_i$ by $\phi:={\psi}_{|J_1}$. Then $G(\phi)(i)=\phi(i)$ for all $i \in J_1$ and $G(\phi)(i)=a_i$ for all $i \in J_2$. Then $G(\phi)(i)=\psi(i)$ for all $i \in J_1$ and $G(\phi)(i)=\psi(i)$ for all $i \in J_2$ (Since $A_i = \{a_i\}$ for all $i \in J_2$). Thus $G(\phi)=\psi$. Hence $G$ is surjective.
To sum up, $G$ is bijective.
Case 1: $J_1$ is finite
Then $\prod\limits_{i \in J_1}A_i$ is countable by Lemma 1. Furthermore, $G:\prod\limits_{i \in J_1}A_i \to \prod\limits_{i\in J}A_i$ is bijective. Hence $\prod\limits_{i\in J}A_i$ is countable.
Case 2: $J_1$ is infinite
Let $B_i := \{0,1\}$ for all $i \in \mathbb N$.
Since $\aleph \le |J_1|$ and $|B_i| \le |A_i|$ for all $i \in J_1$, $|\mathcal{P}(\mathbb N)|=|\prod\limits_{i \in \mathbb N}B_i| \le |\prod\limits_{i \in J_1}A_i|$. By Lemma 2, $\mathcal{P}(\mathbb N)$ is uncountable. Thus $\prod\limits_{i \in J_1}A_i$ is uncountable. Furthermore, $G:\prod\limits_{i \in J_1}A_i \to \prod\limits_{i\in J}A_i$ is bijective. Hence $\prod\limits_{i\in J}A_i$ is uncountable.