Let $(V, \partial)$ be a chain complex of $F$-vector spaces. I'm having trouble proving $\forall n \in \mathbb{Z}$: $$H^n(V^*, \partial^*) \cong H_n(V, \partial)^*$$ where the * denotes the dual vector space (i.e. $V^* = Hom(V, F)$).
Essentially this question is very similar to this 5 year old SE post. I understand the argument using the universal coefficient theorem (although one answer points out that this only works in the finitely generated case). Another answer suggests however, that the UCT is not needed here since the $Hom(\cdot, F)$ functor is exact in the case when $F$ is a field. This is what I want to understand. How does the argument with the exactness of the $Hom$-functor work? And under what circumstances do I still have an isomorphism in the non-finitely generated case?
I also found this question rather insightful, however I'm not sure how to translate it to the case of a contravariant functor (like $Hom(\cdot, F)$).