You don't need to be 'handwavy' at all, and, in the standard modern way to understand this, one does not need one to choose local sections and talk about infinitesimal motions. Here's the standard approach:
First, a Cartan connection of type $(G,H)$ on an $n$-manifold $M$ is, as you know, a principal right $H$- bundle $\pi:B\to M$ endowed with a $\frak{g}$-valued $1$-form $\omega:TB\to\frak{g}$ that gives a parallelism of $B$ (i.e., $\omega_b:T_bB\to\frak{g}$ is an isomorphism for each $b\in B$) subject to the following two conditions: (1) $\omega(Y_v) = v$ for all $v\in\frak{h}$, where $Y_v$ is the vector field on $B$ induced by the flow of right action by the $1$-parameter subgroup $\exp(tv)$ in $H$, and (2) $R_h^*(\omega) = \mathrm{Ad}(h^{-1})(\omega)$ for all $h\in H$. The curvature of $\omega$ is $\Omega = \mathrm{d}\omega + \tfrac12[\omega,\omega]$, and it is $\pi$-semibasic. The torsion of $\omega$ is the $\frak{g}/\frak{h}$-valued $2$-form $\Omega\,\text{mod}\,\frak{h}$.
As an example, $\gamma:TG\to\frak{g}$, the canonical left-invariant $1$-form on $G$, is a Cartan connection for the natural coset quotient $q:G\to G/H$. Of course, the curvature of $\gamma$ vanishes identically.
Now, about the rolling interpretation: Given a Cartan connection $(B,\pi,\omega)$ over $M^n$, consider the product $B\times G$ and the modified 'difference' $1$-form
$$
\theta =\mathrm{Ad}(g)\bigl(\omega-\gamma\bigr).
$$
This $1$-form is invariant under the diagonal right $H$-action on $B\times G$
defined by $(b,g){\cdot}h = (b{\cdot}h,gh)$, and it satisfies $R^*_{a}(\theta) = \mathrm{Ad}(a^{-1})(\theta)$ where $R_a:B\times G\to B\times G$ is the right $G$-action defined by $(b,g)\cdot a = (b,a^{-1}g)$ for $a\in G$. It also satisfies $\iota_{b,g}^*(\theta) = 0$, where $\iota_{b,g}:H\to B\times G$ is the mapping $\iota_{b,g}(h) = (b{\cdot}h, gh)$.
It follows that $\theta$ is the pullback of a well-defined $\frak{g}$-valued $1$-form $\bar\theta$ on the quotient $B\times_HG$ of $B\times G$ by the diagonal right $H$-action. In fact, $\bar\theta$ defines a connection in the usual sense on $B\times_H G$ when this quotient is regarded as a principal right $G$-bundle over $M$, and one has the curvature identity $\bar\Theta = \mathrm{Ad}(g)(\Omega)$. (Hence, even when the torsion of $\omega$ vanishes, the curvature of $\bar\theta$ will not, generally, take values in $\frak{h}$.)
Denote by $\pi:B\times_H G\to M$ the projection to $M$, and denote by $q: B\times_H G\to G/H$ the map defined by $q\bigl([b,g]\bigr) = gH\in G/H$. The pair $(\pi,q)$ defines a double fibration of $B\times_HG$ over the pair of bases $M$ and $G/H$.
Any element $[b,g]\in B\times_HG$ defines a pair of points $(\pi(b),gH)$, but, more than this, the horizontal space $\ker(\bar\theta_{[b,g]})\subset T_{[b,g]}B\times_H G$ maps isomorphically onto $T_{\pi(b)}M$ and onto $T_{gH}G/H$,
so it defines an isomorphism $\tau_{[b,g]}:T_{\pi(b)}M\to T_{gH}G/H$ that can be regarded as a $1$-jet of a pointed diffeomorphism between $(M,\pi(b))$ and $(G/H, gH)$, i.e., an 'infinitesimal identification' of the two spaces. Thus, $B\times_H G$ can be regarded as providing a family of $1$-jets of identifications of $M$ with the 'model space' $G/H$. (There can be, and, often, there is, more information in $(B\times_HG,\pi,q,\bar\theta)$ than this, but that's enough for the present purposes.)
Finally, the connection $\bar\theta$ on $B\times_H G$ defines a way uniquely to lift any differentiable curve $\alpha:[0,1]\to M$ to a $\bar\theta$-horizontal curve $\hat\alpha:[0,1]\to B\times_HG$ once one specifies $\hat\alpha(0)\in\pi^{-1}\bigl(\alpha(0)\bigr)$. In other words, $\hat\alpha$ provides a 'rolling without slipping' interpretation of the Cartan connection $\omega$. Note that if $\omega$ is flat, then this actually defines the developing map of the simply connected cover of $M$ to $G/H$, as you would expect.
Probably, I should also mention that the (ordinary) holonomy of the connection $\bar\theta$ is what Cartan called the holonomy of (what we now call) a Cartan connection.