If the slope had been perfectly flat, the ball would have rolled down it when you placed it on the ground. It would not have stayed where you put it. Gravity would have pulled it down the slope. If there were no friction, the ball would slide down the slope. But because there is friction between the ball and the slope, even when the slope is perfectly flat, it rolls down instead.
The reason the ball does not roll downhill when you place it on the ground is not because of friction but because the ground is not flat enough. Small obstacles which prevent it from doing so - eg it might have to roll over some grass, which requires force to lift it up a little. Because it is not already moving, it has no momentum or inertia to overcome the resistance provided by the grass.
When you apply a force (or rather an impulse) by putting the ball, it rolls forward along the slope. It keeps rolling after it has left contact with the club because it has momentum or inertia.
As it rolls forward, because the ground is a little rough, the ball bounces slightly, because it hits small obstacles. Bouncing enables the ball to overcome other small obstacles not only in front of it but also to the side. Gravity is still trying to pull the ball downhill but now that the ball is bouncing a little it can overcome the obstacles (ie grass) to the side also, and starts to move sideways.
If it builds up enough momentum rolling to the side it will continue rolling downhill even after it has stopped rolling along the slope.