I want to connect Combine RGB with Material output.
How can I convert the yellow dot to green dot?
You need to have a shader between them, like this.
The different shaders are found under Add -> Shader, and they are explained in the manual. Shader Nodes
Commonly used ones are Diffuse, Glossy and Glass, and the Mix Shader is highly useful to combine the effects of several shaders into one material.