I'm making an importer for a xbox360 game. Specular data is in the alpha channel of the image. Once I have enabled the alpha for image, blender does: "RGB" + "A" = "ARGB". But I need the "RGB"` to stay "RGB" for diffuse colors, and use "A" for the specular intensity map.
Right now I'm copying the same image with alpha disabled for diffuse, and with alpha enabled for specular, but copying a lot of hi-res textures is not an option.
How do I stop alpha affecting the diffuse colors? Or how do I set RGB for diffuse color map, and alpha for specular intensity map?
[update]
Unticking the "Image sampling -> Alpha -> Use" does not work(the image only becomes darker). Here is the .blend file.

On the image above: At the left, alpha is on - specularity is ok diffuse is not and at the right alpha is off - diffuse is ok but specularity is not
