I am modeling an old building with walls of big, roughly cut stones, and I wonder if I could use a raster image of a wall to sculpt vertex displacement on a Blender object representing the wall by projecting the raster image onto the object, rather than applying it with a brush. The projection that controls vertex displacement needs to be accurate because I intend to use the same raster image to assign the materials of the stones and the mortar onto the wall object.
I've tried using the Displace modifier for this, and it appears to only use tileable textures, with no option for controlling the scale of the image projection. Can you do the same kind of work with UV maps that is done when assigning materials to generate vertex displacement on an object?