I want to cleanup the highlighted vertices so they are rather sharp edges (which can then be beveled with a modifier if I wish). I've tried just selecting those vertices and doing remove doubles, limited dissolve, and decimate, but each time it ends up affecting the non-highlighted parts (the faces which I want to keep smooth).

Here's another example. I want to clean up the edges without losing the roundness of the pegs:

