I dont need this vertices and/or edge. What is the best way to get rid of them?
Weld Edges into Faces
Select the edge with Alt+RMB, then hit Del or X > Dissolve Edges.
Weld Edges into Facestool, it's here (though the documentation is not very helpful). – mins Jul 05 '18 at 18:49