Let's start by observing that the Exp[-x] factor can be ignored since DiracDelta[x] is zero except at the origin, and at the origin Exp[-x] == Exp[0] == 1. So the expression in question reduces to DiracDelta[x].
Consider the indefinite integral of DiracDelta[x]:
Integrate[DiracDelta[x], x]
(* HeavisideTheta[x] *)
HeavisideTheta[x] is zero to the left of the origin and has the value one to the right as per the definition of Dirac delta. But at the origin it is indeterminate, just as the Dirac delta itself is indeterminate at that point.
Since the lower limit of integration shown in the question is zero, we will get an indeterminate result when we compute the definite integral:
HeavisideTheta[Infinity] - HeavisideTheta[0]
(* 1 - HeavisideTheta[0] *)
To avoid this, we must ensure that neither limit of integration is on the origin -- usually on opposite sides. It is most conventional to use the entire real number line:
Integrate[DiracDelta[x], {x, -Infinity, Infinity}]
(* 1 *)
... but any finite limits will demonstrate the defined effect of integrating the Dirac delta:
Integrate[DiracDelta[x], {x, -1, 1}]
(* 1 *)
Laplace Transform
In the particular case of the Laplace transform, Mathematica offers LaplaceTransform which can evade this difficulty . In the Details and Options section of that documentation, we find:
The lower limit of the integral is effectively taken to be 0₋, so that the Laplace transform of the Dirac delta function is equal to 1.
By taking the lower limit to approach zero from the left, the indeterminancy at the origin is avoided:
LaplaceTransform[DiracDelta[x], x, 1]
(* 1 *)
We can achieve the same effect using Integrate if we explicitly specify that the lower limit of integration must approach zero from the left:
Limit[Integrate[DiracDelta[x]*Exp[-x], {x, z, Infinity}], z -> 0, Direction -> 1]
(* 1 *)
Integrateis a functional that provides you some useful results for a certain class of "arguments". For a broader class of arguments, it still provides some useful results, maybe not for you, but for other people. This is already awesome, despite the fact that theIntegratehas lost its absolute "eternal" meaning. – yarchik Apr 01 '20 at 08:26Integratecommand of MA comprises several mathematical concepts: the antiderivative, definite integral, etc. But it is not even said which definite integral: the Riemann or the Lebesgue integral, or maybe the Darboux integral, or the Lebesgue–Stieltjes integral, or the Haar integral,or the Itô integral? The point is thatIntegraterelates to them all for certain classes of functions, but it is not a mathematical concept on its own. – yarchik Apr 01 '20 at 10:33