It is possible to achieve this by using a small rocket motor burning a small amount of fuel for a long time.
Unfortunately a "long time" is quite finite and it keeps your power from becoming infinite either. A small amount of fuel must either provide a small amount of thrust or not burn for very long. That's why probes take so long to reach even the outer solar system.
I am ignoring the fact that the mass of the rocket decreases as the fuel burns, and assuming that the fuel does not run out while there is a large increase in velocity.
These are big things to ignore. Yes, if we had a magic engine that didn't ever run out of fuel, we could get infinite power from it (in some frame of reference). But such engines do not exist.
probably_someone raised a point you may be wondering about:
why does the power exerted by the rocket continually increase as the velocity increases, even though it seems like the engine doesn't do more work per unit time?
Because most of the time we look at a rocket and we think of the burning fuel and how that affects the rocket's speed. But you also have the unburned fuel and the exhaust.
If the rocket is on the pad, then at launch the energy is going into accelerating everything (the rocket and it's fuel forward, and the exhaust backward). All the KE of the exhaust is basically thrown away and never collected. It has to be done for the momentum exchange, but the energy is lost. So at launch, the rocket is very inefficient.
When the rocket is moving forward at high speed in our observation frame, then we now see the exhaust emerges more slowly. That means the proportion of the energy of the combustion that is going into rocket KE and exhaust KE is changing. All the energy is still being used, but the proportion that goes into the rocket (which we care about) and the proportion going into the exhaust (which we don't care about) is changing.
EXAMPLE:
Assume your rocket has a mass of $1\text{kg}$. In an atomic fashion, it exhausts $1\text{g}$ of mass at a speed of $1000\text{m/s}$. Conservation of momentum means the rocket accelerates by $1.001\text{m/s}$.
Assuming it was at rest initially, we can see the total change in KE is:
$$KE_{\text{fuel}} = 0.5 (1\text{g}) (1000\text{m/s})^2 = 500\text{J}$$
$$KE_{\text{rocket}} = 0.5 (999\text{g}) (1.001\text{m/s})^2 = 0.5005\text{J}$$
So the energy of combustion is giving us almost $501\text{J}$ of energy, but most of it is going into the exhaust. Less than one part in a thousand is going into increasing the rocket's KE.
Now we imagine the rocket is already moving at $10\text{km/s}$ (much faster than the exhaust speed) and it has the same thrust. What's the change in KE of the rocket and the system?
$$\Delta KE_\text{rocket} = KE_{\text{10001m/s}} - KE_{\text{10000m/s}}$$
$$\Delta KE_\text{rocket} = 49,960,001\text{J} - 49,950,000\text{J} = 10001\text{J}$$
$$\Delta KE_\text{fuel} = KE_\text{9000m/s} - KE_\text{10000m/s}$$
$$\Delta KE_\text{fuel} = 40,500\text{J} - 50,000\text{J} = -9500\text{J}$$
$$\Delta KE_\text{total} = 10001\text{J} - 9500\text{J} = 501\text{J}$$
In this frame, the rocket gets a huge increase in KE from the same burn (more than the total energy available from combustion), but only with a corresponding decrease in KE of the exhaust mass. The total change in KE of the system is constant.