Does a reaction that is at equilibrium undergo continual change, or does is just remain the same?
And...
Is a reaction at equilibrium when no reactants remain?

You mean, in a reversible reaction? Then, the equilibrium remains the same, but the reaction continues. This is because the forward reaction is equal to the reverse reaction.

No. I don't think so.