Lights go dim than bright up and down until you put a load on and than they stay bright.

I am no generator mechanic, but sounds like the governor needs to be adjusted, or replaced.