If you have a light on, and turn the power on to something else, what causes the light to dim significantly? Especially when the plug it is in is the only power on at the breaker box.

Loose connections anywhere between power company and lights/recepticle.
A voltmeter will help.
Start at panel.