What voltage should my alternator be charging at when the lights are off
and then when there on

any idea how much an alternator go for

about 14 volts whether your light is on or off. if there is a problem with the alternator, the warning light on your instrumental panel should light up.