mmmm, not absolutely, no. Better to put a voltmeter on the battery terminals & check it that way, or at least look to see if lights brighten when you rev the engine.
Although the light going out should tell you, it is possible to have the light operating normally, but still not charging at all.