Wondering if flames on furance should always be visible when desired temp of furance is reached?

No because the furnace is finished heating at that time. Now if it is a old furnace it could have a pilot and that would keep burning.