Is it normal for the vent covers to get very hot, or do I have a potential problem. I was not aware of how hot they were until someone brought it to my attention

The furnace could be running to hot a temperature or the blower might be running on to slow a speed. Under normal circumstances it is not noticed but if you have children pets etc it could be a problem.

Assuming you have a forced air furnace. If so the registers should never be so hot that you can't hold your hand on them. Very warm is OK, but so hot you can't touch them is not good. Go feel the duck work coming off your furnace and let me know how hot that is. You may have an airflow problem.

Unless you are talking about a floor furnace,they get hot , to hot for small children to be around,Have always thought they were dangerous

I agree with wmproop about the floor furnace. Please let us know what type of heating system you have(forced air, floor furnace, hot water heat(in which case they wouldn't actually be floor register, but wall registers)).. Im banking on forced air. Keep us posted, take care.