I just had direct vent wall furnace installed - should the floor be very cold when it is not running

Yes it could be cold depending upon how it was installed. Call back the company that did the work and complain.