How do you check the heater core to see if that is the problem?

Disconnect the heater hoses and reverse flush the heater core. The heater's inlet and outlet hoses should both get hot, once the engine is at normal operating temperature and the heater is turned on.