We have called the company who closed our pool. They said to fill the pool back up. They said if frost gets into the concrete it will crack, as the water acts as insulation. However... is this not counter-intuitive... as the water will just drain out again?

I would guess a broken drain line.