Why do the ground and the neutral have to be together in main panel and isolated in sub panel?

Your house must have only one reference voltage and that's at the main panel. Otherwise ground currents circulate and offset the references for your telephone, TV and other appliances. Ground should carry no current except during a fault condition. Neutral carries the unbalanced current of L1 and L2.