5 or 6 is not too young IF you watch out which martial arts you choose for them at such age. If you choose to let them practice Aikido or Tai Chi at such age, they will most likely not have any...