What is the difference between an MP3 player and an MP4 player?

In a nutshell mp3 players play only audio files (mp3 files), mp4 players will play audio and video files (check the specs to see what formats they support).