Vectors have both magnitiude and direction. It's obvious that for displacement the magnitude is important (2 miles is definitely different than 3 miles), but so is direction - if you travel 3 miles to the east you end up in a different place that if you travel 3 miles to the west. So both magnitude and direction are important when talking about displacement. Hence displacement is a vector.