The top of my oil dipstick broke off and I couldn't retieve the stick. Will this damage my car?

It potentially could. You need to retrieve the broken parts or they could get into the crank shaft and create problems.