Can an employer ask me for a note from my doctor after a visit?

Its HIPAA and yes he can. The note will not state why you were there just that you were seen by the physician.

Yes, if you are taking off work and using this as an excuse.

Yep, that was my assumption and should have said that. If you told the boss you were going to the doc on company time he can ask for proof of the visit