Does he live with you? Did he help plan and pay for the party?

If the answer to both these questions is no, then he had no right to invite anyone to your home, your party, without asking you...