You're his stand by girl. If anything goes wrong with his girlfriend, he knows you are waiting in the wings. Is that what you want, to be someone's emergency plan?
There are tons of guys out there that will put you first, you deserve nothing less. Say goodbye to this guy, he's not worth it.
Good luck.