My boyfriend thinks I'm always trying to figure him out, he gets mad when I say I know him well, what to say when he says that

Ask him why he's mad.

Is this seriously your question?