Doesn't matter what I think, what matters is what he thinks so talk about it.

This whole situation is a bit much. As I see it you may feel more for him than he does for you. You two are Fwb. If it was anymore than that he was ask for it to be.
You two may have known each other for a while but your relationship appears to be based on sex, nothing more. The fact that he is occasionally attentive otherwise means nothing. You need to have a talk with him. It is impossible for us to know what he is feeling towards you.