It seems like he's comfortable showing physical affection (nonsexual, like holding my hand, kissing my cheek, putting his arm around me, things like that) but doesn't even consider using words to show me that he's into me. We haven't been dating for very long (just over 2 months) but he's never really ever called me pretty or even directly told me "I like you." I understand that this isn't the biggest problem to arise in a relationship, but it really does grate on my nerves sometimes. I'm not the most experienced, but all the boyfriends I've had in the past have been more verbally demonstrative than they were physically demonstrative. Basically, I'm used to boyfriends giving me occasional compliments or telling me something cute once in a while. I think saying things like these is a huge part of a relationship, and I feel like this one particular boy doesn't think they are.
How could I go about talking to him about this? I've considered just asking him directly to compliment me more, but I feel that's rude and then the compliments wouldn't be as genuine.
Thank you!

Not all guys communicate with words, and this one seems to communicate with actions. He is a different guy from what you are use to so adjust, and learn his language, or go back to the verbal guys you are use to.

Now you could just drop a hint that genuine compliments make you happy, and see what happens.