At what age should I stop bottle feeding him?

Kittens are weaned at four weeks and begin to eat solid food then. You can buy kitten chow that is suitable for the age group. You don't say how old your kitten is. When the kitten starts 'worrying' the nipple (as in biting and knawing) then you know he is ready for solid food.

Kittens are weaned at four weeks and begin to eat solid food then. You can buy kitten chow that is suitable for the age group. You dont say how old your kitten is. When the kitten starts 'worrying' the nipple (as in biting and knawing) then you know he is ready for solid food.

He is 4weeks old

Okay, he is four weeks old, now you know what you have to do. Stop being a mom to the kitty and let him get on with becoming mature and a better companion toyou.