Is going Gym 5 days a week, is that bad?
This includes working on the same muscle everyday - but obviously I vary different workouts for it

I would suggest alternate days, say M W F S, etc. with stretching in between. If this is not the way you do it. Muscles need a break. Or if you must get physical activity, walk a couple of miles a day. One mile takes 20 minutes and is all over aerobic.