Can my sons father give his visitation rights to his parents (the grandparents) in the state of North Carolina

Only a court can order visitation rights. That doesn't mean he can't share visitation with them. But if he's just dropping the kids off, the mother can ask for a modification.