The state of Georgia and the IRS care because they are not getting taxes from those incomes. That you don't know the right people to call or how to report it doesn't mean "nobody cares".
Also, your husband's boss obviously does care about small amounts of money, seeing as how he was trying to extort 4000 from his employees.
You're just an excuse factory. Whatever negative consequences happen will be because you refuse to take any action, and you won't receive any sympathy at that point.