We are a 501c and have some ex-presidents/members "demanding" we meet with them. They want to see our records for the past 4 years, which are all in order and we have no problem, since it is public information. Our question is if these people have had no interest or supported our group for years ad are not current members, do we have to work with them?

If everything is in order, as you say, why would you not want to work with them?

If they are not active members, then I believe you have no obligation to spend time with them. Especially if you feel their grievances are baseless. I would tell them they have no standing, but if they have some specific issue they need to check on, then you are willing to accommodate them, since you have nothing to hide.

Tell them "no", or simply ignore their demands.

Review your state non-profit corporation statute (assuming your organization is a NPC) to determine what rights members have to see the records. It is possible, I'm guessing, that they could again become members in good standing, so you should be prepared in case they take that route.

Seems to mne this is more of a PR question than a legal one. It's clear that you have no legal obligation to meet with anyone, absent a court order. But be sure to consider the ramifications around what these people may do if you stonewall them - letters to the editor claiming you have something to hide, controversy stirred up among the membership, general bad-mouthing the organization in the community which may affect contributions, etc. It's best to get in front of this - make sure you understand what their concerns are, be willing to discuss issues at least in broad terms, and consider providing details if it doesn't violate privacy or other HR policies. Be prepared to follow up with a letter or meeting with constituency that adresses the issues so that you control the narrative. Often these types of controversies have to do with a perception that money is being misappropriated, or an employee is being shown favoritism (such as nepotism), or a board member is taking financial advantage. So review your board and management policies in these areas and make sure that there are appropriate safe guards in place.