There are non-profits out here who offer down payment and closing costs assistance,
However the catch is that the seller has pay the money back, so therefore whether it
be private sellers or builders no one wants to assist in helping the buyer, Is there not
one organization out there that will give a housing grant without any stipulations?

No, everything will have some stupulatoin, there is no "free" money

You can in some areas get assistance from zoning or community groups, For example in town town Atlanta, if you moved into a certain areas the city though housing commisisons would apply thousands of dollars toward a down payment. But of course you were buying 200 or 300 thousdand dollar town houses in the very worst area of the city with high crime rates, hoookers on the street a few blocks over and bums that would steal things from front yard. They were trying to bring people back to the inner city.

But in general you work and save money, get good credit and get a good loan and buy a place, People are not in general going to be giving you anything

You should get a copy of Lesko's books from the library. They're a great source of organizations who give grants.
http://www.amazon.com/s/ref=nb_ss_b/104-6138622-8903164?url=search-alias%3Dstripbooks&field-keywords=matthew+lesko&Go.x=0&Go.y=0&Go=Go