I am a federal worker and is currently working oversea. Do I still have to pay GA state tax while working oversea?

Yes, if your stay away from GA is temporary or transitory.

Agreed. To change state residency, you must establish residency in another state or country.