I have a not even two years old oil fueled furnace.
I realize that the burner is a independent part of
The furnace. I was wondering, can that be changed for a gas fueled burner?

Not going to happen cheaply. Two different animals... There are conversion kits available for some models, but not all... Also, it will never be very efficient...