Bush, I'm sorry you have a thief in your neighborhood!
A person should not have to robber-proof their gardens in their own yard.
Putting the electric fence is a good idea.
You could always say it's to keep the animals out;) .
Or a pad/key lock on the gate doors, if that's possible, might work too.