Starting my Avalon has become difficult. Turning the key sometimes makes contact and some of the time it doesn't.
I have the cilander out but can not figure out how to get the actual switch out.

Since you didn't tell us the year, suggest you Google" removing toyota avalon ignition switch" There are lots of hits and how to do's. Also check with You Tube.