Replaced starter on murray riding mower. When trying to start, top of starter sticks in up position. What is problem?

When you say "trying to start" I assume that the engine is not starting. The rotation of the engine after it starts is what turns that gear on the starter and makes it go back down.

Is your flywheel plastic or metal. Might have wrong starter