The piece that holds the thread in place broke off and I don't know where to get a replacement.

You can try a Google search.

Of course it works better if you know the make and model of the machine. Because they aren't ALL the same.