I want some advice on how I could deal with the current situation I'm in

If you feel your children are in danger from someone then as a responsible parent you must remove the children from that danger. Have you revealed any of this to your family or the police? Have you been keeping your children away from him? How soon are you moving?

I only revealed this to my mother and my brother is diagnosed with a mental not that its and excuse in no way do I use that as a justification, I do keep him away from my kids, Hes never really there so it like he comes in and just keeps to himself were trying to find him another place to go because either way.