If I suspect that someone is siphoning money from a household budget and setting up their
Own account, can I find out which bank and what the balance is?

Hello M

Why not just ask? There had to have been something to make you suspect money was missing? Sounds like there may be a trust issue going on. The simple thing to do is ask
At the very least this may open up a conversation.