I was asked about a non-Muslim that if islam does not allow interest on money then how are Muslims allowed to keep money in banks and by doing so are Muslims going against islam?

The receiving (or giving) of interest on financial products is forbidden.