I also have issues with slow water flow from my fridge. However, installing the bypass fixes the problem and the flow goes back to being normal. So I suspect the issue is with the filter.

I have already replaced the water filter 2 times but the issue with slow flow still persists.

Any suggestions?

You have a stopped up filter screen before it goes into the water filter. Also, check the filter screen at the water valve.