Should I worry if my poop is a whitish color?

Yes, whitish feces is a cause for concern and normally means a lack of bile which is produced by the liver. If the liver is not producing enough of this digestive substance then that means a problem with the liver. This is not a diagnosis as it is impossible to diagnose on the internet.

Please see your doctor and be evaluated properly to avoid any further problems.