I wouldn't pay him a dime. If you are in a civilized society, then he sues you for damages, and a judge decides whose right or wrong.