Social polarization due to minor conflicts