Negative resist compositions comprising a polymer comprising repeating units having at least two acid-deallyling hydroxyl or alkoxy groups in the molecule are effective in forming a resist pattern with high resolution and minimum LER while minimizing defects.