Investigation and compensation of the nonlinearity of heterodyne interferometers