Numerical study of the spiking instability caused by modulation frequency detuning in an actively mode-locked solid-state laser