Covariant perturbation theory (II). Second order in the curvature. General algorithms