A search for a fifth planet around HR 8799 using the star-hopping RDI technique at VLT/SPHERE

Context. Direct imaging of extrasolar giant planets demands the highest possible contrasts (ΔH ≳ 10 mag) at the smallest angular separations (∼0.1″) from the star. We present an adaptive optics observing method, called star-hopping, recently offered as standard queue observing (service mode) for the SPHERE instrument at the VLT. The method uses reference difference imaging (RDI) but, unlike earlier RDI applications, images of a reference star for PSF subtraction are obtained within minutes of observing the target star. Aims. We aim to significantly gain in contrast beyond the conventional angular differencing imaging (ADI) method to search for a fifth planet at separations less than 10 au, interior to the four giant planets of the HR 8799 system. The most likely semimajor axes allowed for this hypothetical planet, which were estimated via dynamical simulations in earlier works, were 7.5 au and 9.7 au within a mass range of 1–8 MJup. Methods. We obtained 4.5 h of simultaneous low-resolution integral field spectroscopy (R ∼ 30, Y − H band with IFS) and dual-band imaging (K1 and K2 bands with IRDIS) of the HR 8799 system, interspersed with observations of a reference star. The reference star was observed for about one-third of the total time and generally needs to be of similar brightness (ΔR ≲ 1 mag) and separated on sky by ≲1–2°. The hops between stars were made every 6–10 min, with only 1 min gaps in on-sky integration per hop. Results. We did not detect the hypothetical fifth planet at the most plausible separations, 7.5 and 9.7 au, down to mass limits of 3.6 MJup and 2.8 MJup, respectively, but attained an unprecedented contrast limit of 11.2 magnitudes at 0.1″. We detected all four planets with high signal-to-noise ratios. The YJH spectra for planets c, d were detected with redder H-band spectral slopes than found in earlier studies. As noted in previous works, the planet spectra are matched very closely by some red field dwarfs. Finally, comparing the current locations of the planets to orbital solutions, we found that planets e and c are most consistent with coplanar and resonant orbits. We also demonstrated that with star-hopping RDI, the contrast improvement at 0.1″ separation can be up to 2 mag. Conclusions. Since ADI, meridian transit and the concomitant sky rotation are not needed, the time of observation can be chosen from within a window that is two to three times larger. In general, star-hopping can be used for stars fainter than R = 4 magnitudes, since for these a reference star of suitable brightness and separation is usually available.