Conductivity control via minimally invasive anti-Frenkel defects in a functional oxide