Environmentally induced chaos: Extreme-mass-ratio systems of rotating black holes in astrophysical environments