Non-equilibrium Dynamics of Two-level Systems directly after Cryogenic Alternating Bias