Surrogate Models for Linear Response