We are concerned with the optimization of a functional that is constrained by a parabolic PDE. To minimize this functional, we apply an ensemble-based optimization algorithm and a modified method that introduces neural network-based surrogate functionals in conjunction with a trust-region approach.