Constraints, limits and extensions for nuclear energy density functionals