Fourier-Mukai partners for very general special cubic fourfolds