The VIMOS Public Extragalactic Redshift Survey (VIPERS): Downsizing of the blue cloud and the influence of galaxy size on mass quenching over the last eight billion years