Mathematical and numerical challenges in optical screening of female breast