The search for galaxy cluster members with deep learning of panchromatic HST imaging and extensive spectroscopy