Entropy production and correlations in a controlled non-Markovian setting