Stochastic ODEs and stochastic linear PDEs with critical drift : regularity, duality and uniqueness