Accretion in the spin-down regime of accreting millisecond X-ray pulsars