You put all the shims IN ! ?
You may have to re do the swivel pin's/swivel bush's due to them having been set to loose.
Swivel pre load involves using the right number and thickness of shims to set the load [ a pull of approx 12fp at the end of steering arm] with no big seal fitted.
Land rover...