I think wammers has it. But another possibility is bushes not assembled correctly. There must be no movement there, or there'll be an amount of undamped movement.
I had this problem and bought new dampers all round only to discover the old dampers were ok and the bushes knackered or not done up...