They can be bastids !
That's wot I said (or meant to say)I just replace the whole lower arm these days. The ball joint is a pain unless you have access to a pillar drill. I do have a pillar drill but still prefer to replace the bottom arm.
I had the same problem and soaked the metal shaft in release oil overnight, then put the alloy housing in the vice and with a mixture of twisting, hammering and swearing at it eventually it came out. It took two of us to do it though.my son in law replace the whole wishbone on the drivers side and then started to do the near side (left) and the big back bush just would not come off, in the end I ordered a new bush and the alloy holder and we did it, that one is now it is one the bench waiting to get the alloy housing off we have never ever had this problem before I though the nearside was a bit stiff on the suspension now we know why ,