New pulleys are cheap, you may need to replace yours if the oil seal has worn a groove in the old one. Once you have the new pulley it will not matter if you get a bit brutal removing the original. However I have never had much bother removing a crank pulley so yours may yield to a determined effort.