Looks like the centre spindle has an indent and the collet tabs lock into it.
I wouldn’t be surprised if it was brittle enough to break a few tabs trying to pull them over the end of the spindle. I’d warm everything up a bit to help things but it looks like it should just pull off.