Driving with transmission brake on can cause loads of damage!Major shuddering and kangaroo'ing could be showing worn halfshafts and prop-shaft UJs.
But driving with the handbrake on will make no difference other than wearing the shoes as already said.
Driving with transmission brake on can cause loads of damage!