There is some history of landrovers being used as campers, and if you intend to use the 4wd capability, it is not a bad idea.
However, as you are discovering, the 4wd capability comes with a price in weight and space, and the bodies are not particularly spacious for such a large vehicle.
Provided you don't mind roughing it a bit, it should be fine. Bear in mind that the chap with the caravan mover would probably struggle on any surface that wasn't dry, and pretty much as smooth as a bowling green.
Horses for courses.