Your right, you don't have to remove the seat, but access is far better if you do.
Having done this job myself I'd rather do it with the seat removed for better access, after all, it's only four trim fixings, four Torx bolts & unclip the electrics to gain access, not as bad as it sounds really...