Just fix what you have.
If a keen MOT Tester sees you should have ABS you will have to put all of it back in, cos if was fitted it needs to be there in working condition for your MOT (or at least that is what the general concensus appears to be)
To remove all evidence of the ABS system you will need to remove the rear brake disc sensor rings, front and rear sensors which will mean you will need to replace the front top swivel pins - not sure what you'd do about swivel bearings and pre-load??
You will need to fit the correct brake bias valve thingy. If you have traction control then you will (lose TC) have to remove that as well as it is part of the ABS system.
I may be mistaken but I think the front callipers are different on ABS vehicles so you'll possibly need to change them.
Oh and don't forget you'll have to hide/block/remove or otherwise disguise the mounting for the rear ABS sensors that you'll be removing.
I suppose to do it properly you'll also be needing to remove all the wiring, relays, fuses as well as the ABS ECU.
Really I don't uderstand why you would want to remove the ABS system. It works really well - I know it can be a pain but you are better off fixing it. I suppose though if you're really going to do it you can maybe sell bits off to offset some of the costs and undoubted frustration - I'm sure you'll be able to sell the ABS ECU, Valve block/booster, pressure switch, pump, relays, Sensors etc.
Anyways hope that gives you some food for thought.
Good luck.