The D3 can suffer from the linkage seizing up on the side of the box causing strange things to happen, bit of oil/grease fixed, I think its the same on the D4 with the 6 sped boxes ie pre 2012.
You need to get underneath so car into off road height then you MUST use an axle stand, Im no h+s freak but if it lowers you are dead it really is that simple! then look over the rear of the gearbox undertray down the drivers side and you will see the little lever sticking out of the box, where it meets the cable is the pin that seizes, proper job is strip and grease but cannot hurt to fire some aerosol grease at it and see if it improves the situation then you at least know where your problem lies.