how about a lil bit of locktite in the ball joint, make sure u use the medium or low strengt stuff so that if you gotta move the mirror again u should be able to with a bit of force and if u do knock it the glue should break and let the mirror move a bit
gunna try this then try the low first...