I have read a discussion elsewhere that the cause is the solenoid connectors in the Denso starter motor. Even if one changes the motor, the issues returns after a few years and it was advised to rebuild the motor with heavy duty solenoids.
To verify it, we can tap the motor with a hammer when...