" It is true that petroleum products will degrade natural rubber. But if an o-ring is made from, nitrile, for example (a material used in car fuel and oil lines) then there is no problem using petroleum grease to lubricate the o-ring."Just makes it very slippy for a while.
from
https://pressurewashr.com/silicone-lubricant-grease-for-rubber-o-rings/
Having done a bit of research it appears more complicated than you'd think but Red Rubber grease seems to be the safest option.