Yes, you definitely need to disconnect the BMS from the -ve post. worst case, you buy a new one, best case, you need to reset the throughput due to implausible values.Normally I'd disconnect to charge up, then test.
To put it another way, can you damage anything by pulling a large current/dropping the voltage while it's connected to the car?
Thinking about all the BMS stuff they put on modern cars.. pyrotechnics etc