Small update!
After making sure there was no noise from the fuel tank I got annoyed and gave the fuel tank a few good kick, and all of the sudden the pump was up and running again. It sounds like it's about to give up, not the high pitch like normal, but more like a scared cat inside the tank...